Image acquisition method, electronic device and medium

By distinguishing between high-frequency and low-frequency jitter and only performing OIS compensation on high-frequency jitter, the problem of unstable video and poor clarity caused by jitter when shooting handheld with a mobile phone is solved, achieving higher picture clarity and user experience.

CN115633254BActive Publication Date: 2025-10-17HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110812009.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-16
Publication Date
2025-10-17
Estimated Expiration
2041-07-16

AI Technical Summary

Technical Problem

Existing mobile phones suffer from unstable and poor video clarity due to shaking when shooting handheld, and the optical image stabilization (OIS) system cannot continue to effectively prevent shaking after the shaking exceeds the motor compensation limit.

Method used

By distinguishing between high-frequency and low-frequency jitter, OIS only compensates for high-frequency jitter, and uses the compensation displacement generated by the motor to stabilize the relative position of the lens and image sensor, preventing the compensation displacement from exceeding the mechanical limit of the motor.

Benefits of technology

It improves the clarity of the video image, reduces the situation where the motor compensation displacement exceeds the limit, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115633254B_ABST
    Figure CN115633254B_ABST
Patent Text Reader

Abstract

The present application is suitable for the computer technology field, and particularly relates to an image acquisition method, an electronic device and a medium. Specifically, the image acquisition method of the present application filters out low-frequency jitter components in jitter data collected in a video shooting process, and only compensates for high-frequency jitter components by OIS jitter compensation, thereby solving the quality problem of images shot by a lens of an electronic device. The motor compensation displacement required for only compensating for high-frequency jitter components by OIS jitter compensation is small, and the situation that the OIS motor compensation displacement reaches a maximum value and the mobile phone cannot continue to be subjected to anti-shake processing can be reduced as much as possible.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to an image acquisition method, an electronic device and a medium. BACKGROUND

[0002] With the popularization of mobile phone photographing function, users have higher and higher requirements for mobile phone lens photographing. In the scene of walking, running and the like, when a user holds a mobile phone to shoot a video, there is often a problem of instability and poor definition of the video image shot by the mobile phone due to shaking.

[0003] At present, most mobile phones use two ways of electric image stabilization (EIS) or optical image stabilization (OIS) to perform anti-shake processing on the mobile phone. The principle of electric image stabilization EIS is to perform a series of stretching, clipping and the like on the image itself, which can compensate for the influence of mobile phone shaking on the image to a certain extent, but will cause the consistency and coherence of the image content to be poor, thereby affecting the definition of the image. The principle of optical image stabilization OIS is to use a motor to push the lens or the image sensor to move a specific displacement to offset the displacement caused by mobile phone shaking, which can also eliminate the influence of mobile phone shaking on the image to a certain extent, but the compensation displacement that the motor can provide is limited, so when the distance of mobile phone shaking exceeds the maximum compensation displacement that the motor can provide, optical image stabilization cannot continue to play a role. SUMMARY

[0004] Embodiments of the present application provide an image processing method and device, which divide the shaking amplitude of a mobile phone in a specific scene into high-frequency shaking and low-frequency shaking according to the low-frequency threshold or the high-frequency threshold corresponding to the scene. Since the shaking frequency of low-frequency shaking is low and the amplitude is large, the shaking effect reflected in the video shot by the mobile phone is more consistent with human prediction, while the shaking frequency of high-frequency shaking is high and the amplitude is small, the shaking effect reflected in the video shot by the mobile phone is not consistent with human prediction, so the OIS system only compensates for the high-frequency shaking in the scene, so as to improve the definition of the picture in the video.

[0005] In a first aspect, embodiments of the present application provide an image acquisition method, which can be applied to an electronic device including a motor, a lens and an image sensor, and the method includes: obtaining shaking data of the electronic device; separating a first shaking data part with a shaking frequency greater than a first threshold from the shaking data; calculating a first OIS compensation displacement of the motor based on the first shaking data part; and controlling the motor to move according to the first OIS compensation displacement to change the relative position between the lens and the image sensor in the image acquisition process.

[0006] Generally, the OIS system of the electronic device is to perform anti-shake processing on the original shake of the electronic device, in this case, the compensation displacement generated by the motor in the OIS system of the electronic device is easy to exceed the mechanical limit displacement of the motor (or the maximum compensation displacement that the motor can provide), so that the OIS system cannot effectively perform anti-shake processing on the shake of the electronic device.

[0007] Generally, the shake of the electronic device can be divided into high-frequency shake and low-frequency shake, the high-frequency shake refers to the shake with high frequency and small amplitude, and the low-frequency shake refers to the shake with low frequency and large amplitude, correspondingly, the compensation displacement generated by the motor for the low-frequency shake is greater than the compensation displacement generated by the motor for the high-frequency shake, and the high-frequency shake has a greater impact on the shooting effect of the electronic device, such as the sharpness of the image shot by the electronic device, so in some embodiments of the present application, the electronic device divides the shake data corresponding to the shake of the electronic device into high-frequency shake data (corresponding to first shake data) corresponding to the high-frequency shake and low-frequency shake data corresponding to the low-frequency shake, and only compensates for the high-frequency shake which has a greater impact on the shooting effect of the electronic device and requires a small compensation displacement, so as to reduce the compensation displacement generated by the motor for the shake of the electronic device, and further reduce the situation that the compensation displacement generated by the motor exceeds the mechanical limit displacement of the motor and the electronic device cannot be effectively anti-shake processed. In some embodiments, the shake data of the electronic device includes at least one of the angular velocity of the electronic device and the acceleration of the electronic device.

[0008] The distinction standard of the high-frequency shake data and the low-frequency shake data is whether the shake frequency of the shake data is higher than a first threshold value. In some embodiments, the setting of the first threshold value is related to the shake scene in which the electronic device is located, for example, when the electronic device is in a walking scene, the overall shake frequency of the electronic device is not high at this time, so the first threshold value is set to a small value, such as setting the first threshold value to the average value of the shake frequency of the electronic device in the walking scene, when the electronic device is in a running scene, the overall shake frequency of the electronic device is high at this time, so the first threshold value is set to a large value, such as setting the first threshold value to the average value of the shake frequency of the electronic device in the running scene. In some embodiments, the first threshold value is greater than or equal to 1.5 Hz and less than or equal to 2.5 Hz. The setting method of the first threshold value will be described in detail in the specific embodiment part below, which will not be described here.

[0009] After the electronic device separates the high-frequency jitter data from the jitter data according to the first threshold value, the motor of the OIS system will generate a compensation displacement (corresponding to the first OIS compensation displacement) according to the jitter amplitude corresponding to the high-frequency jitter data, and then adjust the relative position between the lens and the image sensor of the electronic device according to the compensation displacement, so that the light path of the light passing through the lens and reaching the image sensor remains stable, and the light finally remains unchanged at the imaging position of the image sensor, thereby realizing the anti-shake processing of the electronic device.

[0010] In combination with the first aspect, in a possible implementation manner of the first aspect, after obtaining the jitter data of the electronic device, in a case where the electronic device is in a first jitter scene, a first jitter data part with a jitter frequency greater than the first threshold value is separated from the jitter data; and the method further includes: in a case where the electronic device is in a second jitter scene, calculating a second OIS compensation displacement of the motor based on the obtained jitter data, and controlling the motor to move according to the second OIS compensation displacement to change the relative position between the lens and the image sensor; wherein the jitter frequency of the jitter data in the first jitter scene is greater than the jitter frequency of the jitter data in the second jitter scene. In some embodiments, the first jitter scene includes a running scene or a walking scene, and the second jitter scene includes a handheld scene.

[0011] It can be understood that in some scenarios, for example, in a handheld scenario, the jitter frequency and jitter amplitude of the electronic device will not be too high, and in this case, even if the electronic device directly performs anti-shake processing on the jitter data, the compensation displacement generated by the motor of the OIS system of the electronic device will not exceed the mechanical limit displacement of the motor, so at this time the electronic device can directly calculate the second compensation displacement of the motor according to the jitter data, so that the motor changes the relative position between the lens and the image sensor according to the second compensation displacement.

[0012] In some embodiments, the OIS system of the electronic device can also adopt different working modes respectively to perform targeted anti-shake processing on the electronic device in the first shaking scenario or the second shaking scenario described above, so as to better achieve the anti-shake processing on the electronic device. For example, for the first shaking scenario with a larger shaking frequency, the OIS system of the electronic device can adopt a "band-pass" working mode to filter the shaking data of the electronic device, and then separate the high-frequency shaking data in the shaking data of the electronic device, and only perform anti-shake processing on the electronic device according to the high-frequency shaking data. For the second shaking scenario with a smaller shaking frequency, the OIS system of the electronic device can adopt a "all-pass" working mode, that is, still filter the shaking data of the electronic device, but the filtering is only to filter out the noise data in the electronic device, and then without distinguishing the high-frequency shaking data and the low-frequency shaking data in the shaking data of the electronic device, directly perform anti-shake processing on the electronic device according to the shaking data of the electronic device. Specific implementation details will be described in detail in the specific embodiments below.

[0013] With reference to the first aspect and the possible implementation manners thereof, in a possible implementation manner of the first aspect, the electronic device controls the movement of the motor according to the first OIS compensation displacement to change the relative position between the lens and the image sensor, comprising: in the case that the first OIS compensation displacement is greater than the mechanical limit displacement of the motor, adjusting the first OIS compensation displacement by using a compensation coefficient to obtain a third OIS compensation displacement smaller than the first OIS compensation displacement; and controlling the movement of the motor according to the third OIS compensation displacement to change the relative position between the lens and the image sensor; wherein the compensation coefficient is determined based on the focal length of the lens and the accuracy of the component of the electronic device used to collect the shaking data.

[0014] It can be understood that since the first OIS compensation displacement can also be greater than the mechanical limit displacement of the motor, in some embodiments, when the first OIS compensation displacement also exceeds the mechanical limit displacement of the motor, the electronic device can also adjust the first OIS compensation displacement by using a compensation coefficient to reduce the first OIS compensation displacement, so that the reduced first OIS compensation displacement (i.e. the third compensation displacement described above) does not exceed the mechanical limit displacement of the motor. The compensation coefficient is determined based on the focal length of the lens of the electronic device and the accuracy of the component of the electronic device used to collect the shaking data.

[0015] In a second aspect, an electronic device is provided. The electronic device includes a motion sensor, an OIS controller, a motor, a lens, and an image sensor. The motion sensor is configured to collect shaking data of the electronic device and send the shaking data to the OIS controller. The OIS controller is configured to separate, from the shaking data, a first shaking data portion having a shaking frequency greater than a first threshold, and calculate a first OIS compensation displacement of the motor based on the first shaking data portion. The OIS controller is further configured to control the motor to move based on the first OIS compensation displacement, so as to change a relative position between the lens and the image sensor during image acquisition.

[0016] With reference to the second aspect, in a possible implementation manner of the second aspect, after the OIS controller obtains the shaking data of the electronic device, the OIS controller separates, from the shaking data, a first shaking data portion having a shaking frequency greater than a first threshold, in a case that the electronic device is in a first shaking scenario. The OIS controller calculates a second OIS compensation displacement of the motor based on the obtained shaking data, in a case that the electronic device is in a second shaking scenario, and controls the motor to move based on the second OIS compensation displacement, so as to change the relative position between the lens and the image sensor. The shaking frequency of the shaking data in the first shaking scenario is greater than the shaking frequency of the shaking data in the second shaking scenario.

[0017] With reference to the second aspect and the possible implementation manner, in another possible implementation manner of the second aspect, the first shaking scenario includes a running scenario or a walking scenario, and the second shaking scenario includes a handheld scenario.

[0018] With reference to the second aspect and the possible implementation manner, in still another possible implementation manner of the second aspect, the motion sensor includes at least one of a gyroscope sensor and an acceleration sensor, and

[0019] The shaking data includes at least one of an angular velocity of the electronic device and an acceleration of the electronic device.

[0020] With reference to the second aspect and the possible implementation manner, in still another possible implementation manner of the second aspect, the OIS controller controls the motor to move, so as to change the relative position between the lens and the image sensor, by: in a case that the first OIS compensation displacement is greater than a mechanical limit displacement of the motor, adjusting the first OIS compensation displacement by using a compensation coefficient to obtain a third OIS compensation displacement smaller than the first OIS compensation displacement; and controlling the motor to move based on the third OIS compensation displacement, so as to change the relative position between the lens and the image sensor. The compensation coefficient is determined based on a focal length of the lens and a precision of a component of the electronic device used to collect the shaking data.

[0021] With reference to the second aspect and the possible implementation manners of the first aspect, in a possible implementation manner of the second aspect, the first threshold is greater than or equal to 1.5 Hz and less than or equal to 2.5 Hz.

[0022] In a third aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium storing a computer program, and the computer program is executed by a processor to implement the image acquisition method in any one of the first aspect.

[0023] In a fourth aspect, an embodiment of the present application provides a computer program product, when the computer program product is run on an electronic device, the electronic device is caused to execute the image acquisition method in any one of the first aspect.

[0024] It can be understood that the beneficial effects of the second aspect to the fourth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0026] Figure 1 Fig. 1 is a hardware structure schematic diagram of a mobile phone provided by some embodiments;

[0027] Figure 2 Fig. 2 is a schematic diagram of an OIS system provided by some embodiments;

[0028] Figure 3A Fig. 3 is a schematic diagram of an OIS module provided by some embodiments;

[0029] Figure 3B Fig. 4 is a side view of the OIS module in Fig. 3; Figure 3A

[0030] Fig. 5 is a schematic diagram of a vibration mode of the OIS module provided by some embodiments; Figure 3C

[0031] Fig. 6 is a schematic diagram of a vibration mode of the OIS module provided by some embodiments; Figure 3D

[0032] Fig. 7 is a schematic diagram of a vibration amplitude curve of mobile phone vibration in a walking scene provided by some embodiments; Figure 4

[0033] Fig. 8 is a schematic diagram of a vibration amplitude curve of mobile phone vibration in a walking scene provided by some embodiments; and Figure 5is a schematic diagram of a mobile phone shaking provided by some embodiments;

[0034] Figure 6 is a schematic diagram of a compensation displacement curve of an OIS motor provided in some embodiments;

[0035] Figure 7 is a schematic diagram of a jitter amplitude curve of a mobile phone on the x-axis provided by some embodiments;

[0036] Figure 8 yes Figure 7 Schematic diagram of the jitter amplitude curve of the mobile phone on the x-axis after time integration;

[0037] Figure 9A is a schematic diagram of an OIS controller structure provided by some embodiments;

[0038] Figure 9B is based on Figure 9A Schematic diagram of the image acquisition method implemented by the OIS controller shown;

[0039] Figure 10A This is a schematic diagram of the effect of a mobile phone after anti-shake processing on the x-axis, provided by some embodiments;

[0040] Figure 10B This is a schematic diagram of the effect of a mobile phone after anti-shake processing on the y-axis, provided by some embodiments;

[0041] Figure 11A This is an example of an image processed by the image acquisition method of the present application, provided in some embodiments;

[0042] Figure 11B This is an example of an image provided by some embodiments that has not been processed by the image acquisition method of the present application. DETAILED DESCRIPTION

[0043] Illustrative embodiments of the present application include, but are not limited to, image acquisition methods, electronic devices, and media thereof.

[0044] The technical solutions of the embodiments of the present application are described below with reference to the accompanying drawings.

[0045] To solve the problems mentioned in the background, the embodiment of the present application discloses an image acquisition method based on OIS. Specifically, the jitter data of the electronic device collected by the motion sensor such as the gyroscope sensor in the electronic device can be divided into high-frequency jitter component and low-frequency jitter component. The technical solution of the present application filters out the low-frequency jitter component in the jitter data and only compensates the high-frequency jitter component by OIS jitter to solve the quality problem of the image shot by the lens of the electronic device. Since the motor compensation displacement required for OIS jitter compensation of the high-frequency jitter component is small, it can reduce the situation that the OIS motor compensation displacement reaches the maximum value and the mobile phone cannot continue to be deblurred as much as possible.

[0046] In addition, since the jitter frequency of the electronic device caused by the low-frequency jitter component is low, the change caused by the collected image during the shooting of the video is slow, and the human eye is more accustomed to this change. The jitter frequency of the electronic device caused by the high-frequency jitter component is high, and the influence on the collected image is large, or in other words, the human eye is more sensitive to the image distortion caused by the high-frequency jitter component. Therefore, only the high-frequency jitter component is compensated by OIS jitter, which can effectively reduce the distortion of the image caused by the jitter of the electronic device and will not reduce the user experience.

[0047] It can be understood that the image acquisition method provided by the embodiment of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The specific type of the terminal device is not limited by the embodiment of the present application. For the sake of convenience, the image processing method of the present application will be described in detail below by taking a mobile phone 10 as an example.

[0048] Figure 1 is a structural schematic diagram of an example of a mobile phone 10 provided by the present application.

[0049] Specifically, as Figure 1As shown, the mobile phone 10 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a lens 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include an image sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a hall sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0050] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors. In some embodiments, the image signal processor is a unit used to process the electrical signal output by the image sensor 180A to match different manufacturers of image sensors 180A.

[0051] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0052] The processor 110 can also include memory that stores instructions and data. In some embodiments, the memory within the processor 110 is a cache memory. This memory can hold instructions or data that the processor 110 has recently used or has used frequently. If the processor 110 needs to use that instruction or data again, it can be accessed directly from the memory. This avoids repeated accesses and reduces the latency of the processor 110, thus improving the efficiency of the system.

[0053] In some embodiments, the processor 110 can include one or more interfaces.

[0054] The charging management module 140 is configured to receive charging input from a charger. The power management module 141 is configured to connect a battery 142 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display screen 194, the lens 193, and the wireless communication module 160. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In other embodiments, the power management module 141 can also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0055] The wireless communication function of the mobile phone 10 can be achieved through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, and the like.

[0056] The display function of the mobile phone 10 can be achieved through the GPU, the display screen 194, and the application processor, and the like. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0057] The camera function of the mobile phone 10 can be achieved through the ISP, the lens 193, the video codec, the GPU, the display screen 194, and the application processor, and the like. In some embodiments, the user takes a picture through the lens 193, the light passes through the lens 193 to reach the image sensor 180A, the image sensor 180A converts the light signal into an electrical signal, and the ISP performs related processing, and finally displays on the display screen 194.

[0058] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to extend the storage capacity of the mobile phone 10. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.

[0059] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application required by a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data created during use of the mobile phone 10 (such as audio data, a phonebook, etc.), and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like. The processor 110 executes various function applications and data processing of the mobile phone 10 by running instructions stored in the internal memory 121 and / or instructions stored in a memory disposed in the processor.

[0060] The mobile phone 10 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, an application processor, and the like. For example, music playing, recording, and the like.

[0061] The keys 190 include a power-on key, a volume key, and the like.

[0062] The motor 191 can generate a vibration prompt. In some embodiments, the motor 191 can include a motor 191-1 for the x-axis and a motor 191-2 for the y-axis in the OIS system 100 of the mobile phone 10. Both the motor 191-1 and the motor 191-2 are used to generate a compensation displacement according to a control signal sent by an OIS controller, and then push the lens 193 or the image sensor 180A to move to a position that can offset a displacement caused by shaking of the mobile phone 10.

[0063] The indicator 192 can be an indicator light, which can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 is used to connect a SIM card.

[0064] It can be understood that the structure of the embodiments of the present application does not constitute a specific limitation of the mobile phone 10. In other embodiments of the present application, the mobile phone 10 can include more or fewer components than the illustration, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0065] In order to facilitate the understanding of the technical solutions of the present application, first of all, according to some embodiments of the present application, an OIS technology in the mobile phone 10 will be introduced.

[0066] Specifically, the OIS technology is to collect the shaking data of the mobile phone when shaking, such as the angular velocity of the mobile phone shaking, through a motion sensor, such as a gyroscope sensor or an acceleration sensor. Then the OIS controller 102 in the OIS module generates a control signal according to the shaking data of the mobile phone when shaking, which can control the OIS motor to generate a compensation displacement. After that, the OIS motor is powered on according to the control signal and pushes the lens 193 or the image sensor 180A to move to a position that can offset the displacement of the mobile phone shaking, so that the light path of the light passing through the lens 193 to the image sensor 180A is as stable as possible during the shooting process, and the imaging position of the object on the image sensor 180A is as stable as possible, so as to obtain a clearer image.

[0067] Figure 2 The structure of an OIS system 100 for implementing the OIS technology in the mobile phone 10 is shown.

[0068] As shown in Figure 2 The OIS system 100 includes an OIS controller 102, an image sensor 180A, a gyroscope sensor 180B, an X-axis Hall sensor 180D-1, a Y-axis Hall sensor 180D-2, an X-axis OIS motor 191-1, a Y-axis OIS motor 191-2, and a lens 193.

[0069] The image sensor 180A belongs to a light sensing element for light sensing. The image sensor 180A can use the photoelectric conversion function of the photoelectric device to convert the light image on the light sensing surface into an electric signal in a corresponding proportional relationship with the light image, that is, convert the optical signal into an analog image signal corresponding to the optical signal, and output to the graphics processing unit (not shown) of the mobile phone 10. Finally, the graphics processing unit generates an image according to the received analog image signal.

[0070] The gyroscope sensor 180B is used to collect the shaking data of the mobile phone 10, such as the angular velocity. In some embodiments, in the scene of walking or running, when the user holds the mobile phone 10 to shoot, the gyroscope sensor 180B will collect the shaking data of the mobile phone 10 following the user's movement.

[0071] The OIS controller 102 is configured to obtain the shaking data of the mobile phone 10 collected by the gyroscope sensor 180B, and generate a control signal for the OIS motor 191 to generate a compensation displacement according to the shaking data of the mobile phone 10 collected by the gyroscope sensor 180B, and control the X-axis OIS motor 191-1 to push the lens 193 in the x-axis direction and control the Y-axis OIS motor 191-2 to push the lens 193 in the y-axis direction through the control signal, so that the lens 193 is finally moved to a position that can offset the displacement of the mobile phone 10 caused by shaking.

[0072] The X-axis Hall sensor 180D-1 is configured to detect the movement of the lens 193 in the X-axis direction, and the X-axis Hall sensor 180D-1 is also configured to send the real-time position of the lens 193 moved in the X-axis direction to the OIS controller 102. The Y-axis Hall sensor 180D-2 is configured to detect the movement of the lens 193 in the Y-axis direction, and the Y-axis Hall sensor 180D-2 is configured to send the real-time position of the lens 193 moved in the Y-axis direction to the OIS controller 102.

[0073] The OIS controller 102 is also configured to generate a new control signal to control the above-mentioned motor to push the lens 193 to move in the x-axis and / or y-axis according to the received new position of the lens 193 and the new shaking data of the mobile phone 10 obtained by the gyroscope sensor 180B, so as to realize continuous closed-loop control, so that the light path of the light passing through the lens 193 to the image sensor 180A is maintained stable during the entire shooting period.

[0074] It can be understood that, as described above, the OIS system 100 is composed of various components in the mobile phone 10 for cooperating to realize the OIS compensation technology. In some other embodiments, the OIS compensation technology can also be realized by a separate system, which is not limited herein.

[0075] Figure 3A is a top view of an OIS module 200 provided by some embodiments of the present application, wherein the OIS module 200 includes an OIS coil 202, an OIS magnet 204, a spring 206, a lens 193, a gyroscope sensor 180B, an OIS controller 102, a motor 191, etc.

[0076] Figure 3B is a side view of the OIS module 200, as shown in Figure 3A The OIS module 200 further includes an image sensor 180A. Figure 3B

[0077] as shown in Figure 3A and 3B ​As shown, the lens 193 is suspended inside the OIS module 200 by a spring 206. When the OIS controller 102 determines that the lens 193 needs to be pushed, the OIS controller 102 generates different electromagnetic effects by controlling the magnitude of the current flowing on the OIS coil 202, thereby causing the OIS magnet 204 inside the OIS module 200 to generate magnetic force to push the lens 193 to move.

[0078] When the lens 193 moves, the position of the Hall magnet (not shown) on the lens 193 changes. At this time, the Hall sensor (not shown) located inside the OIS module 200 can detect the real-time movement of the lens 193 and transmit the Hall signal to the OIS controller 102, so that the OIS controller 102 generates a new control signal to control the motor 191 to continue to push the lens 193 to move according to the new position of the lens 193 and the new motion data of the mobile phone collected by the gyroscope sensor 180B, so that the optical path of the light passing through the lens 193 to the image sensor 180A can be maintained stable during the entire shooting period, so that the position where the object is finally imaged on the image sensor 180A remains stable.

[0079] Figure 3C 1 is a schematic diagram of an example of a motor 191 driving a lens 193 to move horizontally, provided in some embodiments of the present application. Figure 3D This is a schematic diagram of an example of a motor 191 driving a lens 193 to deflect, provided in some embodiments of the present application. Figure 3C and Figure 3D As can be seen from the figure, the motor 191 can push the lens 193 to move horizontally or drive the lens 193 to deflect to offset the displacement of the mobile phone 10 due to shaking.

[0080] It should be noted that Figure 3C as well as Figure 3D The manner in which the motor 191 drives the lens 193 is merely exemplary and does not constitute a complete Figure 3C as well as Figure 3D The number or type of specific components in the Figure 3D For example, in some embodiments, an optical prism can be added above the lens 193, and the motor 191 can be Figure 3D When compensating for the shake of the mobile phone 10 in the manner shown, a compensating displacement can be generated to drive the optical prism to rotate, so that the light undergoes physical phenomena such as reflection and refraction in the optical prism, and the imaging position that finally reaches the image sensor 180A remains stable.

[0081] And, for the sake of ease of understanding, the text is Figure 3C However, it should be understood that the principles and methods of this application are also applicable to the use of Figure 3DThe method shown in FIG. 1 is used to perform anti-shake processing on the mobile phone 10. Figure 3C The method shown in FIG. 1 is to compensate for the shake of the mobile phone 10 by pushing the lens 193 to perform translational motion by the motor 191. The compensation displacement unit generated by the motor 191 is in millimeters (mm). Figure 3D In the method shown, that is, the motor 191 drives the lens 193 or the above-mentioned optical prism to rotate to compensate for the shake of the mobile phone 10, the unit of the compensation displacement generated by the motor 191 will be degree, which will not be repeated below.

[0082] In some embodiments, the OIS controller 102 can also control the motor 191 to push the image sensor 180A to a position that can compensate for the displacement caused by the shaking of the mobile phone 10. The principle of the OIS controller 102 controlling the motor 191 to push the image sensor 180A to move is the same as the principle of the OIS controller 102 controlling the motor 191 to push the lens 193 to move, and will not be repeated here.

[0083] In other embodiments, the OIS module 200 may be a voice coil actuator / voice coil motor (VCM) type OIS module, a ball piston type hydraulic motor type OIS module, a shape memory alloy (SMA) type OIS module, a piezoelectric OIS module, a stepper motor type OIS module, or an OIS module with a liquid lens, etc. The present application does not limit the specific form of the OIS module.

[0084] From the working principle of the above-mentioned OIS module 200, it can be seen that the OIS module 200 can generate compensatory displacement by controlling the motor 191, thereby pushing the lens 193 or the image sensor 180A to move, so as to offset the displacement caused by the shaking of the mobile phone 10, so that when the user takes a picture, the imaging position of the object on the image sensor 180A will not change due to the shaking of the mobile phone 10, thereby allowing the user to obtain stable and clear images.

[0085] However, it is understood that the compensation displacement of the motor 191 is limited, and the motor 191 cannot continue to provide the compensation displacement when the motor 191 reaches the mechanical limit, at which time the compensation displacement of the motor 191 is the maximum compensation displacement. When the displacement of the mobile phone 10 due to shaking is greater than the maximum compensation displacement of the motor 191, the OIS controller 102 cannot control the motor 191 to continue to generate the compensation displacement to push the lens 193 or the image sensor 180A to continue to move. At this time, since the compensation displacement of the motor 191 has reached the maximum value, the OIS module 200 cannot function to eliminate or reduce the impact of the shaking of the mobile phone 10 on the image in the above manner, and a clear image is generated.

[0086] For example, taking the focal length of the mobile phone 10 as 125 millimeters (mm) as an example, Figure 4 is an example of a shaking amplitude curve of the mobile phone 10 in a walking scenario when the sampling rate of the signal is 100 Hz, which is provided by some embodiments of the present application. Wherein A represents the shaking amplitude of the mobile phone (unit: degree (degree)), t represents the sampling time of the gyroscope sensor 180B (unit: second (s)), the solid line represents the shaking amplitude curve of the mobile phone 10 on the x-axis, and the dashed line represents the shaking amplitude curve of the mobile phone 10 on the y-axis.

[0087] From Figure 4 It can be seen that when the user holds the mobile phone 10 to take a picture while walking, the shaking amplitude of the mobile phone 10 is generally between 0° and 3.5°. Then, the mobile phone 10 determines the compensation displacement that the motor 191 needs to generate at the corresponding moment based on the shaking amplitude curve of the mobile phone 10. Figure 4

[0088] In some embodiments, the mobile phone 10 can calculate the compensation displacement of the motor 191 corresponding to the shaking amplitude of the mobile phone 10 by using formula (one).

[0089] Specifically, taking the calculation of the compensation displacement of the motor 191 corresponding to the shaking amplitude curve of the mobile phone 10 on the x-axis as an example, as shown in Figure 5 assuming that the object A originally images at point a of the image sensor 180A, due to the shaking of the mobile phone and the shaking amplitude θ, the object A moves to A' relative to the mobile phone 10, and correspondingly, A' images at point a' of the image sensor 180A. At this time, the distance d from a' to a is the compensation displacement that the motor 191 needs to compensate to push the lens 193, wherein the distance from a' to a can be calculated by the following formula (one).

[0090] Dist=tan(θ)*focal_length≈θ*focal_length(one)

[0091] ​Among them, Dist represents the compensation displacement of the motor 191 (unit: millimeter (mm)), θ represents the offset angle (or jitter amplitude) of the mobile phone 10 on a certain axis, and focal_length represents the focal length of the mobile phone 10.

[0092] The mobile phone 10 uses the above formula (1) to calculate Figure 4 The compensation displacement of the motor 191 on the x-axis and y-axis at each moment can be obtained as follows: Figure 6 A graph of the compensated displacement of motor 191 is shown.

[0093] like Figure 6 As shown, s represents the compensation displacement generated by motor 191 (unit: mm), t represents the time for motor 191 to generate the compensation displacement (unit: ms), the solid line represents the compensation displacement of motor 191 on the x-axis, and the dotted line represents the compensation displacement of motor 191 on the y-axis.

[0094] from Figure 6 It can be seen that the maximum compensation displacement of motor 191 is about 100mm, and the focal length of mobile phone 10 is 125mm, so the maximum compensation displacement of motor 191 is converted into the corresponding mobile phone shaking amplitude of arctan(100 / 125)*180 / π=0.8° using formula (1).

[0095] That is, the motor 191 can only compensate for the vibration of the mobile phone 10 with a vibration amplitude of 0.8 degrees through the maximum compensation displacement, and Figure 6 As can be seen in the figure, when the vibration amplitude of the phone 10 exceeds 0.8 degrees, the compensation displacement of the motor 191 will remain at its maximum value and cannot continue to increase. In other words, the OIS module 200 cannot control the motor 191 to continue to provide compensation displacement for subsequent anti-shake processing. For example, as mentioned above, when a user holds the phone 10 while walking to shoot, the vibration amplitude of the phone 10 is generally between 0° and 3.5°. In other words, the vibration of the phone 10 in walking scenes can no longer be effectively compensated.

[0096] In addition, as mentioned earlier, in common scenarios such as walking and running, the amplitude of mobile phone jitter can be divided into high-frequency jitter components and low-frequency jitter components. The motor compensation displacement required for OIS jitter compensation of the high-frequency jitter component is smaller, which can possibly reduce the situation where the OIS motor compensation displacement reaches the maximum value and the mobile phone cannot continue to be anti-shake processed. Moreover, only performing OIS jitter compensation on the high-frequency jitter component can also effectively reduce the distortion of the image caused by the jitter of the electronic device without reducing the user experience.

[0097] For example, Figure 7As shown, continue to take the example of the phone 10 shaking in the x-axis, where w represents the angular velocity w (unit: degree / s) of the phone shaking, t represents the sampling time (unit: s) of the gyroscope sensor 180B, the dashed line represents the angular velocity curve of the high-frequency shaking of the phone 10, the dotted line represents the angular velocity curve of the low-frequency shaking of the phone 10, and the solid line represents the original shaking amplitude curve of the phone 10 shaking in the x-axis.

[0098] As can be seen from Figure 7 , the angular velocity of the high-frequency shaking component is much lower than that of the low-frequency shaking component. For example, when the sampling time is 11.5s and 22s respectively, the angular velocity of the high-frequency shaking component is -3° and -2.3° respectively, while the angular velocity of the low-frequency shaking component is about 0°.

[0099] Correspondingly, in order to more conveniently understand the difference between the two, the angular velocity curve can be converted into the shaking amplitude curve. For example, the phone 10 shakes in the x-axis Figure 7 The angular velocity of the phone 10 shaking in the x-axis is integrated according to the sampling time, as shown in Figure 8 , to obtain the shaking amplitude curve of the phone 10 in the x-axis. In some embodiments, the shaking amplitude of the phone 10 in the x-axis can be integrated according to the following integral formula (two) according to the angular velocity of the phone 10 shaking in the x-axis Figure 7 , according to the sampling time t:

[0100]

[0101] , where θ is the angle, ω is the angular velocity, and t represents the sampling time.

[0102] As shown in Figure 8 , where A represents the shaking amplitude of the phone 10 in the x-axis (unit: degree), t represents the sampling time (unit: s) of the gyroscope sensor 180B, the dotted line represents the curve of the high-frequency shaking component in the shaking amplitude of the phone 10, the dashed line represents the curve of the low-frequency shaking component in the shaking amplitude of the phone 10, and the solid line represents the original shaking data curve of the phone 10 shaking in the x-axis.

[0103] As can be seen from Figure 8 , the shaking amplitude in the low-frequency shaking component is larger than that in the high-frequency shaking component, which means that the compensation displacement of the motor 191 required by the low-frequency shaking component is larger than that of the high-frequency shaking, that is, the motor 191 is more likely to reach or even exceed the maximum compensation displacement of the motor 191 when compensating for the displacement of the low-frequency shaking, and it is relatively difficult for the motor 191 to exceed the maximum compensation displacement of the motor 191 when compensating for the displacement of the high-frequency shaking.

[0104] For example, at t=4s, the jitter amplitude of the original jitter data is-2°, according to formula (I), the compensation displacement of the motor 191 required at this time is 250mm, the jitter amplitude of the low-frequency jitter component of the original jitter data is-1.5°, according to formula (I), the compensation displacement of the motor 191 corresponding to the low-frequency jitter component is 137.5mm, and the jitter amplitude of the high-frequency jitter component in the original jitter data is-0.5°, according to formula (I), the compensation displacement of the motor 191 corresponding to the high-frequency jitter component is 62.5mm, it can be seen that the compensation displacement of the motor 191 corresponding to the high-frequency jitter component is much smaller than the compensation displacement of the motor 191 corresponding to the low-frequency jitter component and the original jitter data.

[0105] Moreover, it can be seen from Figure 8 that the maximum jitter amplitude of the mobile phone 10 is about-3°, at this time, the low-frequency jitter amplitude of the original jitter data is about-2.8°, according to formula (I), the compensation displacement of the motor 191 corresponding to the maximum jitter amplitude of the mobile phone 10 and the low-frequency jitter amplitude both exceeds the maximum compensation displacement 100mm of the motor 191, while the high-frequency jitter amplitude at this time is only 0.5°, the compensation displacement of the motor 191 corresponding to the high-frequency jitter amplitude is 62.5mm, which does not exceed the maximum compensation displacement of the motor 191, that is, within the maximum compensation displacement 100mm of the motor 191, the high-frequency jitter component of the mobile phone 10 can still be compensated for jitter to realize the anti-shake processing of the mobile phone 10.

[0106] Therefore, the present application provides an image acquisition method, which only processes the high-frequency jitter component in the jitter data for anti-shake, and can be implemented based on the OIS system 100 described above, wherein the structure of an OIS controller 102 in the OIS system 100 is as shown in Figure 9A For ease of understanding, the image acquisition method is described below in combination with Figure 9A .

[0107] As shown in Figure 9A , the OIS controller 102 includes a HallAmp 810, an analog-to-digital conversion circuit 820, a servo filter unit 830, a pulse width modulation unit 840, and a gyroscope filter unit 870.

[0108] The Hall Amp 810 is used to feed back the position of the lens 193, the analog-digital conversion circuit 820 is used to convert the digital signal of the current size controlled by the OIS controller 102 to the actual circuit current, the servo filter unit 830 is used to adjust the driving output of the motor 191 in real time according to the position of the lens 193 fed back by the Hall Amp 810, so as to control the displacement of the motor 191 pushing the lens 193, the pulse width modulation unit 840 is used to control the current or voltage output to drive the motor 191 to move, and the gyroscope filter unit 870 is used to filter the jitter data of the mobile phone 10, so as to separate the high-frequency jitter component of the mobile phone 10 or filter out the noise in the jitter data of the mobile phone 10.

[0109] Specifically, in the OIS controller 102 shown in the figure, the gyroscope filter unit 870 filters the jitter data of the mobile phone 10 collected by the gyroscope sensor 180B according to a preset high-frequency threshold, so as to filter out the low-frequency jitter component in the jitter data and obtain the high-frequency jitter component in the jitter data of the mobile phone 10. Figure 9A

[0110] For example, the preset high-frequency threshold can be selected as 2hz, 2.5hz, etc. In some embodiments, for the scene of high jitter frequency and the scene of low jitter frequency, the preset high-frequency threshold can be set as the general jitter frequency of the scene of low jitter frequency, for example, for the running scene and the walking scene, the preset high-frequency threshold can be the frequency of the jitter of the mobile phone 10 in the walking scene, i.e. 1.5hz. In this way, the jitter component higher than 1.5hz in the jitter data of the mobile phone 10 is the high-frequency jitter component, and the jitter component lower than 1.5hz in the jitter data of the mobile phone 10 is the low-frequency jitter component.

[0111] In addition, in other embodiments, since the main functions of different models of mobile phones 10 are different, for example, the main function of the beautifying photographing mobile phone 10 is photographing, and the main function of the business mobile phone 10 is the security function. Therefore, the demand for anti-shake of the mobile phone 10 when the user uses the beautifying photographing mobile phone 10 to take a photograph is higher than the demand for anti-shake when the user uses the business mobile phone 10 to take a photograph. Therefore, the preset high-frequency threshold of the beautifying photographing mobile phone 10 can be set as a higher value, so as to ensure that the compensation displacement provided by the motor 191 does not exceed the maximum compensation displacement of the motor 191 when the beautifying photographing mobile phone 10 is processed for anti-shake. For the business mobile phone 10 with lower demand for anti-shake, the preset high-frequency threshold of the business mobile phone 10 can be set as a lower value to meet the lowest photographing demand of the user.

[0112] It should be understood that the application does not limit the setting method of the preset high-frequency threshold.

[0113] ​Since the filtering process of the gyroscope filter unit 870 is based on Z-domain IIR filtering, a phase difference will occur between the phase of the high-frequency jitter component and the phase of the original jitter data of the mobile phone 10. Therefore, the phase of the high-frequency jitter component needs to be adjusted by the servo filter unit 830 to obtain a function of the high-frequency jitter component that is consistent with the phase of the original jitter data of the mobile phone 10.

[0114] Then, the mobile phone 10 calculates a compensation displacement function of the motor 191 corresponding to the function of the high-frequency jitter component, so that the motor 191 only generates a compensation displacement for the high-frequency jitter component to avoid the situation that the motor 191 reaches or exceeds the maximum compensation displacement and then cannot continue to generate a compensation displacement for the jitter of the mobile phone 10.

[0115] Specifically, based on Figure 9A the OIS controller 102 shown in FIG. 1, Figure 9B a method flow diagram for performing an anti-shake process on the mobile phone 10 by using the OIS controller 102 is provided for some embodiments of the present application. As shown in Figure 9B the method 1000 includes:

[0116] Step 1002: The mobile phone 10 collects jitter data when the mobile phone 10 is jittering by using the gyroscope sensor 180B.

[0117] In some embodiments, the mobile phone 10 can collect jitter data of the mobile phone 10 in real time by using the gyroscope sensor 180B, where the jitter data includes angular velocity or acceleration when the mobile phone 10 is jittering.

[0118] In some embodiments, in order to reduce the power consumption of the mobile phone 10, the mobile phone 10 can also collect jitter data of the mobile phone 10 by using the gyroscope sensor 180B every interval of a preset time length, such as 1 second, 2 seconds, etc.

[0119] In some other embodiments, the mobile phone 10 can also adjust the time interval for collecting jitter data of the mobile phone 10 by using the gyroscope sensor 180B in real time according to the scene in which the user is located. For example, when the mobile phone 10 determines that the current scene is a running scene, the frequency of the jitter of the mobile phone 10 will be relatively high, and the mobile phone 10 can adjust the time interval for collecting jitter data of the mobile phone 10 by using the gyroscope sensor 180B to be small, such as 1 second, 2 seconds, etc. When the mobile phone 10 determines that the current scene is a walking scene, the frequency of the jitter of the mobile phone 10 will be relatively low, and the mobile phone 10 can adjust the time interval for collecting jitter data of the mobile phone 10 by using the gyroscope sensor 180B to be large, such as 5 seconds, 10 seconds, etc. Wherein, how the mobile phone 10 judges the current scene will be described in detail below, and thus will not be described here.

[0120] Furthermore, in other embodiments, the mobile phone 10 may also collect the shake data of the mobile phone 10 through other components, not limited to the gyroscope sensor. For example, the mobile phone 10 may collect acceleration data of the mobile phone 10 through an accelerometer, and use the acceleration data to perform anti-shake processing on the mobile phone 10. The principle of the mobile phone 10 using acceleration data for anti-shake processing is the same as the principle of the mobile phone 10 using the angular velocity of the mobile phone 10 collected by the gyroscope sensor 180B for anti-shake processing. For details, please refer to the method of the mobile phone 10 using the angular velocity of the mobile phone 10 collected by the gyroscope sensor 180B for anti-shake processing, which will not be repeated here.

[0121] Step 1004: The mobile phone 10 determines the current scene of the mobile phone 10 based on the jitter data.

[0122] After the mobile phone 10 obtains its jitter data in step 1002, the mobile phone 10 can determine the current scenario based on the jitter data and then, based on the specific scenario, determine whether to adopt a jitter compensation scheme that only compensates for high-frequency jitter components. That is, in some scenarios, the jitter amplitude of the mobile phone 10 is small, and jitter compensation can be performed on the entire jitter data. In other scenarios, the jitter amplitude of the mobile phone 10 is large, and only high-frequency jitter components can be compensated.

[0123] Specifically, when the jitter amplitude is generally small and the signal variance is small, the mobile phone 10 will determine that the current scene is a low-jitter scene, such as walking scenes, handheld scenes, and scenes in a smoothly moving vehicle. When the jitter amplitude is large and the jitter amplitude is mainly distributed in a specific frequency band, such as 2-4 Hz, the mobile phone 10 will determine that the current scene is a high-jitter scene, such as running scenes, jogging scenes, and scenes in a relatively bumpy vehicle. It should be noted that the handheld scene refers to the scene where the user is in a relatively static state and holding the mobile phone 10 to shoot. The signal variance is used to represent the volatility of the signal when the mobile phone 10 collects the mobile phone 10 jitter data through the gyroscope sensor 180B. If the volatility of the signal when the mobile phone 10 collects the mobile phone 10 jitter data through the gyroscope sensor 180B is stronger, the signal variance is larger, indicating that the jitter of the mobile phone 10 is stronger. If the volatility of the signal when the mobile phone 10 collects the mobile phone 10 jitter data through the gyroscope sensor 180B is weaker, the signal variance is smaller, indicating that the jitter of the mobile phone 10 is weaker. In some embodiments, the signal variance can be calculated using the variance formula (3):

[0124] D(X)=E(X 2 )-E 2 (X)(Three)

[0125] Where X is the jitter data of the mobile phone 10 currently collected by the mobile phone 10, E(X) represents the mean value of the jitter data of the mobile phone 10 currently collected by the mobile phone 10, and E(X2 D(X) represents the mean value of the square of the current collected shaking data of the mobile phone 10, and D(X) is the variance of the current collected shaking data of the mobile phone 10, that is, the signal variance of the mobile phone 10.

[0126] It can be understood that the basis for the mobile phone 10 to determine the current scene is the shaking data of the mobile phone 10, and the shaking data of the mobile phone 10 is different in different scenes. The mobile phone 10 can determine the shaking amplitude and the shaking frequency of the mobile phone 10 from the shaking data, and then determine the current scene of the mobile phone 10 according to the shaking amplitude and the shaking frequency of the mobile phone 10.

[0127] For example, taking the running scene and the walking scene as examples, the shaking amplitude and the shaking frequency of the mobile phone 10 in the running scene are higher than the shaking amplitude and the shaking frequency in the walking scene. When the shaking data collected by the gyroscope sensor 180B has a high shaking amplitude and a large frequency, the mobile phone 10 determines that the current scene is the running scene. When the shaking data collected by the gyroscope sensor 180B has a low shaking amplitude and a low frequency, the mobile phone 10 determines that the current scene is the walking scene.

[0128] It should be understood that the above-mentioned low shaking scene and high shaking scene are relative. As described above, the basis for the mobile phone 10 to determine the current scene is the shaking data of the mobile phone 10, and the shaking data of the mobile phone is different in different scenes. Then, for the low shaking scenes such as the walking scene and the handheld scene, if the shaking amplitude and the shaking frequency in the shaking data of the mobile phone 10 in the walking scene are higher than the shaking amplitude and the shaking frequency in the handheld scene, the walking scene can be considered as a high shaking scene relative to the handheld scene.

[0129] In some embodiments, the mobile phone 10 can set the high frequency component threshold and the low frequency component threshold at the same time. When the shaking amplitude of the mobile phone 10 collected by the gyroscope sensor 180B in a period T exceeds the preset amplitude more than a preset number of times, it can be considered that the mobile phone 10 is in a high shaking scene. When the shaking amplitude of the mobile phone 10 collected by the gyroscope sensor 180B in a period T exceeds the preset amplitude less than a preset number of times, it can be considered that the mobile phone 10 is in a low shaking scene. For example, taking a period T of 1 second, a preset amplitude of 0.1°, and a preset number of times of 2 as an example, when the number of times that the shaking amplitude of the mobile phone 10 exceeds 0.1° in 1 second is 4, which is greater than the preset number of times 2, the mobile phone 10 is in a high shaking scene. When the number of times that the shaking amplitude of the mobile phone 10 exceeds 0.1° in 1 second is 0, which is less than the preset number of times 2, the mobile phone 10 is in a low shaking scene.

[0130] Step 1006: The mobile phone 10 determines the working mode of the OIS controller 102 according to the current scene.

[0131] As mentioned above, the mobile phone 10 has different shaking conditions in different scenes. In some scenes, the compensation displacement corresponding to the low-frequency shaking component in the shaking data of the mobile phone 10 exceeds the maximum compensation displacement that the motor 191 can provide, so the mobile phone 10 needs to filter the low-frequency shaking component in the original shaking data and only perform anti-shaking processing on the high-frequency shaking component in the original shaking data, so that the mobile phone 10 can effectively perform anti-shaking processing within the maximum compensation displacement that the motor 191 can provide. However, in other scenes, the compensation displacement corresponding to the low-frequency shaking component in the shaking data of the mobile phone 10 can not exceed the maximum compensation displacement that the motor 191 can provide. It can be understood that in this case, the effect of directly performing anti-shaking processing on the mobile phone 10 according to the original shaking data is better than that of only performing anti-shaking processing on part of the shaking data (high-frequency shaking component) in the original shaking data.

[0132] Therefore, the mobile phone 10 can control the OIS controller 102 to perform anti-shaking processing on the mobile phone 10 in different working modes according to different scenes. Specifically, if the compensation displacement corresponding to the low-frequency shaking component in the shaking data of the mobile phone 10 does not exceed the maximum compensation displacement that the motor 191 can provide, the mobile phone 10 determines the working mode of the OIS controller 102 as "all-pass", that is, the OIS controller 102 will perform anti-shaking processing on the mobile phone 10 according to the original shaking data of the mobile phone 10; if the compensation displacement corresponding to the low-frequency shaking component in the shaking data of the mobile phone 10 exceeds the maximum compensation displacement that the motor 191 can provide, the mobile phone 10 determines the working mode of the OIS controller 102 as "band-pass", that is, the OIS controller 102 will perform anti-shaking processing on the mobile phone 10 according to the high-frequency shaking component in the original shaking data of the mobile phone 10.

[0133] For example, if the current scene determined in step 1004 is a handheld scene, since the user uses the mobile phone 10 to shoot in the handheld scene, the shaking amplitude of the mobile phone 10 is small and the frequency is low, and the image displayed on the shooting interface of the mobile phone 10 and the image shot by the mobile phone 10 are not greatly affected in clarity, that is, the image shot by the mobile phone 10 is distorted, and the distortion is consistent with the expectation of the human eye. At this time, the shaking displacement caused by the maximum shaking amplitude of the mobile phone 10 generally does not exceed the maximum compensation displacement of the motor 191, so the mobile phone 10 can set the working mode of the OIS controller 102 as "all-pass" mode. In the "all-pass" mode, the OIS controller 102 will perform anti-shaking processing on the low-frequency shaking component of the mobile phone 10 and the high-frequency shaking component of the mobile phone 10.

[0134] If the current scene determined in step 1004 is the walking scene, since the user uses the mobile phone 10 to shoot in the walking scene, the amplitude and frequency of the shaking of the mobile phone 10 are relatively large, and the image displayed on the shooting interface of the mobile phone 10 and the image shot by the mobile phone 10 are greatly affected, that is, the distortion of the image shot by the mobile phone 10 does not conform to the expectation of the human eye. At this time, the shaking displacement corresponding to the shaking amplitude of the mobile phone 10 may exceed the maximum compensation displacement of the motor 191, and therefore, in order to reduce the compensation displacement of the motor 191 and make the compensation displacement of the motor 191 not exceed the maximum compensation displacement of the motor 191, the mobile phone 10 can set the working mode of the OIS controller 102 to the “band-pass” mode, and in the “band-pass” mode, the OIS controller 102 will only process the high-frequency shaking component of the mobile phone 10.

[0135] Step 1008: The OIS controller 102 compensates the shaking of the mobile phone 10 in the corresponding scene in the corresponding working mode.

[0136] Based on the current scene of the mobile phone 10 and the working mode of the OIS controller 102 determined in the above steps, the OIS controller 102 compensates the shaking of the mobile phone 10 in the current scene in the working mode corresponding to the current scene.

[0137] The following will be described with reference to Figure 7 and Figure 8 , respectively, taking the current scene as the handheld scene and the working mode of the OIS controller 102 as “all-pass”, and taking the current scene as the walking scene and the working mode of the OIS controller 102 as “band-pass” as examples, to introduce the compensation mode of the OIS controller 102 for the shaking of the mobile phone 10 in the two scenes.

[0138] 1. The current scene is the walking scene, and the working mode of the OIS controller 102 is “band-pass”

[0139] 1) In the “band-pass” mode, the gyroscope filtering unit 870 in the OIS controller 102 filters the angular velocity of the shaking of the mobile phone 10 obtained in the above step 1002 to filter the low-frequency shaking component in the angular velocity of the shaking of the mobile phone 10, and obtain the high-frequency shaking component of the shaking of the mobile phone 10 (for reference to the dashed curve in Figure 7 ).

[0140] 2) The OIS controller 102 integrates the above high-frequency shaking component according to the sampling time t to obtain the shaking amplitude curve (unit: degree) corresponding to the high-frequency shaking component as shown in Figure 8 . The specific way in which the OIS controller 102 integrates the high-frequency shaking component according to the sampling time t can refer to the way in which the integral formula (two) is used to integrate the shaking amplitude of the mobile phone 10 in the x-axis in the above Figure 7 .

[0141] 3) Based on the above step processing, the high-frequency jitter component of the mobile phone 10 is obtained, and then the mobile phone 10 calculates the compensation displacement of the motor 191 corresponding to the high-frequency jitter amplitude of the mobile phone 10 at each time by using the formula (I) described above, and then the motor 191 pushes the lens 193 to move to a specific position according to the calculated compensation displacement.

[0142] For example, at T1, the original jitter amplitude of the mobile phone 10 in the x-axis is 3°, and the low-frequency jitter amplitude corresponding to this time is filtered out by the mobile phone 10, which is 2.5°, and the high-frequency jitter amplitude obtained is 0.4°.

[0143] According to formula (I), the compensation displacement of the motor 191 at this time is dist1 = 0.4°*focal_length, assuming that the focal length of the lens of the mobile phone 10 is 25mm, then the compensation displacement of the motor 191 is dist1 = 0.4*25 = 10mm.

[0144] Therefore, the motor 191 needs to push the lens 193 to move 10mm along the x-axis in the direction opposite to the jitter direction of the mobile phone 10, so as to offset the displacement caused by the jitter of the mobile phone 10.

[0145] Correspondingly, in the same scenario, if the mobile phone 10 compensates the original jitter amplitude (3°) including the high-frequency jitter amplitude and the low-frequency jitter amplitude at the same time, the compensation displacement of the motor 191 is dist2 = 3*focal_length = 3*25 = 75mm. It can be seen that compared with the above calculated 10mm, the compensation displacement of the motor 191 needs to be greatly reduced (△dist = 65mm) in the case of compensating only the high-frequency jitter component of the mobile phone 10.

[0146] Further, when the OIS controller 102 performs real-time anti-shake processing on the mobile phone 10, the comparison between the compensation displacement generated by the motor 191 through the scheme of the present application and the compensation displacement generated according to the original jitter data of the mobile phone 10 is shown in the following FIG. 10-FIG. 11.

[0147] Specifically, Figure 10A The compensation displacement function of the motor 191 to the x-axis jitter of the mobile phone 10 is shown in the following FIG. 10-FIG. 11. Wherein, s represents the compensation displacement of the motor 191 (unit: mm), t represents the sampling time (unit: s), the solid line represents the compensation displacement of the motor 191 according to the original jitter data of the mobile phone 10, and the dotted line represents the compensation displacement of the motor 191 through the scheme of the present application.

[0148] From Figure 10AIt can be seen from the figure that the compensation displacement of the motor 191 on the x-axis according to the original shaking data of the mobile phone 10 is easy to reach the maximum compensation displacement of the motor 191, and the method of the present application can reduce the compensation displacement of the motor 191. For example, as shown in the figure at t = 10.0, the compensation displacement of the motor 191 according to the original shaking data of the mobile phone 10 reaches the maximum compensation displacement, i.e. about 100 mm, but through the scheme of the present application, the compensation displacement of the motor 191 at t = 10.0 is less than 50 mm, and even close to 0 mm. It can be seen that through the scheme of the present application, the compensation displacement of the motor 191 is significantly reduced.

[0149] Figure 10B The compensation displacement function of the motor 191 on the y-axis shaking of the mobile phone 10 is compared. Wherein s represents the compensation displacement of the motor 191 (unit: mm), t represents the sampling time (unit: s), the solid line represents the compensation displacement of the motor 191 generated by the original shaking data of the mobile phone 10, and the dashed line represents the compensation displacement of the motor 191 generated by the scheme of the present application.

[0150] From Figure 10B It can be seen from the figure that the compensation displacement of the motor 191 on the y-axis according to the original shaking data of the mobile phone 10 is easy to reach the maximum compensation displacement of the motor 191, and the method of the present application can reduce the compensation displacement of the motor 191. For example, as shown in the figure at t = 15.0, the compensation displacement of the motor 191 according to the original shaking data of the mobile phone 10 has reached the maximum compensation displacement of about 100 mm, and after using the scheme of the present application, the compensation displacement of the motor 191 at t = 15.0 is less than 50 mm. It can be seen that through the scheme of the present application, the compensation displacement of the motor 191 is significantly reduced.

[0151] It can be understood from the foregoing that although the compensation displacement of the motor 191 is significantly reduced, since the motor 191 at this time only compensates for the high-frequency shaking component of the mobile phone 10, and as described above, the shaking data of the mobile phone 10 can be divided into a high-frequency shaking component and a low-frequency shaking component, and the high-frequency shaking component has a greater impact on the mobile phone 10 than the low-frequency shaking component, so in the case that the displacement of the motor 191 is easy to exceed the maximum compensation displacement of the motor 191 when directly compensating for the original shaking data of the mobile phone 10, the mobile phone 10 only compensates for the high-frequency shaking component in the original shaking data, which not only effectively reduces the compensation displacement of the motor 191 as shown in FIG. 10, thereby reducing the case that the compensation displacement of the motor 191 exceeds the maximum compensation displacement of the motor 191 and affects the anti-shaking effect of the OIS system 100, but also effectively realizes the anti-shaking processing of the mobile phone 10, for example, as shown in FIG. 11, wherein Figure 11Athe image processed by the image acquisition method of the present application, Figure 11B the image not processed by the image acquisition method of the present application, Figure 11A it can be seen that the definition of the image shown in Figure 11B is higher than that of the image shown in

[0152] 2. The current scene is a handheld scene, and the working mode of the OIS module 200 is "full pass"

[0153] 1) In the "full pass" mode, the gyroscope filtering unit 870 in the OIS controller 102 will filter the angular velocity of the shaking of the mobile phone 10 obtained in the above step 1002, but it should be understood that at this time the function of the gyroscope filtering unit 870 is to filter out the noise data in the angular velocity of the shaking of the mobile phone 10, that is, to denoise the angular velocity of the mobile phone 10 collected by the gyroscope sensor 180B. Specifically, the gyroscope filtering unit 870 will filter out the angular velocity that is obviously too high in the angular velocity of the shaking of the mobile phone 10, for example, assuming that the angular velocity of the shaking of the mobile phone 10 collected by the gyroscope sensor 180B is 0.00958 degrees / second, 0.01384 degrees / second, 0.1248 degrees / second, 0.01916 degrees / second, and 0.02023 degrees / second. It can be seen that 0.1248 degrees / second is obviously higher than the other values, so when the gyroscope filtering unit 870 filters the foregoing data, it will filter out the data 0.1248 degrees / second that is obviously too high.

[0154] 2) The OIS controller 102 integrates the angular velocity of the shaking of the mobile phone 10 after the foregoing denoising processing according to the sampling time t to obtain the original shaking data curve of the x-axis shaking amplitude of the mobile phone 10 as shown in Figure 8 . Among them, the specific way in which the OIS controller 102 integrates the angular velocity of the shaking of the mobile phone 10 according to the sampling time t can refer to the way in which the integral formula (two) is used to integrate the x-axis shaking amplitude of the mobile phone 10 in the above Figure 7 , which will not be described here.

[0155] 3) According to the original shaking data curve of the x-axis shaking amplitude of the mobile phone 10 obtained in step 2), it is determined whether the shaking amplitude of the mobile phone 10 exceeds the amplitude corresponding to the maximum compensation displacement that the motor 191 can provide. When the shaking amplitude of the mobile phone 10 at a certain time exceeds the amplitude corresponding to the maximum compensation displacement that the motor 191 can provide, the compensation coefficient is used to reduce the compensation displacement corresponding to the shaking amplitude of the mobile phone 10 at that time.

[0156] It can be understood that in the embodiments of the present application, the compensation coefficient can be a coefficient determined based on the inherent characteristics of some devices of the lens of the mobile phone 10, which is used to reduce the compensation displacement in proportion. The following will be described in detail.

[0157] It can be understood that in some embodiments of the present application, for example, in the above-mentioned band-pass working mode, if the compensation displacement of the motor 191 corresponding to the high-frequency jitter component of the mobile phone 10 also exceeds the maximum compensation displacement of the motor 191, the mobile phone 10 can also adjust the compensation displacement of the high-frequency jitter component of the mobile phone 10 through the compensation coefficient, so that the compensation displacement corresponding to the high-frequency jitter component of the mobile phone 10 will not exceed the maximum compensation displacement that the motor 191 can provide.

[0158] If the jitter amplitude of a certain jitter component in the mobile phone 10 exceeds the amplitude corresponding to the maximum compensation displacement that the motor 191 can provide, the compensation displacement that the motor 191 needs to provide is reduced by reducing the compensation coefficient, and the motor 191 pushes the lens 193 to move to a certain position according to the reduced compensation displacement.

[0159] If the jitter amplitude of a certain jitter component in the mobile phone 10 does not exceed the amplitude corresponding to the maximum compensation displacement that the motor 191 can provide, the compensation displacement function of the motor 191 corresponding to each jitter component of the mobile phone 10 is calculated using formula (one), and the motor 191 pushes the lens 193 to move to a certain position according to the calculated compensation displacement. In some embodiments, the mobile phone 10 can calculate the compensation coefficient through formula (four), and calculate the reduced compensation displacement corresponding to the compensation coefficient through formula (five). Specifically,

[0160]

[0161] Dist g =g*Dist (five)

[0162] Wherein, g is the compensation coefficient, focal_length is the focal length of the lens in the OIS controller 102, Dist represents the compensation displacement generated by the motor 191, and Dist g is the reduced compensation displacement corresponding to the compensation coefficient.

[0163] It should be understood that the data collected by the gyroscope sensor may have errors in terms of accuracy, that is, the jitter amplitude of the mobile phone 10 collected by the gyroscope sensor 180B is not consistent with the actual jitter amplitude of the mobile phone 10, for example, the mobile phone 10 actually shakes 1°, but the data fed back to the OIS controller 102 by the gyroscope sensor is 0.95° smaller than the actual shaking angle, or the data fed back to the OIS controller 102 by the gyroscope sensor is 1.05° larger than the actual shaking angle. In this case, the compensation coefficient can be calculated by formula (six):

[0164]

[0165] Wherein, x represents the actual jitter amplitude of the mobile phone 10, and x' represents the jitter amplitude of the mobile phone 10 collected by the gyroscope sensor 180B of the mobile phone 10.

[0166] It can be understood that, according to the formula (four), when the focal length of the lens 193 in the mobile phone 10 is determined, the compensation coefficient g used by the OIS controller 102 for the anti-shake processing of the mobile phone 10 is also determined.

[0167] Taking the original jitter amplitude of the mobile phone 10 on the x-axis at T1 as 4.5°, after the original jitter amplitude of the mobile phone 10 is filtered by the gyroscope filtering unit 870, the low-frequency jitter amplitude corresponding to this moment is 4.4°, the high-frequency jitter amplitude is 0.1°, and the focal length of the mobile phone 10 is 25mm.

[0168] At this time, the mobile phone 10 calculates the compensation coefficient g according to the formula (four) Then the mobile phone 10 calculates the compensation displacement of the motor 191 for the low-frequency jitter amplitude (4.4°) as Dist3 = 4.4 * 25 = 110mm according to the formula (one), and calculates the compensation displacement of the motor 191 for the high-frequency jitter amplitude (0.5°) as Dist4 = 0.5 * 25 = 12.5mm according to the formula (one).

[0169] Suppose the maximum compensation displacement of the motor 191 is 100mm, according to the formula (one), the amplitude corresponding to the maximum compensation displacement of the motor 191 is θ1 = 100 / 25 = 4°, so the low-frequency jitter amplitude of the mobile phone 10 is greater than the amplitude corresponding to the maximum compensation displacement of the motor 191, at this time the motor 191 cannot compensate the low-frequency jitter amplitude of the mobile phone 10. Therefore, the mobile phone 10 will recalculate the compensation displacement Dist4 of the motor 191 for the low-frequency jitter amplitude (4.4°) according to the formula (five) through the compensation coefficient g = 0.04, that is, Dist4 = 0.04 * 110 = 4.4mm. It can be seen that, at this time, the compensation displacement of the motor 191 for the low-frequency jitter amplitude of the mobile phone 10 is obviously reduced, and the motor 191 can compensate the low-frequency jitter amplitude of the mobile phone 10 to a certain extent.

[0170] It can be understood that, in other embodiments, in order to reduce the power consumption of the mobile phone 10, the mobile phone 10 can not set the working mode of the OIS controller 102 according to the scene, but directly set the working mode of the OIS controller 102 to the "band-pass" mode, and perform anti-shake processing on the jitter of the mobile phone 10 in any scene in this working mode. That is, steps 1004, 1006 and 1008 in the above method 1000 can be omitted, and after completing step 1002, the mobile phone 10 can perform anti-shake processing on the mobile phone 10 according to the jitter data of the mobile phone 10.

[0171] In this way, the mobile phone 10 can analyze the shaking data of the mobile phone 10 collected by the gyroscope sensor 180B, and determine the current scene of the mobile phone 10 according to the analysis result, thereby reducing the power consumption of the mobile phone 10.

[0172] In addition, in the case that the shaking data of the mobile phone 10 collected by the gyroscope sensor 180B is inaccurate, the mobile phone 10 can avoid misjudging the current scene according to the inaccurate shaking data, and further avoid missetting the working mode of the OIS controller 102 to a working mode that does not conform to the current scene, thereby affecting the anti-shaking processing of the OIS controller 102 on the shaking of the mobile phone 10.

[0173] Specifically, the gyroscope sensor 180B has a single sensitivity error, that is, the actual shaking amplitude of the mobile phone 10 can be different (larger or smaller) from the shaking amplitude of the mobile phone 10 fed back to the OIS controller 102 by the gyroscope sensor 180B. For example, the actual shaking amplitude of the mobile phone 10 is 0.2 degrees, and the shaking amplitude of the mobile phone 10 fed back to the OIS controller 102 by the gyroscope sensor 180B is 0.1 degrees. Then the mobile phone 10 can misjudge the current scene according to the inaccurate shaking amplitude.

[0174] For example, it is assumed that the preset amplitude is 0.2 degrees. When the shaking amplitude of the mobile phone 10 is less than the preset amplitude, the mobile phone 10 records this shaking as shaking conforming to the low-shaking scene. When the above-mentioned situation is continuously or cumulatively more than a preset number of times within a period T, the mobile phone 10 determines that the current scene is a low-shaking scene, and sets the OIS controller 102 to the "all-pass" mode. However, in the actual situation, the mobile phone 10 is in a low-shaking scene, and the OIS controller 102 should be in a "band-pass" mode. It can be understood that when the "all-pass" mode is used to process the high-shaking scene, the shaking amplitude of the mobile phone 10 is large, and the shaking frequency is also large. When the low-frequency shaking component in the shaking amplitude of the mobile phone 10 is processed, the compensation displacement of the motor 191 is easy to exceed the maximum compensation displacement, and the OIS module 200 cannot continue to process the shaking of the mobile phone 10 due to the maximum compensation displacement of the motor 191. Therefore, as described above, the mobile phone 10 can set the working mode of the OIS controller 102 to a single working mode, that is, a "band-pass" mode, and process the shaking of the mobile phone 10 in the "band-pass" mode, thereby avoiding the above-mentioned situation.

[0175] It should be understood that the reference in the specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one example embodiment or technique according to the disclosure. The appearance of the phrase "in one embodiment" in various places in the specification does not necessarily all refer to the same embodiment.

[0176] The processes and displays presented herein are not inherently related to any particular computer or other apparatus. Various general purpose systems can be used with programs in accordance with the teachings herein, or it can prove convenient to construct more specialized apparatus to perform one or more method steps. The structure for a variety of these systems is discussed in the detailed description below. In addition, any particular programming language can be used to implement the teachings of the disclosure as discussed herein. Various programming languages can be used to implement the disclosure as discussed herein.

[0177] Also, the language used in the specification has been principally selected for readability and instructional purposes and can not have been selected to delineate or circumscribe the disclosed subject matter. Accordingly, the disclosure is intended to be illustrative, and not restrictive, of the scope of the concepts discussed herein.

[0178] The embodiments of the present application also provide an electronic device, comprising: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps in any of the above method embodiments when executing the computer program.

[0179] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, wherein the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0180] The embodiments of the present application provide a computer program product, which, when executed on a mobile terminal, enables the mobile terminal to implement the steps in any of the above method embodiments.

[0181] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the processes in the above method embodiments, which can be completed by instructing related hardware through a computer program. The computer program can be stored in a computer readable storage medium, and the computer program, when executed by a processor, can implement the steps in each of the above method embodiments. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable storage medium at least includes any entity or device capable of carrying the computer program code to the photographing device / terminal equipment, recording medium, computer memory, read-only memory (ROM), random access memory (RAM) and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc.

[0182] In the above embodiments, the description of each embodiment is focused on, and the parts not described or recorded in a certain embodiment can be referred to the relevant description of other embodiments.

[0183] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0184] The above-described embodiments are only used to illustrate the technical solutions of the present application, but not limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can still be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. An image acquisition method, applied to an electronic device, wherein the electronic device includes a motor, a lens, and an image sensor, characterized in that: The method comprises: Obtain jitter data of electronic devices; When the electronic device is in a first jitter scenario, separating a first jitter data portion having a jitter frequency greater than a first threshold from the jitter data; calculating a first OIS compensation displacement of the motor based on the first jitter data portion; controlling the movement of the motor according to the first OIS compensation displacement to change the relative position between the lens and the image sensor during image acquisition; When the electronic device is in a second shaking scenario, calculating a second OIS compensation displacement of the motor based on the acquired shaking data, and controlling the movement of the motor according to the second OIS compensation displacement to change the relative position between the lens and the image sensor; The jitter frequency of the jitter data in the first jitter scenario is greater than the jitter frequency of the jitter data in the second jitter scenario.

2. The method according to claim 1, characterized in that The first shaking scene includes a running scene or a walking scene, and the second shaking scene includes a hand-held scene.

3. The method according to claim 1, characterized in that The jitter data includes at least one of an angular velocity of the electronic device and an acceleration of the electronic device.

4. The method according to claim 1, wherein The controlling the movement of the motor according to the first OIS compensation displacement to change the relative position between the lens and the image sensor includes: When the first OIS compensation displacement is greater than the mechanical limit displacement of the motor, the first OIS compensation displacement is adjusted using a compensation coefficient to obtain a third OIS compensation displacement that is smaller than the first OIS compensation displacement; Using the third OIS compensation displacement to control the movement of the motor to change the relative position between the lens and the image sensor; The compensation coefficient is determined based on the focal length of the lens and the accuracy of a component of the electronic device used to collect the jitter data.

5. The method according to any one of claims 1 to 4, characterized in that The first threshold is greater than or equal to 1.5 Hz and less than or equal to 2.5 Hz.

6. An electronic device, characterized in that: The electronic device includes a motion sensor, an OIS controller, a motor, a lens, and an image sensor; The motion sensor is used to collect jitter data of the electronic device and send the jitter data to the OIS controller; The OIS controller is configured to separate a first jitter data portion having a jitter frequency greater than a first threshold from the jitter data, and calculate a first OIS compensation displacement of the motor based on the first jitter data portion, and the OIS controller is further configured to control movement of the motor according to the first OIS compensation displacement to change a relative position between the lens and the image sensor during image capture; After acquiring the jitter data of the electronic device, the OIS controller separates a first jitter data portion having a jitter frequency greater than a first threshold from the jitter data when the electronic device is in a first jitter scenario; The OIS controller calculates a second OIS compensation displacement of the motor based on the acquired vibration data when the electronic device is in a second vibration scenario, and controls the motor to move according to the second OIS compensation displacement to change the relative position between the lens and the image sensor; The jitter frequency of the jitter data in the first jitter scenario is greater than the jitter frequency of the jitter data in the second jitter scenario.

7. The electronic device according to claim 6, wherein: The first shaking scene includes a running scene or a walking scene, and the second shaking scene includes a hand-held scene.

8. The electronic device according to claim 6, wherein: The motion sensor includes at least one of a gyro sensor and an acceleration sensor, and The jitter data includes at least one of an angular velocity of the electronic device and an acceleration of the electronic device.

9. The electronic device according to claim 6, wherein: The OIS controller controls the movement of the motor to change the relative position between the lens and the image sensor in the following manner: When the first OIS compensation displacement is greater than the mechanical limit displacement of the motor, the first OIS compensation displacement is adjusted using a compensation coefficient to obtain a third OIS compensation displacement that is smaller than the first OIS compensation displacement; Using the third OIS compensation displacement to control the movement of the motor to change the relative position between the lens and the image sensor; The compensation coefficient is determined based on the focal length of the lens and the accuracy of a component of the electronic device used to collect the jitter data.

10. The electronic device according to any one of claims 6 to 9, characterized in that: The first threshold is greater than or equal to 1.5 Hz and less than or equal to 2.5 Hz.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the image acquisition method according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Image tremor correction device and control method of the same, optical device and imaging device

    JP2016004243A