Shooting method and device, electronic equipment, readable storage medium and program product

By controlling the enable and disability of the camera anti-shake assembly when the data read signal is triggered, the distance between the anti-shake assembly and the reference center is ensured to reduce, and the problem of low image clarity in the prior art is solved, and higher anti-shake effect and image clarity are achieved.

CN119520994APending Publication Date: 2025-02-25GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411624457.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-13
Publication Date
2025-02-25

AI Technical Summary

Technical Problem

In the prior art, when shooting with a camera, the image blurring caused by external jitter, optical anti-shake (OIS) controls the anti-shake assembly to be disabled during the non-exposure period to improve the anti-shake effect during the exposure period, but the image clarity is still not high.

Method used

By acquiring the first and second image data when the data reading signal is triggered, the anti-shake assembly is controlled to be disabled during the acquisition of the first image data, and the anti-shake assembly is enabled during the acquisition of the second image data, ensuring that the distance between the anti-shake assembly and the reference center is reduced, thereby improving the anti-shake angle and image clarity when the anti-shake assembly is enabled.

Benefits of technology

The distance between the anti-shake assembly and the reference center is achieved by capturing the time of at least one frame of image data, so that the anti-shake assembly has a larger anti-shake angle when it is restored to enable, and the clarity of the acquired image data is higher, and the clarity of the captured image is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119520994A_ABST
    Figure CN119520994A_ABST
Patent Text Reader

Abstract

The invention relates to a shooting method and device, electronic equipment, a readable storage medium and a program product. The method comprises the steps of obtaining first image data in response to triggering of a first data reading signal, and controlling the anti-shake assembly to be disabled in the process of obtaining the first image data or before obtaining the first image data; in response to triggering of a second data reading signal, acquiring second image data, and controlling the anti-shake component to be enabled in the process of acquiring the second image data or before the second image data is acquired; the generation moment of the second data reading signal is later than the generation moment of the first data reading signal; a first distance between the anti-shake assembly and a reference center at the generation moment of the first data reading signal is greater than a second distance between the anti-shake assembly and the reference center at the generation moment of the second data reading signal; and obtaining a target image according to the second image data. By adopting the method, the definition of the shot image can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of photographing technology, and in particular to a photographing method, device, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] With the development of electronic devices such as smart phones, photography technology has become increasingly popular. People can use cameras to take photos or videos anytime and anywhere. However, when using cameras, the electronic devices often shake due to external influences, resulting in blurred images. Therefore, electronic devices need to be anti-shake processed. Optical Image Stabilization (OIS) is a common anti-shake processing method to suppress motion blur in captured images.

[0003] In the related art, the anti-shake effect of the anti-shake component enabled during the exposure period is improved by controlling the anti-shake component to be disabled during the non-exposure period. However, the clarity of the image captured in this way is still not high. Summary of the invention

[0004] The embodiments of the present application provide a shooting method, device, electronic device, and computer-readable storage medium, which can improve the clarity of captured images.

[0005] In a first aspect, the present application provides a shooting method, comprising:

[0006] In response to a trigger of a first data reading signal, first image data is acquired, and before or during the process of acquiring the first image data, the anti-shake component is controlled to be disabled;

[0007] In response to a trigger of a second data read signal, second image data is acquired, and in the process of or before acquiring the second image data, the anti-shake component is controlled to be enabled; the second data read signal is generated later than the first data read signal; a first distance between the anti-shake component and a reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated;

[0008] A target image is obtained according to the second image data.

[0009] In a second aspect, the present application further provides a photographing device, including:

[0010] A first image acquisition module, configured to acquire first image data in response to a trigger of a first data reading signal, and to control the anti-shake component to be disabled during or before acquiring the first image data;

[0011] a second image acquisition module, configured to acquire second image data in response to a trigger of a second data read signal, and control the anti-shake component to be enabled during or before the process of acquiring the second image data; the second data read signal is generated later than the first data read signal; a first distance between the anti-shake component and the reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated;

[0012] The target image obtaining module is used to obtain a target image according to the second image data.

[0013] In a third aspect, the present application further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the shooting method provided in the first aspect when executing the computer program.

[0014] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the shooting method provided in the first aspect are implemented.

[0015] In a fifth aspect, the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the shooting method provided in the first aspect.

[0016] The above-mentioned shooting method, device, electronic device, computer-readable storage medium and computer program product obtain the first image data by responding to the trigger of the first data read signal, and control the anti-shake component to be disabled during or before the process of obtaining the first image data, and obtain the second image data in response to the trigger of the second data read signal. And before or after the process of obtaining the second image data, the anti-shake component is controlled to be enabled, and the first distance between the anti-shake component and the reference center at the time when the first data read signal is generated is greater than the second distance between the anti-shake component and the reference center at the time when the second data read signal is generated; the target image is obtained according to the second image, and it is possible to shorten the distance between the anti-shake component and the reference center through the acquisition time of at least one frame of image data, that is, provide a sufficient time to reduce the distance between the anti-shake component and the reference center, so that the anti-shake component has a larger anti-shake angle when it is restored to be enabled, and the clarity of the image data collected by the anti-shake enabling is higher, and the captured image is obtained through the clear anti-shake enabled image, thereby improving the clarity of the captured image. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] FIG1 is a diagram of an application environment of a shooting method according to an embodiment;

[0019] FIG2 is a schematic diagram of a process of a photographing method in one embodiment;

[0020] FIG3 is a schematic diagram of obtaining first image data and second image data in one embodiment;

[0021] FIG4 is a schematic diagram of obtaining third image data in one embodiment;

[0022] FIG5 is a schematic diagram of a process flow of a photographing method in another embodiment;

[0023] FIG6 is a schematic flow chart of a photographing method in another embodiment;

[0024] FIG7 is a structural block diagram of a photographing device in one embodiment;

[0025] FIG. 8 is a diagram showing the internal structure of an electronic device in one embodiment. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0027] The working principle of optical image stabilization is to detect jitter data and compensate for displacement based on inertial sensors. Inertial sensors such as gyroscopes and accelerometers detect the corresponding jitter when the electronic device shakes, and then transmit the jitter data to the microprocessor. The microprocessor calculates the displacement that needs to be compensated based on the jitter data, and then compensates according to the lens jitter direction and displacement through the compensation component, thereby overcoming the image blur caused by jitter.

[0028] At present, many smart phones are designed with optical image stabilization solutions, such as micro-gimbal image stabilization, image sensor image stabilization, etc., and there are also different motors such as piezoelectric, spring, ball, memory alloy, etc. to drive the lens or sensor. In the process of image sensor collecting images, there is a non-exposure period between every two frames. During the non-exposure period, the image sensor does not produce images. At this time, the image stabilization component is not required for optical image stabilization. The OIS function can be turned off, that is, the OIS is disabled, and the lens is pulled back to the optical center at the same time, in the hope that each frame of the image collected during the exposure period is compensated from the optical center. However, in actual application scenarios, the motor is required to quickly pull the lens from the edge of the full stroke to the optical center and stabilize it during the non-exposure period, and the control performance of the motor and other driving components, such as PID (proportional integral differential) control, is required to be high. In addition, if the sensor's readout time is long, the non-exposure time will be compressed. In application scenarios with long exposure times, such as in dark environments, the non-exposure time will also be compressed. It is easy for the lens to fail to return to the optical center due to the short non-exposure time, thus affecting the lens return-to-center effect. The image after jitter compensation is still blurry. According to actual application conditions, the solution of lens return-to-center within the non-exposure time is only applicable to scenarios with an image acquisition frame rate of 30fps and a short exposure time. However, for application scenarios with long exposure times, such as dark environments, long and short exposures, the corresponding return-to-center effect is not ideal. Due to the influence of device performance and shooting environment, in application scenarios with short non-exposure times, the captured image is still not clear.

[0029] In response to the technical problem of low image clarity in the above-mentioned traditional return-to-center scheme, an embodiment of the present application provides a shooting method, by acquiring first image data and second image data when triggered by a data read signal, controlling the anti-shake component to be disabled during or before the process of acquiring the first image data, and controlling the anti-shake component to be enabled during or before the process of acquiring the second image data, it is possible to ensure that the distance between the anti-shake component and the reference center is shortened through at least one frame of image acquisition time, so that the clarity of the image acquired when the anti-shake component is enabled is maximized, thereby improving the clarity of the captured image, achieving good motion blur suppression effect in more application scenarios, and capturing images with higher clarity.

[0030] The shooting method provided in the embodiment of the present application can be applied to the electronic device as shown in FIG1. ​​The electronic device 100 includes a camera module 20, a processor 30 and a housing 40. The camera module 20 and the processor 30 are both arranged in the housing 40, and the housing 40 can also be used to install functional modules such as a power supply device and a communication device of the electronic device 100, so that the housing 40 provides dustproof, drop-proof, waterproof and other protections for the functional modules.

[0031] The camera module 20 may be a front camera module, a rear camera module, a side camera module, an under-screen camera module, etc., and is not limited here. The camera module 20 may include an anti-shake component, which may include a lens or an image sensor 21, etc. When the camera module 20 captures an image, light passes through the lens and reaches the image sensor 21, and the image sensor 21 is used to convert the light signal irradiated on the image sensor 21 into an electrical signal.

[0032] The electronic device 100 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart vehicle-mounted devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. It is understandable that the electronic device 100 may also be any other device or equipment with image processing functions. The electronic device may be a terminal or a server.

[0033] In some exemplary embodiments, as shown in FIG2 , a shooting method is provided, including the following steps 202 to 206. Among them:

[0034] Step 202 , in response to the triggering of the first data reading signal, acquiring first image data, and controlling the anti-shake component to be disabled during or before the process of acquiring the first image data.

[0035] The first data read signal may be any data read signal. The data read signal is used to indicate that the image sensor has completed reading a frame of image data. The data read signal is a pulse signal. A data read signal is generated each time a frame of image data is read. Generally, the time it takes for the image sensor to complete reading a frame of image data is fixed. Therefore, a data read signal may be generated at intervals of a certain time. It is easy to understand that the first data read signal is generated when the image sensor completes reading the first frame of image data. The image sensor completes reading a frame of image data, which refers to the process in which the photosensitive element in the image sensor converts the photosensitive value into a digital value and reads it out. The data read signal may be generated by hardware or software. For example, the data read signal is a Vsync (Vertical Synchronization) signal output by the GPO (General-purpose output) pin of the image sensor. The Vsync signal may be used to indicate the state of a frame of image data, that is, the acquisition of the previous frame of image data is completed and the acquisition of the next frame of image data is ready to begin.

[0036] In an optional application scenario, when the first data reading signal is generated, the acquisition of the previous frame of image data representing the first image data is completed, and the first image data is collected after a preset time interval starting from the moment the first data reading signal is generated. The preset time interval can be a non-exposure time, that is, the image sensor does not collect image data during this preset time. Then, the electronic device can start to control the anti-shake component to be disabled at any time within the preset time, or it can also be controlled to disable the anti-shake component when the first image data is started to be collected, or it can be controlled to disable the anti-shake component before the first data reading signal is generated. In other words, the duration for the electronic device to control the anti-shake component to be disabled includes the acquisition duration of at least one frame of image data. Controlling the anti-shake component to be disabled means that the anti-shake component is not in the anti-shake working state.

[0037] Optionally, in the process of controlling the anti-shake component to be disabled, the anti-shake component may be controlled to move from a current position toward a reference center direction, that is, to realize the return of the anti-shake component to the center.

[0038] Optionally, the first image data may be acquired in response to a preset operation and a trigger of a first data read signal, wherein the preset operation may include a shooting trigger operation, a focusing operation, etc. For example, the first image data may be acquired in response to a shooting trigger operation and a trigger of a first data read signal.

[0039] Optionally, the first image data may include one or more frames of image data. In response to the triggering of the first data reading signal, the electronic device may continuously acquire multiple frames of first image data, each frame of first image data corresponding to one data reading signal.

[0040] Step 204, in response to the triggering of the second data read signal, acquire the second image data, and control the anti-shake component to be enabled during or before the process of acquiring the second image data; wherein, the second data read signal is generated later than the first data read signal; and a first distance between the anti-shake component and the reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated.

[0041] The second data read signal may be any data read signal, and the second data read signal is generated later than the first data read signal, that is, the second data read signal and the first data read signal are data read signals generated at different times.

[0042] The anti-shake component may include a lens or a photosensitive element, and the reference center may include the optical center of the lens or the photosensitive center of the photosensitive element. The optical center of the lens refers to the virtual point that light passes through when passing through the lens. When the light passes through the virtual point, no refraction or deflection occurs, that is, when light in any direction passes through the point, the propagation direction of the light remains unchanged, and the outgoing direction and the incident direction are parallel to each other. The optical center of the lens is usually the center of gravity of the lens. The lens may include one or more groups of lenses. The photosensitive center refers to the imaging center position of the photosensitive element. When the photosensitive element is at the imaging center position, the light can be fully and stably projected onto the image sensor, so that the captured image has the highest clarity. In general, the image captured based on the reference center has the highest clarity. It is easy to understand that when an electronic device is initialized, the photosensitive element is located at the photosensitive center, or the lens is located at the optical center, through calibration or fine-tuning in advance. However, during the shooting process, the electronic device is prone to shaking, which makes the photosensitive element or lens easily deviate from the initialization position. The driving component can be used to drive the photosensitive element to move toward the photosensitive center, or drive the lens to move toward the optical center, thereby achieving compensation for the shake.

[0043] Optionally, when a preset stop condition is met, the electronic device acquires the second image data in response to the triggering of the second data reading signal, and controls the anti-shake component to be enabled during or before acquiring the second image data, that is, the anti-shake component is in a working state, and the second image data is the anti-shake image data. It is easy to understand that since the second distance between the anti-shake component and the reference center at the moment when the second data reading signal is generated is greater than the first distance between the anti-shake component and the reference center at the moment when the first data is read, that is, when the second image data is collected, the distance between the anti-shake component and the reference center is closer than the distance between the anti-shake component and the reference center when the first image data is collected, then, during the process of collecting the second image data, the anti-shake component has a larger anti-shake angle during the enabling process, and therefore, the clarity of the second image data is higher than that of the first image data.

[0044] It is easy to understand that when the second data reading signal is generated, the previous frame of image data representing the second image data is collected. Starting from the moment the second data reading signal is generated, the second image data is collected after a preset time interval. The preset time interval can be a non-exposure time, that is, the image sensor does not collect image data during this preset time interval. Then, the electronic device can start to control the anti-shake component to be enabled at any time within the preset time interval, or it can also be controlled to enable the anti-shake component when the second image data is collected, or it can be controlled to enable the anti-shake component before the preset time interval, that is, before the second data reading signal is generated. Controlling the anti-shake component to be enabled means controlling the anti-shake component to be in an anti-shake working state.

[0045] Exemplarily, the second image data may include one or more frames. In response to the triggering of the second data read signal, multiple frames of second image data may be continuously acquired, and each frame of second image data corresponds to a data read signal. For example, in response to the triggering of the shooting trigger operation and the first data read signal after the shooting trigger operation, the first frame of first image data is acquired, in response to the triggering of the second data read signal after the shooting trigger operation, the second frame of first image data is acquired, in response to the triggering of the third data read signal after the shooting trigger operation, the first frame of second image data is acquired, and in response to the triggering of the fourth data read signal after the shooting trigger operation, the second frame of second image data is acquired. It can be understood that in this example, the first data read signal is the first data read signal after the shooting trigger operation, the second data read signal is the third data read signal after the shooting trigger operation, the first image data includes two frames, and the second image data includes two frames.

[0046] Step 206: Obtain a target image according to the second image data.

[0047] In this embodiment, since the first image data is image data obtained when the anti-shake component is disabled, the first image data is relatively blurred, and the second image data is image data obtained when the anti-shake component is disabled for at least one frame, the second image has higher clarity. Therefore, by removing the blurred first image data, a target image with higher clarity can be obtained based on the second image data.

[0048] Optionally, when the second image data includes multiple frames, the multiple frames of the second image data can be fused to obtain a target image. In an actual application scenario, after obtaining the target image, it can be saved and output for display, and the target image is the final captured image or the previewed image.

[0049] In the above shooting method, the first image data is acquired in response to the triggering of the first data reading signal, and the anti-shake component is controlled to be disabled during or before the process of acquiring the first image data. The second image data is acquired in response to the triggering of the second data reading signal, and the anti-shake component is controlled to be enabled during or before the process of acquiring the second image data. At the time when the first data reading signal is generated, the first distance between the anti-shake component and the reference center is greater than the second distance between the anti-shake component and the reference center at the time when the second data reading signal is generated. The target image is obtained according to the second image data, and the distance between the anti-shake component and the reference center can be shortened by the acquisition time of at least one frame of image data, that is, sufficient time is provided to reduce the distance between the anti-shake component and the reference center, so that the anti-shake component has a larger anti-shake angle when it is restored to be enabled, the anti-shake effect is better, and the clarity of the acquired image data is higher. The captured image is obtained by the clear image captured in the anti-shake enabled state, thereby improving the clarity of the captured image. At the same time, the influence of the non-exposure time can be avoided, and a high-definition image can be captured for application scenarios with a short non-exposure time such as dark environments, and a better motion blur suppression effect can be achieved in more application scenarios.

[0050] In some embodiments, in response to the triggering of the first data reading signal, acquiring the first image data in step 202 includes:

[0051] In response to the triggering of the shooting trigger operation and the first data reading signal, the first image data is acquired.

[0052] Among them, the shooting trigger operation refers to an operation that can trigger shooting, for example, shooting can be triggered by a shooting control or a preset sliding gesture, and the corresponding shooting trigger operation is an operation that triggers the shooting control or an operation that triggers a preset sliding gesture, etc. It can be understood that the shooting trigger operation can generate a corresponding shooting trigger signal, and can also obtain the first image data based on the triggering of the shooting trigger signal and the first data reading signal. The form of the shooting trigger signal is not specifically limited here.

[0053] Optionally, the first data read signal may be the first data read signal after the shooting trigger operation, or may be any data read signal after the shooting trigger operation. The first data read signal may be determined according to the relationship between the generation time of the data read signal and the triggering time of the shooting trigger operation. When the shooting trigger operation and the first data read signal are triggered simultaneously, the first image data is acquired, and during or before the acquisition of the first image data, the anti-shake component is controlled to be disabled, that is, the anti-shake component is in a non-working state, and the anti-shake component does not have an anti-shake function. Therefore, the first image data is image data without anti-shake.

[0054] In this embodiment, the first image data is acquired in response to the triggering of the shooting trigger operation and the first data reading signal, that is, under the joint action of the shooting trigger operation and the first data reading signal, the first image data is acquired and the anti-shake component is controlled to be disabled, thereby ensuring that a clear image can be captured after the shooting trigger operation.

[0055] In some embodiments, in response to the capture triggering operation and the triggering of the first data reading signal, acquiring the first image data in step 202 includes:

[0056] A data read signal closest to the triggering moment of the shooting triggering operation after the shooting triggering operation is determined as a first data read signal; and first image data is acquired in response to the triggering of the first data read signal.

[0057] After the shooting trigger operation, multiple data read signals will appear, and each data read signal is used to indicate that the image data of the corresponding frame has been read. The data read signal closest to the triggering moment of the shooting trigger operation after the shooting trigger operation is the first data read signal after the shooting trigger operation. The triggering in response to the first data read signal after the shooting trigger operation is characterized by first responding to the shooting trigger operation and then responding to the first data read signal after the shooting trigger operation to obtain the first image data.

[0058] Optionally, the first image data is acquired by triggering the first data read signal after the shooting trigger operation, that is, the first data read signal after the shooting trigger operation is used as the first data read signal. The first data read signal after the shooting trigger operation is a data read signal after the shooting trigger operation that is closest to the triggering moment of the shooting trigger operation.

[0059] In one example, a schematic diagram of obtaining the first image data and the second image data is shown in FIG3, and the first data read signal after the shooting trigger operation is used as the first data read signal. In response to the triggering of the first data read signal after the shooting trigger operation, the first image data is obtained, and the first image data is blurred image data, wherein, in the process of obtaining the first image data, the anti-shake component is controlled to be disabled, and the lens is controlled to move from the current position toward the optical center of the lens, and in response to the triggering of the second data read signal after the shooting trigger operation, the first frame of the second image data is obtained, and in response to the triggering of the third data read signal after the shooting trigger operation, the second frame of the second image data is obtained. It can be seen that in this example, one frame of the first image data and two frames of the second image data are obtained, wherein, in the process of obtaining the second image data, the anti-shake component is controlled to be enabled.

[0060] In this embodiment, the first image data is obtained by responding to the trigger of the first data reading signal after the shooting trigger operation. The first image data can be quickly obtained after the shooting trigger operation, and the anti-shake component can be controlled after the return operation is performed in time to enable the acquisition of a clear anti-shake image, thereby improving the shooting efficiency.

[0061] In some embodiments, in response to the capture triggering operation and the triggering of the first data reading signal, acquiring the first image data in step 202 includes:

[0062] In response to a shooting trigger operation and a trigger of a first data reading signal, a target number of first image data is acquired; wherein the target number is determined according to the reading performance of the image sensor of the camera module, and the first data reading signal is a pulse signal, and each pulse signal is used to indicate that the reading of a frame of first image data is completed.

[0063] The reading performance of the image sensor refers to the time taken by the image sensor to read a frame of image data, that is, the time taken by the photosensitive element in the image sensor to convert the photosensitive value into a digital value and read it out. The reading performance of different image sensors is generally different. The longer the time taken by the image sensor to read a frame of image data, the worse the reading performance of the image sensor. Correspondingly, the shorter the time taken by the image sensor to read a frame of image data, the better the reading performance of the image sensor. In other words, the worse the reading performance of the image sensor, the longer the time taken to read a frame of image data, resulting in a shorter non-exposure time, and the more the corresponding number of targets can be. The better the reading performance of the image sensor, the shorter the time taken to read a frame of image data, resulting in a longer non-exposure time, and the fewer the corresponding number of targets can be. The number of targets is negatively correlated with the reading performance of the image sensor. The number of targets is at least 1.

[0064] Optionally, in response to a shooting trigger operation and a trigger of a first data read signal, a target amount of first image data is continuously acquired, each frame of first image data corresponds to a data read signal, and each data read signal indicates that the reading of a frame of first image data is completed.

[0065] In this embodiment, by responding to the shooting trigger operation and the triggering of the first data reading signal, a target number of first image data are obtained, and the anti-shake component can be controlled to be disabled within the time length corresponding to the acquisition of the target number of image data, that is, the distance between the anti-shake component and the reference center is reduced by the acquisition time length of the target number of frame image data. Having sufficient time length to reduce the distance between the anti-shake component and the reference center can improve the clarity of the target image.

[0066] In some embodiments, the second image data includes multiple frames; step 206 of obtaining the target image according to the second image data includes:

[0067] The multiple frames of second image data are fused to obtain a target image.

[0068] The second image data is high-definition image data, and the pixel information of corresponding positions in multiple frames of the second image data can be fused to obtain the pixel information of the corresponding position in the target image. For example, the fusion can be performed by weighted averaging or arithmetic averaging.

[0069] In an optional example, pixel information at corresponding positions in multiple frames of second image data is weightedly fused, wherein the weight corresponding to the weighted fusion can be determined based on the acquisition time of the second image data. For example, the earlier the acquisition time of the second image data is, the greater the corresponding weight is, and the later the acquisition time of the second image data is, the smaller the corresponding weight is.

[0070] In this embodiment, by fusing multiple frames of second image data, image information in the second image data with higher definition can be fully utilized to obtain a target image with higher definition.

[0071] In an exemplary embodiment, obtaining a target image according to the second image data includes:

[0072] The first image data is deblurred to obtain deblurred image data corresponding to the first image data; and a target image is obtained according to the deblurred image data and the second image data.

[0073] The clarity of the deblurred image data is higher than the clarity of the first image data.

[0074] Optionally, the first image data may be deblurred by a deblurring algorithm or a fuzzy processing model to obtain deblurred image data corresponding to the first image data. The deblurring algorithm or the fuzzy processing model is not specifically limited herein. The deblurred image data may be fused with the second image data to obtain a target image.

[0075] In this embodiment, by deblurring the first image data, deblurred image data corresponding to the first image data is obtained, and then the target image data is obtained based on the deblurred image data and the second image data. This enables the target image to fuse the image information of the first image data and the second image data, thereby enriching the image information of the target image.

[0076] In some embodiments, performing deblurring processing on the first image data to obtain deblurred image data corresponding to the first image data includes:

[0077] The first image data is deblurred according to the second image data to obtain deblurred image data corresponding to the first image data.

[0078] Optionally, target second image data adjacent to the first image data is selected, and the first image data is deblurred based on the target second image data to obtain deblurred image data corresponding to the first image data. For example, a deblurring kernel corresponding to the first image data may be determined based on the target second image data and the first image data, and the first image data is deblurred based on the deblurring kernel to obtain deblurred image data corresponding to the first image data. Alternatively, the previous frame of image data of the first image data, the first image data, and the second image data adjacent to the first image data may be selected to determine the deblurring kernel corresponding to the first image data.

[0079] In this embodiment, the first image data is deblurred by using the second image data with higher clarity to obtain deblurred image data corresponding to the first image data. The first image data and the second image data are obtained by shooting the same picture, so that the deblurred image data is more consistent with the actual shot picture and has higher clarity.

[0080] In some embodiments, in response to the shooting trigger operation and the triggering of the first data reading signal in step 202, before acquiring the first image data, the method further includes:

[0081] When the camera module is in an enabled state, in response to the triggering of the third data reading signal, the third image data is acquired, and in the process of acquiring the third image data, the anti-shake component is controlled to be enabled; wherein the generation time of the third data reading signal is earlier than the generation time of the first data reading signal;

[0082] Obtaining a target image according to the second image data includes:

[0083] A target image is obtained according to the second image data and the third image data.

[0084] Wherein, when the camera module is in an enabled state, the anti-shake component is usually in an enabled state, and in response to the triggering of the third data reading signal, the third image data is acquired, and the third image data is the anti-shake image data, and the electronic device acquires the first image data in response to the shooting triggering operation and the triggering of the first data reading signal. The generation time of the first data reading signal is later than the generation time of the third data reading signal.

[0085] Optionally, the second image data and the third image data are fused to obtain the target image data, wherein the fusion can be performed in a weighted or arithmetic averaging manner.

[0086] Normally, when the camera module is in an enabled state, the image sensor collects image data, and the anti-shake component is enabled to obtain anti-shake image data. Each frame of anti-shake image data corresponds to a data reading signal, and the anti-shake image here is the third image data. When the shooting is triggered, the electronic device responds to the shooting trigger operation and the triggering of the first data reading signal to obtain the first image data, that is, the acquisition time of the third image data is earlier than the acquisition time of the first image data.

[0087] In one example, the schematic diagram of obtaining the third image data is shown in FIG4 . The electronic device obtains the third image data in response to the trigger of the third data read signal. In the process of obtaining the third image data, the anti-shake component is controlled to be enabled. Then, the electronic device obtains the first image data in response to the trigger of the shooting trigger operation and the first data read signal. In the process of obtaining the first image data, the anti-shake component is controlled to be disabled, and the lens is controlled to move from the current position to the optical center of the lens. If the lens stops moving from the current position to the optical center of the lens, the second image data is obtained in response to the trigger of the second data read signal, and the anti-shake component is controlled to be enabled in the process of obtaining the second image data. The second data read signal is generated later than the first data read signal, and the first data read signal is generated later than the third data read signal. Then, the target image is obtained based on the second image data and the third image data.

[0088] In the present embodiment, before acquiring the first image data in response to the shooting trigger operation and the triggering of the first data reading signal, the third image data is acquired in response to the triggering of the third data reading signal. Since the anti-shake component is in an enabled state during the process of acquiring the third image data, the third image data is also anti-shake image data and has a certain clarity. Therefore, the target image is obtained based on the third image data and the second image data. While obtaining a clear captured image, more actual detail information of the captured picture can be retained, thereby improving the clarity and accuracy of the captured image.

[0089] In an exemplary embodiment, the reference center includes an optical center or a photosensitive center; and the method further includes:

[0090] In the process of controlling the anti-shake component to be disabled, the lens in the anti-shake component is controlled to move from the current position toward the optical center of the lens; or, the photosensitive element in the anti-shake component is controlled to move from the current position toward the photosensitive center of the photosensitive element; when the preset stop condition is met, the step of acquiring the second image data in response to the triggering of the second data reading signal is executed.

[0091] The optical center of the lens refers to the position of the lens where the outgoing direction and the incident direction are parallel to each other when light from any direction passes through. The optical center of the lens is usually the center of gravity of the lens. The photosensitive center refers to the imaging center position of the photosensitive element. When the photosensitive element is at the imaging center position, it can fully and stably image the light of the object. The photosensitive element includes an image sensor. When the lens is at the optical center or the photosensitive element is at the photosensitive center, the clarity of the collected image data is the highest.

[0092] It is easy to understand that the optical center of the lens is often also the initialization position of the lens. The clarity of the image data obtained when the lens is at the optical center position is the highest. Exemplarily, in the process of acquiring the first image data, the anti-shake component is controlled to be disabled, and the lens is controlled to move from the current position to the optical center of the lens, and can be moved to the target position. The target position may include the optical center or any position within a preset range centered on the optical center. For example, a preset range of 20%-30% of the lens movement stroke centered on the optical center, and the target position may be any position within the preset range. The current position refers to the position when the lens starts to collect the first image data. In the process of collecting image data, the device shakes due to external factors, and the position of the lens will also change, and it is not necessarily fixed at the initialization position. Therefore, it is necessary to move the lens from the position after shaking to the target position to achieve jitter compensation for the collected image data. Correspondingly, the photosensitive center of the photosensitive element is often also the initialization position of the photosensitive element.

[0093] Exemplarily, controlling the lens to move from the current position toward the optical center may be controlling any position on the lens to move toward the optical center. For example, the center of the lens may be controlled to move toward the optical center. The center of the controlled lens includes the center of gravity of the lens. The preset stop condition refers to the condition for controlling the anti-shake component to stop moving from the current position toward the reference center. The preset stop condition may include, for example, at least one of the following: the lens moves to a preset position, or the photosensitive element moves to a target position, or the number of first image data acquired continuously reaches a target number, and the preset position may be the optical center position of the lens or any position within a preset range centered on the optical center. The target position may be the imaging center position of the photosensitive element or any position within a preset range centered on the imaging center.

[0094] Optionally, the electronic device acquires first image data in response to a shooting trigger operation and a first data reading signal. In the process of acquiring the first image data, the electronic device controls the anti-shake component to be disabled, and controls the lens to move from a current position toward the optical center of the lens, or controls the photosensitive element to move from a current position toward the photosensitive center. When a preset stop condition is met, the electronic device controls the lens or the photosensitive element to stop moving. When the lens or the photosensitive element stops moving, the electronic device controls the anti-shake component to be enabled in response to the triggering of a second data reading signal to acquire second image data.

[0095] In this embodiment, during the process of controlling the anti-shake component to be disabled, the anti-shake component is controlled to move from the current position toward the reference center, that is, the lens can be controlled to move from the current position toward the optical center of the lens, or the photosensitive element can be controlled to move from the current position toward the photosensitive center. When the preset stop condition is met, the second image data is acquired in response to the triggering of the second data reading signal, that is, the acquisition of the first image data is switched to the acquisition of the second image data. The acquisition timing of the second image data can be accurately determined, thereby improving the shooting efficiency and accuracy of the captured image. At the same time, it can be achieved that the lens is pulled back to the optical center or the photosensitive element is pulled back to the optical center by the acquisition time of at least one frame of image data. Pull it to the photosensitive center, and there is enough pull-back time to enable the lens to successfully pull back to the optical center or the photosensitive element to successfully pull back to the photosensitive center, thereby reducing the control performance requirements for driving components such as motors and the readout performance requirements for image sensors. The anti-shake component has a larger anti-shake angle when it is restored and enabled, so that higher-definition image data can be collected and clearer images can be obtained. The influence of non-exposure time can be avoided, and higher-definition images can be taken for scenes with short non-exposure time such as dark environments. Better motion blur suppression effect can be achieved by the anti-shake component returning to the center in more application scenarios, thereby increasing the scope of application scenarios in which the anti-shake component returning to the center is effective.

[0096] In some embodiments, the first image data has a lower definition than the second image data.

[0097] The first image data is image data collected when the anti-shake component is disabled, that is, the first image data is image data collected when the anti-shake component is not working, and image data that has not been anti-shake compensated by the anti-shake component. If there is shaking, it may be blurred image data. The second image data is image data collected when the anti-shake component is enabled, that is, the second image data is image data collected when the anti-shake component is working, and image data that has been anti-shake compensated by the anti-shake component. If there is shaking, it will be compensated by the anti-shake component to be a clear image. Since the first distance between the anti-shake component and the reference center at the moment when the first data reading signal is generated is greater than the second distance between the anti-shake component and the reference center at the moment when the second data reading signal is generated, it means that during the disabling process of the anti-shake component, the distance between the anti-shake component and the reference center is decreasing. If the anti-shake component is disabled for a longer time, the distance between the anti-shake component and the reference center is reduced more, that is, the anti-shake component is closer to the reference center. In other words, the anti-shake component is disabled in order to gain time for the anti-shake component to return to the center when it is restored. Then, the anti-shake component has a larger anti-shake angle when it is restored, thereby obtaining clearer second image data. Then, the captured target image is obtained based on the clearer second image data, which can improve the clarity of the target image.

[0098] In some embodiments, the non-exposure duration in the first shooting scene is shorter than the non-exposure duration in the second shooting scene, and the brightness of the first shooting scene is lower than the brightness of the second shooting scene.

[0099] For the same camera module, the non-exposure time in the first shooting scene is shorter than the non-exposure time in the second shooting scene, and the brightness of the first shooting scene is lower than that of the second shooting scene. For example, the first shooting scene is a dark light environment, and the second shooting scene is a normal bright light environment. It is easy to understand that in a dark light environment, due to the dim light, a longer exposure time is required to obtain more image information to capture a more complete image. Therefore, compared with a normal bright light environment, the non-exposure time in a dark light environment is longer. The darker the brightness of the shooting scene, the longer the exposure time and the shorter the non-exposure time.

[0100] It should be noted that, in the first shooting scene and the second shooting scene, the interval duration between the two data reading signals is the same, and the interval duration between the two data reading signals includes non-exposure duration and exposure duration. The non-exposure duration in the first shooting scene is shorter than the non-exposure duration in the second shooting scene. Therefore, the exposure duration in the first shooting scene is longer than the exposure duration in the second shooting scene.

[0101] Optionally, the above-mentioned shooting method can be applied to a first shooting scene and a second shooting scene. For example, in the first shooting scene, the first image data can be acquired in response to the triggering of the shooting trigger operation and the first data reading signal, and in the process of acquiring the first image data, the anti-shake component is controlled to be disabled; in the second shooting scene, the first image data can be acquired in response to the triggering of the shooting trigger operation and the first data reading signal, and before acquiring the first image data, for example, at any time between the time when the first data reading signal is generated and the time when the first image data is started to be collected, or before the time when the first data reading signal is generated, the anti-shake component is controlled to be disabled.

[0102] In this embodiment, by shortening the corresponding non-exposure time and lengthening the exposure time in shooting scenes with lower brightness, more image detail information is obtained, thereby achieving a larger anti-shake angle for shake compensation when the anti-shake component is restored and enabled, and being able to obtain clearer image data with more detail information, thereby achieving higher definition images when shooting in dark environments.

[0103] In an exemplary embodiment, a flowchart of a photographing method is shown in FIG. 5 . The photographing method includes steps 502 to 508 .

[0104] Step 502 , in response to the triggering of the third data reading signal, acquiring third image data, and in the process of acquiring the third image data, controlling the anti-shake component to be enabled.

[0105] Step 504, in response to the shooting trigger operation and the triggering of the first data reading signal, obtain the target number of first image data, control the anti-shake component to be disabled during or before obtaining the first image data, and control the anti-shake component to move from the current position toward the reference center direction; wherein the data reading signal is a pulse signal, and each pulse signal is used to indicate that the reading of a frame of image data is completed.

[0106] Step 506, when acquiring the target number of first image data, control the anti-shake component to stop moving from the current position toward the reference center, acquire the second image data in response to the triggering of the second data read signal, and control the anti-shake component to be enabled during or before acquiring the second image data; wherein, the first data read signal is generated later than the third data read signal, the second data read signal is generated later than the first data read signal, and a first distance between the anti-shake component and the reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated.

[0107] Step 508: Fusing the second image data and the third image data to obtain a target image.

[0108] In this embodiment, the anti-shake component is recentered by sacrificing the acquisition time of at least one frame of image data under the triggering of the shooting trigger operation and the data reading signal, so that the anti-shake component has the largest anti-shake angle when it is restored to be enabled, so that the clarity of the acquired image data is the highest, and the captured image is obtained by fusion based on the clear image acquired in the enabled state of the anti-shake component, so that the captured image has higher clarity and has a better motion blur suppression effect. The setting of the anti-shake component re-centering condition and the re-centering timing in this embodiment avoids the influence of the non-exposure time and the exposure mode. The anti-shake component can be recentered in any exposure period to capture a clear image, which increases the scene range in which the anti-shake component re-centering takes effect.

[0109] In another exemplary embodiment, a flowchart of a shooting method is shown in FIG6 , and the electronic device includes a camera module, the camera module includes an OIS anti-shake component and an image sensor, and the OIS anti-shake component includes a lens. It can be understood that the anti-shake component may also include a photosensitive element. This example is explained by taking the anti-shake component including a lens as an example. The data read signal includes a first data read signal, a second data read signal, and a third data read signal. The generation time of the first data read signal is earlier than the generation time of the second data read signal, and the generation time of the third data read signal is earlier than the generation time of the first data read signal. The data read signal may be, for example, a Vsync signal. The electronic device responds to the triggering of the third data read signal, and the image sensor acquires the third image data. The data read signal is a pulse signal. The third data read signal may be any data read signal, and one pulse signal corresponds to one frame of the third image data. If the electronic device detects a shooting trigger operation, a shooting trigger signal is generated in response to the shooting trigger operation. The electronic device acquires first image data in response to the triggering of the shooting trigger signal and the first data reading signal. The first image data may include one or more frames (the example in FIG. 6 is a case of one frame of first image data). In the process of acquiring the first image data, the anti-shake component is controlled to be disabled, and the lens is controlled to move from the current position to the optical center of the lens. When the preset stop condition is met, the lens is controlled to stop moving from the current position to the optical center of the lens. In response to the triggering of the second data reading signal, the second image data is acquired. In the process of acquiring the second image data, the anti-shake component is controlled to be enabled. The second image data acquired in this way is image data with higher definition. For example, the second image data of the 1st to 3rd frames acquired during the process of enabling the anti-shake component after returning to the center has higher definition. Then the first number of third image data and the second number of second image data are selected and fused to obtain a target image, which is the image finally captured. Among them, the first number and the second number can be the same or different, and the first number and the second number can be selected according to the actual application scenario.

[0110] The shooting method in the above embodiment, by returning the lens to the center according to the data reading signal and the shooting trigger signal when the camera module is in the enabled state, that is, in response to the triggering of the data reading signal and the shooting trigger signal, the first image data is obtained, and the lens is controlled to move from the current position to the optical center direction of the lens during the process of obtaining the first image data, so as to ensure that the lens return time is greater than or equal to the time of collecting one frame of image data, such as the application scenario with an image acquisition frame rate of 30 frames / second, the return time is greater than or equal to 33 milliseconds, the application scenario with an image acquisition frame rate of 60 frames / second, the return time is greater than or equal to 17 milliseconds, etc. Under such a return time, it can be ensured that the lens is successfully pulled back to the optical center, so as to ensure that the clarity of the image data obtained after the return to the center is the highest when the anti-shake component is enabled, so as to help the image finally captured have a better motion blur suppression effect. At the same time, the hardware control performance requirements for the lens return to the center are reduced, and the dependence on the exposure mode and the influence of the exposure time are avoided. Whether it is a long or short exposure mode or a single exposure mode, the return to the center can be achieved, and the application scenario range in which the lens return to the center is effective is increased.

[0111] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0112] Based on the same inventive concept, the embodiment of the present application also provides a photographing device for implementing the photographing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more embodiments of the photographing device provided below can refer to the limitations on the photographing method above, and will not be repeated here.

[0113] In an exemplary embodiment, as shown in FIG. 7 , a photographing device is provided, including: a first image acquisition module 702, a second image acquisition module 704 and a target image acquisition module 706, wherein:

[0114] A first image acquisition module 702 is configured to acquire first image data in response to a trigger of a first data reading signal, and to control the anti-shake component to be disabled during or before the process of acquiring the first image data;

[0115] The second image acquisition module 704 is used to acquire the second image data in response to the triggering of the second data reading signal, and control the anti-shake component to be enabled during or before the process of acquiring the second image data; the second data reading signal is generated later than the first data reading signal; and a first distance between the anti-shake component and the reference center at the time when the first data reading signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data reading signal is generated;

[0116] The target image obtaining module 706 is used to obtain a target image according to the second image data.

[0117] In some embodiments, the first image acquisition module 702 is further configured to acquire first image data in response to a capture trigger operation and a trigger of a first data reading signal.

[0118] In some embodiments, the first image acquisition module 702 is also used to determine a data read signal that is closest to the triggering moment of the shooting trigger operation after the shooting trigger operation as the first data read signal; and acquire the first image data in response to the triggering of the first data read signal.

[0119] In some embodiments, the first image acquisition module 702 is also used to acquire a target number of first image data in response to a shooting trigger operation and a trigger of a first data reading signal; the target number is determined according to the reading performance of the image sensor of the camera module, and the first data reading signal is a pulse signal, and each pulse signal is used to indicate that the reading of a frame of first image data is completed.

[0120] In some embodiments, the second image data includes multiple frames; the target image obtaining module 706 is further used to fuse the multiple frames of second image data to obtain the target image.

[0121] In some embodiments, the target image obtaining module 706 is further used to perform deblurring processing on the first image data to obtain deblurred image data corresponding to the first image data; and obtain the target image according to the deblurred image data and the second image data.

[0122] In some embodiments, the target image obtaining module 706 is further configured to perform a deblurring process on the first image data according to the second image data to obtain deblurred image data corresponding to the first image data.

[0123] In some embodiments, the shooting device further includes a third image acquisition module, which is used to acquire the third image data in response to the triggering of the shooting trigger operation and the first data reading signal before acquiring the first image data, and in the case where the camera module is in an enabled state, in response to the triggering of the third data reading signal, and to control the anti-shake component to be enabled during the process of acquiring the third image data; the generation time of the third data reading signal is earlier than the generation time of the first data reading signal;

[0124] The target image obtaining module 706 is further configured to obtain a target image according to the second image data and the third image data.

[0125] In some embodiments, the reference center includes an optical center or a photosensitive center; the shooting device also includes an anti-shake component moving module, which is used to control the lens in the anti-shake component to move from a current position toward the optical center of the lens during the process of controlling the anti-shake component to be disabled; or, to control the photosensitive element in the anti-shake component to move from a current position toward the photosensitive center of the photosensitive element; when the preset stop condition is met, the trigger in response to the second data reading signal is executed to obtain the second image data.

[0126] Each module in the above-mentioned shooting device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in an electronic device in the form of hardware, or can be stored in a memory in an electronic device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0127] In an exemplary embodiment, an electronic device is provided, which may be a terminal, and its internal structure diagram may be shown in FIG8. The electronic device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, the memory, and the input / output interface are connected via a system bus, and the communication interface, the display unit, and the input device are connected to the system bus via the input / output interface. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the electronic device is used to exchange information between the processor and an external device. The communication interface of the electronic device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner may be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a shooting method is implemented. The display unit of the electronic device is used to form a visually visible picture, which may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the electronic device casing, or an external keyboard, touchpad or mouse.

[0128] Those skilled in the art will understand that the structure shown in FIG. 8 is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0129] In an exemplary embodiment, an electronic device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the steps of the shooting method in the above embodiment are implemented.

[0130] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the shooting method in the above embodiment are implemented.

[0131] In one embodiment, a computer program product is provided, including a computer program, which implements the steps of the shooting method in the above embodiment when executed by a processor.

[0132] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0133] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0134] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0135] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A shooting method, characterized in that: Applied to a camera module, the camera module includes an anti-shake component, and the method includes: In response to a trigger of a first data reading signal, first image data is acquired, and before or during the process of acquiring the first image data, the anti-shake component is controlled to be disabled; In response to a trigger of a second data read signal, second image data is acquired, and in the process of or before acquiring the second image data, the anti-shake component is controlled to be enabled; the second data read signal is generated later than the first data read signal; a first distance between the anti-shake component and a reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated; A target image is obtained according to the second image data.

2. The method according to claim 1, characterized in that The step of acquiring the first image data in response to the triggering of the first data reading signal comprises: In response to the triggering of the shooting trigger operation and the first data reading signal, the first image data is acquired.

3. The method according to claim 2, characterized in that The step of acquiring first image data in response to a shooting trigger operation and a trigger of a first data reading signal comprises: Determine a data reading signal which is closest to the triggering moment of the shooting triggering operation after the shooting triggering operation as a first data reading signal; In response to the triggering of the first data reading signal, the first image data is acquired.

4. The method according to claim 2, characterized in that: The step of acquiring first image data in response to a shooting trigger operation and a trigger of a first data reading signal comprises: In response to a shooting trigger operation and a trigger of a first data reading signal, a target number of first image data is acquired; the target number is determined according to the reading performance of the image sensor of the camera module, and the first data reading signal is a pulse signal, each pulse signal is used to indicate that the reading of a frame of first image data is completed.

5. The method according to claim 1, characterized in that: The second image data includes a plurality of frames; and obtaining a target image according to the second image data includes: A plurality of frames of the second image data are fused to obtain the target image.

6. The method according to claim 1, characterized in that The step of obtaining a target image according to the second image data comprises: Performing a deblurring process on the first image data to obtain deblurred image data corresponding to the first image data; The target image is obtained according to the deblurred image data and the second image data.

7. The method according to claim 6, characterized in that The deblurring the first image data to obtain deblurred image data corresponding to the first image data includes: The first image data is deblurred according to the second image data to obtain deblurred image data corresponding to the first image data.

8. The method according to claim 1, characterized in that Before acquiring the first image data in response to the triggering of the first data reading signal, the method further includes: When the camera module is in an enabled state, in response to a trigger of a third data reading signal, third image data is acquired, and in the process of acquiring the third image data, the anti-shake component is controlled to be enabled; the third data reading signal is generated earlier than the first data reading signal; The step of obtaining a target image according to the second image data comprises: The target image is obtained according to the second image data and the third image data.

9. The method according to any one of claims 1 to 8, characterized in that: The reference center includes an optical center or a photosensitive center; the method further includes: In the process of controlling the anti-shake component to be disabled, controlling the lens in the anti-shake component to move from a current position toward the optical center direction of the lens; Alternatively, controlling the photosensitive element in the anti-shake component to move from a current position toward a photosensitive center of the photosensitive element; When the preset stop condition is met, the step of acquiring the second image data in response to the triggering of the second data reading signal is performed.

10. The method according to any one of claims 1 to 8, characterized in that: The definition of the first image data is lower than that of the second image data.

11. The method according to any one of claims 1 to 8, characterized in that: The non-exposure duration in the first shooting scene is shorter than the non-exposure duration in the second shooting scene, and the brightness of the first shooting scene is lower than the brightness of the second shooting scene.

12. A photographing device, characterized in that: The device comprises: A first image acquisition module, configured to acquire first image data in response to a trigger of a first data reading signal, and to control the anti-shake component to be disabled during or before acquiring the first image data; a second image acquisition module, configured to acquire second image data in response to a trigger of a second data read signal, and control the anti-shake component to be enabled during or before the process of acquiring the second image data; the second data read signal is generated later than the first data read signal; a first distance between the anti-shake component and the reference center at the time when the first data read signal is generated is greater than a second distance between the anti-shake component and the reference center at the time when the second data read signal is generated; The target image obtaining module is used to obtain a target image according to the second image data.

13. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 11 are implemented.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

Citation Information

Cited By

  • Electronic device and image stabilization method thereof

    US20260129296A1