Image acquisition method and device, electronic equipment and storage medium

Abstract

The invention provides an image acquisition method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the scanning based on the scanning starting time offset in a plurality of continuous time periods, and obtaining a plurality of frames of scanning images; combining the multiple frames of scanning images into one frame of target image; wherein in the plurality of continuous time periods, the difference between the scanning starting time offsets in the adjacent time periods is a preset number of shutter periods. Scanning is carried out based on the scanning starting time offset with the difference of the preset number of shutter cycles, so that the bright and dark stripes of the multiple frames of scanning images are staggered and the energy of the bright stripes is the same, then the multiple frames of scanning images with the staggered bright and dark stripes are combined, a stripe-free target image can be obtained, and the quality of the collected image is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image acquisition, and particularly to an image acquisition method, device, electronic device and storage medium. Background Art

[0002] When a CMOS (Complementary Metal Oxide Semiconductor) progressive scan image sensor acquires an image, if the light frequency or screen frequency is not an integer multiple of half the shutter period, the image quality will be poor; for example, when the shutter period is small, there will be bright and dark stripes in the image scanned by the CMOS progressive scan image sensor. If the shutter period is increased, the image will be overexposed;

[0003] Therefore, how to improve the quality of the acquired image has become an urgent problem to be solved. Summary of the Invention

[0004] The present invention provides an image acquisition method, device, electronic device and storage medium, which are used to solve the defect of poor image quality in the prior art and realize the improvement of image quality.

[0005] The present invention provides an image acquisition method, including:

[0006] Performing scanning based on the scanning start time offsets within a plurality of consecutive time periods to obtain multiple frames of scanned images;

[0007] Merging the multiple frames of scanned images into one frame of target image;

[0008] Wherein, within the plurality of consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter periods.

[0009] According to the image acquisition method provided by the present invention, the determining step of the scanning start time offsets within the plurality of consecutive time periods includes:

[0010] Determining the scanning start time offset corresponding to the first frame of scanned image among the multiple frames of scanned images based on the generation time of the maximum energy value or the minimum energy value;

[0011] Determining the scanning start time offsets within the plurality of consecutive time periods based on the scanning start time offset corresponding to the first frame of scanned image and the preset number of shutter periods;

[0012] Wherein, the maximum energy value or the minimum energy value is: the maximum value or the minimum value of the energy values generated during the scanning of any one frame of scanned image.

[0013] An image acquisition method provided by the present invention, the determining step of the generation time of the maximum energy value or the minimum energy value includes:

[0014] Determine the scanning start time of the reference frame image, where the reference frame image is obtained by scanning before the multi-frame scanned images;

[0015] Delay the scanning start time by a first offset to obtain the generation time of the maximum energy value or the minimum energy value;

[0016] Wherein, the first offset is calculated based on the difference between the scanning start time and the reference time; the reference time is: the generation time of the maximum or minimum value of the energy generated during the scanning of the reference frame image.

[0017] An image acquisition method provided by the present invention, the determining the scanning start time of the reference frame image includes:

[0018] Based on a first expression regarding the scanning start time and a second expression regarding the scanning start time, obtain the scanning start time;

[0019] Wherein, the first expression is used to represent: the total energy within an energy period corresponding to the energy generated during the scanning of the reference frame image; the second expression is used to represent: the energy generated within a preset number of shutter periods respectively during the scanning of the reference frame image.

[0020] An image acquisition method provided by the present invention, the obtaining the scanning start time based on a first expression regarding the scanning start time and a second expression regarding the scanning start time includes:

[0021] Based on the ratios of the brightnesses corresponding to the preset number of shutter periods respectively to the total brightness of the reference frame scan image, obtain the ratios of the energies generated within the preset number of shutter periods respectively to the total energy;

[0022] Based on the ratios of the energies generated within the preset number of shutter periods respectively to the total energy, the first expression, and the second expression, obtain the scanning start time.

[0023] The present invention also provides an image acquisition method, the method includes:

[0024] Execute at least one image acquisition process to obtain the target image output by the at least one image acquisition process;

[0025] Wherein, the image acquisition process includes:

[0026] Perform scanning based on the scanning start time offsets within multiple consecutive time periods to obtain multiple frames of scanned images;

[0027] Merge the multiple frames of scanned images into one frame of target image;

[0028] Among them, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0029] The present invention also provides an image acquisition device, and the device includes:

[0030] A scanning module, configured to perform scanning based on the scanning start time offsets within multiple consecutive time periods to obtain multiple frames of scanned images;

[0031] A merging module, configured to merge the multiple frames of scanned images into one frame of target image;

[0032] Among them, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0033] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the image acquisition method as described in any one of the above.

[0034] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the image acquisition method as described in any one of the above.

[0035] The present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the image acquisition method as described in any one of the above.

[0036] The image acquisition method, device, electronic device, and storage medium provided by the present invention perform scanning based on the scanning start time offsets that differ by a preset number of shutter cycles, so that the bright and dark stripes of multiple frames of scanned images are misaligned and the bright stripe energies are the same. Furthermore, after merging the multiple frames of scanned images with misaligned bright and dark stripes, a stripe-free target image can be obtained, improving the quality of the acquired images. Description of the Drawings

[0037] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0038] Figure 1 It is one of the schematic flowcharts of the image acquisition method provided by the present invention;

[0039] Figure 2 It is a schematic diagram of the energy value waveform generated during the scanning process provided by the present invention;

[0040] Figure 3 It is a schematic diagram of the energy values within two shutter cycles provided by the present invention;

[0041] Figure 4 It is a schematic diagram of the energy change function generated when passing through one shutter cycle at different scanning start times provided by the present invention;

[0042] Figure 5 It is a schematic structural diagram of the image acquisition device provided by the present invention;

[0043] Figure 6 It is a schematic structural diagram of the electronic device provided by the present invention. Detailed implementation manners

[0044] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without creative efforts shall fall within the protection scope of the present invention.

[0045] The image acquisition method, device, electronic device and storage medium of the present invention will be described below with reference to the accompanying drawings.

[0046] Figure 1 It is one of the schematic flowcharts of the image acquisition method provided by the present invention. As Figure 1 shown, the image acquisition method includes the following steps:

[0047] Step 100: Based on the scanning start time offsets within multiple consecutive time periods, perform scanning to obtain multiple frames of scanned images;

[0048] Among them, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles;

[0049] Specifically, the image acquisition method is applied to a camera device, such as a camera; among them, the camera device at least includes an image sensor that can adjust the scanning time of each frame of image.

[0050] For example, if the screen refresh rate (screen frequency) in the monitoring screen is 60HZ, an image sensor that supports at least 60fps per second can be used, and the image sensor supports adjusting the scanning time of each frame of image;

[0051] For example, if the indoor light frequency is 60HZ and it is in a wide dynamic application scenario, an image sensor that supports at least 90fps per second can be used, and the image sensor supports adjusting the scanning time of each frame of image.

[0052] Specifically, a time period is used to scan a frame of scanned image, and the scanning start moment of the scanned image is determined based on the start moment of the time period and the scanning start time offset within the time period;

[0053] For example, if the start moment of a time period is t0 and the scanning start time offset within the time period is △t, the image is scanned at the moment (t0 + △t).

[0054] Optionally, the length of the time period can be determined based on the frequency or refresh rate. For example, if the screen refresh rate (screen frequency) in the monitoring screen is 60HZ and an image sensor with 60fps per second is used, that is, 60 frames can be scanned per second, then one second can be evenly divided into 60 time periods, and the length of each time period is 1 / 60 second.

[0055] Step 110, merge the multiple frames of scanned images into one frame of target image.

[0056] Specifically, in order to improve the quality of the collected images, the scanning start time offset corresponding to each frame can be determined to accurately control the scanning start moment of each frame of scanned image, so that the bright and dark stripes of adjacent frames of scanned images are staggered, and then the scanned images with staggered bright and dark stripes are merged to obtain a target image without dark stripes.

[0057] In the present invention, multiple consecutive time periods can be 2 consecutive time periods or 3 consecutive time periods, that is, 2 frames of scanned images with staggered bright and dark stripes or 3 frames of scanned images with staggered bright and dark stripes can be obtained, and the 2 frames of scanned images with staggered bright and dark stripes or 3 frames of scanned images with staggered bright and dark stripes are merged to obtain a target image without dark stripes.

[0058] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 2. Then, the camera device can perform scanning using an image sensor based on two scanning start time offsets. The difference between the two scanning start time offsets can be 0 shutter periods, that is, the two scanning start time offsets are equal. Since (1 / f)÷2÷T = 2, that is, one shutter period is exactly half of an energy period in the energy values generated during the scanning process, the bright and dark stripes of two consecutive scanned images are exactly staggered. That is, two scanned images with staggered bright and dark stripes can be obtained and merged into a single image taken by the user.

[0059] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 3. Then, the camera device can perform scanning using an image sensor based on two scanning start time offsets. The difference between the two scanning start time offsets can be 1 shutter period (for example, the second scanning start time offset is delayed by 1 shutter period relative to the first scanning start time offset). That is, two scanned images with staggered bright and dark stripes can be obtained and merged into a single image taken by the user.

[0060] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 4. Then, the camera device can perform scanning using an image sensor based on two scanning start time offsets. The difference between the two scanning start time offsets can be 2 shutter periods (for example, the second scanning start time offset is delayed by 2 shutter periods relative to the first scanning start time offset). That is, two scanned images with staggered bright and dark stripes can be obtained and merged into a single image taken by the user.

[0061] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 4. Then, the camera device can perform scanning using an image sensor based on three scanning start time offsets. Among the three scanning start time offsets, the second scanning start time offset is delayed by one shutter period relative to the first scanning start time offset, and the third scanning start time offset is delayed by one shutter period relative to the second scanning start time offset. That is, three scanned images with staggered bright and dark stripes can be obtained and merged into a single image taken by the user.

[0062] In one embodiment, a user uses a camera device to capture a video. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 2. The acquisition process for each frame in the video is as follows: The camera device can perform scanning using an image sensor based on two scanning start-time offsets. The difference between the two scanning start-time offsets can be 0 shutter periods, that is, the two scanning start-time offsets are equal. Since (1 / f)÷2÷T = 2, that is, one shutter period is exactly half of an energy period in the energy values generated during the scanning process, the bright and dark stripes of two consecutive scanned images are exactly staggered and displayed. That is, two scanned images with staggered bright and dark stripes can be obtained and merged into one frame in the video. By continuously performing the above acquisition process multiple times, a series of consecutive frames can be obtained to form a video.

[0063] It should be noted that the energy values generated during one scanning process can form two energy periods.

[0064] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 3. The acquisition process for each frame in the video is as follows: The camera device can perform scanning using an image sensor based on two scanning start-time offsets. The difference between the two scanning start-time offsets can be 1 shutter period (for example, the second scanning start-time offset is delayed by 1 shutter period relative to the first scanning start-time offset). That is, two scanned images with staggered bright and dark stripes can be obtained and merged into one frame in the video. By continuously performing the above acquisition process multiple times, a series of consecutive frames can be obtained to form a video.

[0065] In one embodiment, a user uses a camera device to take a photo. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 4. The acquisition process for each frame in the video is as follows: The camera device can perform scanning using an image sensor based on two scanning start-time offsets. The difference between the two scanning start-time offsets can be 2 shutter periods (for example, the second scanning start-time offset is delayed by 2 shutter periods relative to the first scanning start-time offset). That is, two scanned images with staggered bright and dark stripes can be obtained and merged into one frame in the video. By continuously performing the above acquisition process multiple times, a series of consecutive frames can be obtained to form a video.

[0066] In one embodiment, the user takes a photo with a camera device. The screen refresh rate (screen frequency) is f, and the user adjusts a shutter period to T, where (1 / f)÷2÷T = 4. The acquisition process for each frame in the video is as follows: The camera device can perform scanning using an image sensor based on three scanning start time offsets. Among the three scanning start time offsets, the second scanning start time offset is delayed by one shutter period relative to the first scanning start time offset, and the third scanning start time offset is delayed by one shutter period relative to the second scanning start time offset. That is, three scanned images with interleaved bright and dark stripes can be obtained and merged into one frame in the video. By continuously performing the above acquisition process multiple times, a series of consecutive frames of images can be obtained to form a video.

[0067] The image acquisition method provided by the present invention performs scanning based on scanning start time offsets that differ by a preset number of shutter periods, so that the bright and dark stripes of multiple scanned images are misaligned and the bright stripe energies are the same. Then, after merging the multiple scanned images with misaligned bright and dark stripes, a target image without stripes can be obtained, improving the quality of the acquired images.

[0068] In some embodiments, the step of determining the scanning start time offsets within the multiple consecutive time periods includes:

[0069] Based on the generation moment of the maximum energy value or the minimum energy value, determine the scanning start time offset corresponding to the first scanned image among the multiple scanned images;

[0070] Based on the scanning start time offset corresponding to the first scanned image and the preset number of shutter periods, determine the scanning start time offsets within the multiple consecutive time periods;

[0071] Wherein, the maximum energy value or the minimum energy value is: the maximum value or the minimum value of the energy values generated during the scanning process of any one scanned image.

[0072] It should be noted that for the same camera device with unchanged shooting parameters in the same shooting scene, the waveforms formed by the energy values generated during each frame scanning process are the same, and the moments corresponding to the maximum energy value or the minimum energy value of the waveforms formed by the energy values generated during each frame scanning process are the same.

[0073] Specifically, the scanning start moment of the first scanned image among multiple consecutive scanned images can be adjusted to: the moment when the energy value generated during the scanning of this camera device is the maximum energy value or the minimum energy value.

[0074] Taking the screen refresh rate (screen frequency) f as 60HZ and the shutter period T as 1 / 360 second as an example, Figure 2 is a schematic diagram of the waveform of the energy value generated during the scanning process provided by the present invention, as Figure 2As shown, the moments corresponding to the maximum energy values include 1 / 240 second and 3 / 240 second, and the moments corresponding to the minimum energy values include 1 / 120 second and 1 / 60 second.

[0075] For example, it can be determined that the scanning start time offset corresponding to the first frame of the multi-frame scanned images is 1 / 240 second or 3 / 240 second.

[0076] For example, it can be determined that the scanning start time offset corresponding to the first frame of the multi-frame scanned images is 1 / 120 second or 1 / 60 second.

[0077] After determining the scanning start time offset corresponding to the first frame of the scanned images, delaying a preset number of shutter cycles backward can obtain the scanning start time offsets corresponding to the remaining scanned images respectively.

[0078] For example, the imaging device can perform scanning based on 2 scanning start time offsets using the image sensor to obtain 2 frames of scanned images; if it is determined that the scanning start time offset corresponding to the first frame of the scanned images is △t, then it can be determined that the scanning start time offset corresponding to the second frame of the scanned images is △t + M×T, where M is an integer greater than or equal to 0, such as M being 0 or 1 or 2, and T is a shutter cycle.

[0079] For example, the imaging device can perform scanning based on 3 scanning start time offsets using the image sensor to obtain 3 frames of scanned images; if it is determined that the scanning start time offset corresponding to the first frame of the scanned images is △t, then it can be determined that the scanning start time offset corresponding to the second frame of the scanned images is △t + T, and the scanning start time offset corresponding to the third frame of the scanned images is △t + 2×T, where T is a shutter cycle.

[0080] In the present invention, by adjusting the scanning start moments of consecutive multi-frame scanned images to the moments corresponding to the maximum energy value or the minimum energy value of the energy value waveform generated during any one-frame scanning process respectively, the bright stripe energies of the multi-frame scanned images can be ensured to be the same, which can better realize the merging of consecutive multi-frame scanned images and improve the quality of the acquired images.

[0081] In some embodiments, the step of determining the generation moment of the maximum energy value or the minimum energy value includes:

[0082] Determine the scanning start moment of the reference frame image, and the reference frame image is obtained by scanning before the multi-frame scanned images;

[0083] Delay the scanning start moment by a first offset to obtain the generation moment of the maximum energy value or the minimum energy value;

[0084] Wherein, the first offset is calculated based on the difference between the scanning start time and the reference time; the reference time is: the generation time of the maximum or minimum energy value generated during the scanning process of the reference frame image.

[0085] Specifically, in order to adjust the scanning start time of the first frame of the continuous multi-frame scanning images to the time when the energy value generated during the scanning of the imaging device is the maximum energy value or the minimum energy value, the first frame image scanned by the imaging device under the current parameters can be used as the reference frame image first. The scanning start time of the reference frame image is calculated, and a delay is performed based on the scanning start time of the reference frame image. Specifically, the first offset can be delayed to obtain the scanning start time offset of the next frame (which can be used as the first frame of the multi-frame scanning images), so that the scanning start time of the next frame of scanning image is the time when the energy value generated during the scanning of the imaging device is the maximum energy value or the minimum energy value.

[0086] Specifically, the scanning start time offset corresponding to the scanning start time after delaying the first offset can also be used as the scanning start time offset of the first frame of the continuous multi-frame scanning images that need to be merged in each group, so as to ensure that the scanning start time of the first frame of the continuous multi-frame scanning images that need to be merged in each group is the time when the energy value generated during the scanning of the imaging device is the maximum energy value or the minimum energy value.

[0087] In one embodiment, the imaging device uses an image sensor that can accurately adjust the inter-frame scanning time. The first frame of the scanning image at the start of scanning is used as the reference frame image, the scanning start time t of the reference frame image is confirmed, and the first offset △t’ is delayed to obtain the scanning start time offset t + △t’ of the second frame of the scanning image. Further, the scanning start time offset t + △t’ + M×T of the third frame of the scanning image can be determined, the scanning start time offset t + △t’ of the fourth frame of the scanning image, the scanning start time offset t + △t’ + M×T of the fifth frame of the scanning image, and so on. The scanning start time offsets of all subsequent frames of the scanning images are successively t + △t’ and t + △t’ + M×T, showing a periodic change; the second frame of the scanning image and the third frame of the scanning image are merged to obtain the first target image (that is, the adjacent two frames of stripe-misaligned images are combined into one frame of stripe-free image), the third frame of the scanning image and the fourth frame of the scanning image are merged to obtain the second target image, and so on, until all the scanning images are merged in pairs.

[0088] The present invention determines how to adjust the scanning start time of the first frame of a series of consecutive frames of scanned images to be combined by using an initial reference scanning frame, so as to ensure that the scanning start times of the series of consecutive frames of scanned images are at the moments corresponding to the maximum or minimum energy values of the energy value waveform, thereby ensuring that the bright stripe energies of the multiple frames of scanned images are the same and improving the quality of the acquired images.

[0089] In some embodiments, determining the scanning start time of the reference frame image includes:

[0090] Obtaining the scanning start time based on a first expression regarding the scanning start time and a second expression regarding the scanning start time;

[0091] Wherein, the first expression is used to represent the total energy within an energy period corresponding to the energy values generated during the scanning of the reference frame image; the second expression is used to represent the energies respectively generated within a preset number of shutter periods during the scanning of the reference frame image.

[0092] Specifically, within the time period corresponding to a frame of scanned image, there can be (1 / f÷T) shutter periods;

[0093] For example, if f = 60HZ and T = 1 / 360 second, then within the time period corresponding to a frame of scanned image, there can be 6 shutter periods, and 5 of them can be used for scanning, that is, the scanning duration is (1 / 60 - 1 / 360) second. The energy generated within the first 3 shutter periods (i.e., 1 / 2 of all shutter periods) can form an energy period, and the remaining 2 shutter periods can be used to calculate the scanning start time.

[0094] As Figure 2 shown, the first 3 shutter periods are 1 / 120 second, and the energy generated within the first 3 shutter periods forms an energy period, that is, a first expression regarding the scanning start time t can be obtained, which is used to represent the total energy within an energy period.

[0095] Figure 3 is a schematic diagram of the energy values within 2 shutter periods provided by the present invention. As Figure 3 shown, a second expression regarding the scanning start time t can be obtained, which is used to represent the energies respectively generated within a preset number of shutter periods.

[0096] Specifically, since the ratio between the energy generated within each shutter period and the total energy can be determined based on the ratio between the brightness within this shutter period and the total brightness, and the brightness value of the imaging device at each moment is known, then the scanning start time t can be calculated based on the first expression and the second expression regarding the scanning start time t.

[0097] In some embodiments, obtaining the scanning start time based on a first expression about the scanning start time and a second expression about the scanning start time comprises:

[0098] Based on the ratio between the brightness corresponding to the preset number of shutter periods and the total brightness of the reference frame scan image, the ratio between the energy generated in the preset number of shutter periods and the total energy is obtained;

[0099] The scanning start time is obtained based on the ratio between the energy generated in the preset number of shutter cycles and the total energy, the first expression and the second expression.

[0100] Specifically, the ratio between the energy generated in a shutter period and the total energy can be determined based on the ratio between the brightness in a shutter period and the total brightness. The expression of the ratio between the energy generated in the shutter period and the total energy can also be obtained based on the second expression and the first expression, that is, an equation can be formed to solve the scanning start time.

[0101] For example, a unique solution can be obtained based on the ratio of the brightness of two adjacent shutter cycles after an integer number of energy cycles from the scan start time to the total brightness, and the scan start time can be calculated accordingly.

[0102] Figure 4 is a schematic diagram of the energy change function generated when different scanning start times provided by the present invention respectively pass through a shutter cycle, wherein f=60HZ, T=1 / 360 seconds, the time period corresponding to a frame of scanned image may include 6 shutter cycles, 5 of which may be used for scanning, that is, the scanning duration is (1 / 60-1 / 360) seconds, wherein the energy generated in the first 3 shutter cycles (i.e. 1 / 2 of all shutter cycles) may form an energy cycle, and the remaining 2 shutter cycles are used to calculate the scanning start time; Figure 4 As shown, one energy value corresponds to two t values, that is, based on the above ratio, the second expression corresponding to one shutter cycle and the equation formed by the first expression, two solutions can be obtained. If it is necessary to determine the exact scanning start time t, taking the preset number of shutter cycles including the remaining two shutter cycles (shutter cycle four and shutter cycle five) as an example, equation 1 and equation 2 can be combined to obtain a unique solution t;

[0103] Among them, Equation 1 is an equation formed by the ratio of the energy E1 generated within the fourth shutter period to the total energy E, the second expression corresponding to the fourth shutter period, and the first expression; Equation 2 is an equation formed by the ratio of the energy E2 generated within the fifth shutter period to the total energy E, the second expression corresponding to the fifth shutter period, and the first expression. Equations 1 and 2 can be specifically described as follows:

[0104]

[0105] Among them, t is time.

[0106] In one embodiment, when the indoor light frequency f is 60HZ, the image sensor of the imaging device needs to support at least 90fps per second, and the minimum scanning time for each frame of scanned image is less than 1 / 120 - 1 / 360s. The image processing method of combining two frames into one frame in the wide dynamic application scenario can be combined with the method of combining multi-frame bright and dark interleaved scanned images in the present invention. For example, the time of the first frame is 1 / 60s, and the time of the second and third frames is 1 / 120s. Since 1 / 120s is an integer multiple of the energy period, two frames of scanned images with fixed stripes and periodic dislocation between adjacent frames can be obtained, that is, the second and third frames are bright and dark interleaved scanned images. Then, the second and third frames can be synthesized for the first time, and then synthesized with the first frame using the image processing method of combining two frames into one frame in the wide dynamic application scenario for the second time, finally obtaining a complete wide dynamic image without stripes.

[0107] In some embodiments, at least one image acquisition process may also be performed to obtain the target image output by the at least one image acquisition process;

[0108] Among them, the image acquisition process includes:

[0109] Scanning based on the scanning start time offset within multiple consecutive time periods to obtain multiple frames of scanned images;

[0110] Combining the multiple frames of scanned images into one frame of target image;

[0111] Among them, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter periods.

[0112] In one embodiment, when the user uses the imaging device to take a photo, only one image acquisition process may be performed, and then one frame of target image can be obtained, which is the photo taken by the user.

[0113] In one embodiment, when the user uses the imaging device to collect a video, multiple image acquisition processes may be performed, and then multiple consecutive frames of images can be obtained to form a video.

[0114] The image acquisition device provided by the present invention will be described below. The image acquisition device described below can be correspondingly referred to the image acquisition method described above.

[0115] Figure 5 is a schematic structural diagram of the image acquisition device provided by the present invention. As Figure 5 shown, the image acquisition device 500 includes: a scanning module 510 and a merging module 520; wherein:

[0116] The scanning module 510 is configured to perform scanning based on the scanning start time offset within a plurality of consecutive time periods to obtain multiple frames of scanned images;

[0117] The merging module 520 is configured to merge the multiple frames of scanned images into a target image;

[0118] Wherein, within the plurality of consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0119] The image acquisition device provided by the present invention performs scanning based on the scanning start time offset that differs by a preset number of shutter cycles, so that the bright and dark stripes of multiple frames of scanned images are misaligned and the bright stripe energies are the same. Furthermore, after merging the multiple frames of scanned images with misaligned bright and dark stripes, a stripe-free target image can be obtained, improving the quality of the acquired images.

[0120] It should be noted that the image acquisition device provided by the present invention can implement the embodiments corresponding to all the above image acquisition methods and produce the same technical effects, which will not be elaborated here.

[0121] Figure 6 illustrates a schematic structural diagram of an electronic device. As Figure 6 shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630, and a communication bus 640. Among them, the processor 610, the communication interface 620, and the memory 630 complete mutual communication through the communication bus 640. The processor 610 can call the logical instructions in the memory 630 to execute the image acquisition method, which includes: performing scanning based on the scanning start time offset within a plurality of consecutive time periods to obtain multiple frames of scanned images;

[0122] merging the multiple frames of scanned images into a target image;

[0123] Wherein, within the plurality of consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0124] In addition, when the logical instructions in the above-mentioned memory 630 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0125] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the image acquisition method provided by the above-mentioned various methods. The method includes: performing scanning based on the scanning start time offsets within a plurality of consecutive time periods to obtain multiple frames of scanned images;

[0126] merging the multiple frames of scanned images into one frame of target image;

[0127] wherein, within the plurality of consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0128] In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is configured to execute the image acquisition method provided by the above-mentioned various methods. The method includes: performing scanning based on the scanning start time offsets within a plurality of consecutive time periods to obtain multiple frames of scanned images;

[0129] merging the multiple frames of scanned images into one frame of target image;

[0130] wherein, within the plurality of consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

[0131] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative work.

[0132] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or equivalently replace some of the technical features. And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An image acquisition method, characterized in that, The method includes: Performing scanning based on the scanning start time offsets within multiple consecutive time periods to obtain multiple frames of scanned images; Merging the multiple frames of scanned images into one frame of target image; Wherein, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

2. The image acquisition method according to claim 1, wherein The determining step of the scanning start time offsets within the multiple consecutive time periods includes: Determining the scanning start time offset corresponding to the first frame of scanned image among the multiple frames of scanned images based on the generation moment of the maximum energy value or the minimum energy value; Determining the scanning start time offsets within the multiple consecutive time periods based on the scanning start time offset corresponding to the first frame of scanned image and the preset number of shutter cycles; Wherein, the maximum energy value or the minimum energy value is: the maximum value or the minimum value of the energy values generated during the scanning process of any one frame of scanned image.

3. The image acquisition method according to claim 2, wherein The determining step of the generation moment of the maximum energy value or the minimum energy value includes: Determining the scanning start moment of the reference frame image, where the reference frame image is obtained by scanning before the multiple frames of scanned images; Delaying the scanning start moment by a first offset to obtain the generation moment of the maximum energy value or the minimum energy value; Wherein, the first offset is calculated based on the difference between the scanning start moment and the reference moment; the reference moment is: the generation moment of the maximum value or the minimum value of the energy values generated during the scanning process of the reference frame image.

4. The image acquisition method according to claim 3, wherein The determining the scanning start moment of the reference frame image includes: Obtaining the scanning start moment based on a first expression regarding the scanning start moment and a second expression regarding the scanning start moment; Wherein, the first expression is used to represent: the total energy within an energy cycle corresponding to the energy value generated during the scanning process of the reference frame image; the second expression is used to represent: the energies respectively generated within a preset number of shutter cycles during the scanning process of the reference frame image.

5. The image acquisition method according to claim 4, wherein The obtaining the scanning start moment based on the first expression regarding the scanning start moment and the second expression regarding the scanning start moment includes: Obtaining the ratio of the energies respectively generated within the preset number of shutter cycles to the total energy based on the ratio of the brightnesses respectively corresponding to the preset number of shutter cycles to the total brightness of the reference frame scanned image; Obtaining the scanning start moment based on the ratio of the energies respectively generated within the preset number of shutter cycles to the total energy, the first expression, and the second expression.

6. An image acquisition method, characterized in that, The method includes: Performing at least one image acquisition process to obtain the target image output by the at least one image acquisition process; Wherein, the image acquisition process includes: Performing scanning based on the scanning start time offsets within multiple consecutive time periods to obtain multiple frames of scanned images; Merging the multiple frames of scanned images into one frame of target image; Wherein, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

7. An image acquisition device, characterized in that, The device includes: A scanning module, configured to perform scanning based on the scanning start time offsets within multiple consecutive time periods, so as to obtain multiple frames of scanned images; A merging module, configured to merge the multiple frames of scanned images into a target image; Wherein, within the multiple consecutive time periods, the scanning start time offsets between adjacent time periods differ by a preset number of shutter cycles.

8. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the image acquisition method according to any one of claims 1 to 6.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the image acquisition method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the image acquisition method according to any one of claims 1 to 6.

Images