Image correction method, device and electronic equipment

Abstract

The present application discloses an image correction method, device and electronic device, which belongs to the field of image processing and can solve the problem of image anomalies (such as partial exposure, slope graphics, shaking, etc.) in the collected image when shooting with Rolling shutter. The method includes: during the movement of the target shooting object, obtaining the first image and the second image collected by the camera for the target shooting object, the first image is collected by the global shutter method, and the second image is collected by the rolling shutter method; matching the first image and the second image to determine the target correction parameters corresponding to the second image; according to the target correction parameters, image correction is performed on the image dislocation generated by the image corresponding to the target shooting object in the second image to obtain the target image. The present application is applied to shooting scenes.

Description

Technical Field

[0001] The present application belongs to the field of image processing, and specifically relates to an image correction method, device and electronic equipment. Background Art

[0002] At present, the electronic shutter of the camera is mainly divided into two types: rolling shutter and global shutter. Among them, global shutter is mainly used in some low exposure, low resolution or frame rate occasions, while rolling shutter can obtain higher frame rate, higher resolution and support higher exposure time occasions.

[0003] In the related art, for the rolling shutter, at the beginning of exposure, the image will be scanned line by line for exposure, and the start time of each line of exposure will have a certain interval, but the same exposure time is maintained.

[0004] Thus, when the subject is in motion, different parts of the subject are exposed at different times, resulting in image anomalies (such as partial exposure, slope patterns, shaking, etc.) in the captured image. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an image correction method, device and electronic device, which can solve the problem of image anomalies (such as partial exposure, slope graphics, shaking, etc.) in the collected images when shooting with rolling shutter.

[0006] In order to solve the above technical problems, this application is implemented as follows:

[0007] In a first aspect, an embodiment of the present application provides an image correction method, the method comprising: during the movement of a target photographing object, obtaining a first image and a second image captured by a camera for the target photographing object, the first image being captured by a global shutter method, and the second image being captured by a rolling shutter method; matching the first image and the second image to determine a target correction parameter corresponding to the second image; and performing image correction on the image misalignment generated by the image corresponding to the target photographing object in the second image according to the target correction parameter to obtain a target image.

[0008] In a second aspect, an embodiment of the present application provides an image correction device, which includes: an acquisition module, used to acquire a first image and a second image captured by a camera for the target object during its movement, wherein the first image is captured using a global shutter method, and the second image is captured using a rolling shutter method; a determination module, used to match the first image and the second image acquired by the acquisition module, and determine a target correction parameter corresponding to the second image; and a correction module, used to perform image correction on the image misalignment generated by the image corresponding to the target object in the second image according to the target correction parameter determined by the determination module, so as to obtain the target image.

[0009] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

[0010] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0011] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0012] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a non-volatile storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0013] In an embodiment of the present application, a first image captured by using a global shutter is matched with a second image captured by using a rolling shutter to determine a target correction parameter of the second image. Then, based on the target correction parameter, image correction is performed on the misaligned image in the second image captured by the rolling shutter. This allows the final corrected target image to have the advantages of both rolling shutter and global shutter. This improves the image anomalies caused by the rolling shutter (such as partial exposure, slope graphics, shaking, etc.) while ensuring that the rolling shutter can support scenes with higher resolutions and higher frame rates. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1It is a schematic diagram of image anomaly comparison between a global shutter and a rolling shutter provided in an embodiment of the present application;

[0015] Figure 2 It is a method flow diagram of an image correction method provided by an embodiment of the present application;

[0016] Figure 3 It is one of the image correction schematic diagrams corresponding to an image correction method provided in an embodiment of the present application;

[0017] Figure 4 This is the second image correction schematic diagram corresponding to an image correction method provided in an embodiment of the present application;

[0018] Figure 5 This is one of the structural schematic diagrams of an image correction device provided in an embodiment of the present application;

[0019] Figure 6 This is a second structural schematic diagram of an image correction device provided in an embodiment of the present application;

[0020] Figure 7 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0021] Figure 8 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. In addition, the "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.

[0024] The technical terms mentioned in the embodiments of the present application are explained below:

[0025] 1) Global shutter

[0026] Global shutter, the entire image is exposed at the same time, and the exposure ends at the same time. Generally, Global shutter is mainly used in some low-exposure scenes, low-resolution or low-frame-rate scenes.

[0027] Due to the different exposure methods of Global shutter and Rolling shutter, each page has different disadvantages: For Global shutter, such as Figure 1 As shown in (a), 1) when the subject is moving, if the exposure time of the global shutter is long, it is easy to cause the shooting result (such as image or video) to be blurred. Figure 1 The upper image in (a) is a normal image, and the lower image is a blurred image; 2) Since the global shutter starts and ends exposure at the same time, the concurrent output bandwidth is large, and most current cameras cannot support higher resolutions and higher frame rates.

[0028] 2) Rolling shutter

[0029] Rolling shutter: The image is exposed by scanning line by line. The exposure start time of each line will be spaced at the same time, but the same exposure time is maintained; therefore, the exposure end time is also spaced at a certain interval between each line. Generally, Rolling shutter is mainly used to obtain higher frame rate, higher resolution, and support higher exposure time.

[0030] Due to the different exposure methods of Global shutter and Rolling shutter, each page has different disadvantages: For Rolling shutter, such as Figure 1 As shown in (b), since the rolling shutter is exposed line by line, the exposure start time of each line is different. Therefore, when the subject is moving, different parts of the subject are exposed at different times, resulting in a slope pattern in the shooting result (also known as the "jelly effect"). Even when the camera is focusing or the camera is not stable, the shooting result will be shaken. Figure 1 The upper image in (b) is a normal image, and the lower image is an abnormal image with a slope pattern.

[0031] In the shooting method, device and electronic device provided in the embodiments of the present application, a better image effect is synthesized by combining a rolling shutter sensor and a global shutter sensor, so that the final image can have the advantages of both rolling shutter and global shutter. On the basis of ensuring that the rolling shutter can support a larger resolution and a higher frame rate, the image anomalies caused by the rolling shutter (such as partial exposure, slope graphics, shaking, etc.) can be improved.

[0032] The image correction method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0033] The present application embodiment provides an image correction method, such as Figure 2 As shown, the image correction method provided in the embodiment of the present application may include the following steps 201 to 203:

[0034] Step 201: While the target object is moving, a first image and a second image captured by a camera for the target object are obtained.

[0035] In the embodiment of the present application, the first image is acquired by adopting a global shutter (i.e., Global shutter) method, and the second image is acquired by adopting a rolling shutter (i.e., Rolling shutter) method.

[0036] Optionally, in an embodiment of the present application, the image correction device can set different shooting parameters for Rolling shutter and Global shutter devices according to the actual application environment.

[0037] In an example, the image correction device may set different exposure times for the Rolling shutter and the Global shutter, for example, setting a longer exposure time for the Rolling shutter and setting a lower exposure time for the Global shutter.

[0038] In another example, the image correction device can set different frame rates for Rolling shutter and Global shutter. For example, the frame rate set for Rolling shutter can ensure that the shooting effect of the target object can meet the requirements of the human eye. Some scenes are small and the integration time is large. A higher frame rate is set for Global shutter and a shorter integration time is set, so that the moving target object can be tracked while modifying the ghost caused by the movement of the target object.

[0039] Optionally, in an embodiment of the present application, the first image is an image captured by a global shutter method when the exposure time corresponding to the global shutter method is less than a second threshold value. Exemplarily, since the blurriness of the image of the dynamic object captured by the global shutter will be reduced after the global shutter reduces the integration time, the embodiment of the present application may use a low-resolution or low-frame-rate global shutter, which can reduce the bandwidth, and the viewing angle (fov) is also closer to the rolling shutter, and the integration time is shorter.

[0040] Step 202: Match the first image and the second image to determine the target correction parameters corresponding to the second image.

[0041] In the embodiment of the present application, the target correction parameters are used to correct the image misalignment generated by the image corresponding to the target photographed object in the second image. It can be understood that since there is no image misalignment in the image captured by using the global shutter, the image correction device uses the first image captured by using the global shutter as the reference image to restore the image misalignment existing in the image corresponding to the target photographed object in the second image captured by using the rolling shutter.

[0042] Optionally, in an embodiment of the present application, when matching the first image and the second image, the image correction device can directly perform feature point matching on the feature points of the target object in the first image and the feature points of the target object in the second image to determine the offset amount that each feature point needs to be offset.

[0043] Optionally, in an embodiment of the present application, when matching the first image and the second image, the image correction device may also divide the first image and the second image into multiple sub-areas respectively according to the same division rule (for example, horizontal division according to the scanning direction of the Rolling shutter), match the images corresponding to each sub-area respectively, and determine the offset amount that needs to be offset for the images corresponding to each sub-area.

[0044] Step 203: performing image correction on the image misalignment generated by the image corresponding to the target photographed object in the second image according to the target correction parameters to obtain a target image.

[0045] In the embodiment of the present application, the image correction device corrects the image misalignment existing in the image corresponding to the target photographed object in the second image according to the above-mentioned target correction parameters to obtain the target image.

[0046] Optionally, in an embodiment of the present application, the target correction parameter includes a first correction parameter of the area to be corrected in the second image; the first correction parameter includes the offset to be corresponding to each pixel point in the area to be corrected in the second image. The area to be corrected is the area where the target photographed object is located in the second image.

[0047] Further optionally, in the embodiment of the present application, the first correction parameter includes: the amount to be offset corresponding to each row of pixels in the image in the area to be corrected. It can be understood that the amount to be offset corresponding to the pixel is: the amount to be offset corresponding to the misalignment offset that has occurred in the pixel due to the rolling shutter.

[0048] Further optionally, in the embodiment of the present application, the above-mentioned area to be corrected includes N sub-areas, and image misalignment occurs between the N sub-images corresponding to the above-mentioned N sub-areas; and the above-mentioned first correction parameter includes: the amount to be offset corresponding to each sub-image in the above-mentioned N sub-images. It can be understood that the amount to be offset corresponding to the above-mentioned sub-image is: the amount to be offset corresponding to the misalignment offset that has occurred in the above-mentioned sub-image due to the rolling shutter.

[0049] Further optionally, in the embodiment of the present application, when the target correction parameter includes a first correction parameter of the area to be corrected in the second image, the step 203 may include the following step 203a:

[0050] Step 203a: performing image shift on the area to be corrected in the second image according to the first correction parameter to obtain a target image.

[0051] Exemplarily, when performing image correction on the second image, the image correction device can first perform image shift on the area to be corrected in the second image according to the above-mentioned first correction parameters, and then fill the blank area in the second image formed after the shift with pixels according to the first image to complete the correction of the entire second image.

[0052] For example, Figure 3 As shown, during the movement of object a, the image correction device uses Globalshutter to collect the image 1 of the object a (such as Figure 3As shown in (b) in FIG. 1 , a rolling shutter is used to collect the image 2 of the object a (as shown in FIG. 1 ). Figure 3 (c) in the figure), compared with the normal image (as shown in Figure 3 As shown in (a) in the figure, since the rolling shutter is exposed by scanning line by line, the image of object a in image 2 is misaligned, and the object a in image 1 has a virtual image. In order to restore the misaligned image in image 2, the image correction device matches image 1 with image 2 and determines the relative position of each feature point of object a in image 1 and image 2 (for example, Figure 3 Pixels 1 to 8 in image 1 correspond to pixels a to h in image 2, respectively. For example, pixel 1 in image 1 and pixel a in image 2 are the same feature point, and pixel 2 in image 1 and pixel b in image 2 are the same feature point). Then, based on the matching result, the misaligned image of object a in image 2 is corrected, and the image misalignment caused by the exposure interval in the original image 2 can be restored. The corrected image is as follows: Figure 3 As shown in image (d).

[0053] So, refer to Figure 3 As shown, the Global shutter can not only correct the image anomaly problem of the image corresponding to the Rolling shutter during high-speed movement, but also reduce the image blur problem caused by the long-term exposure of the Global shutter. In summary, the technical solution provided by the embodiment of the present application can not only improve the image anomaly caused by the rolling shutter, but also combine the image characteristics of the rolling shutter and the global shutter to further improve the image quality or be used as other post-image applications.

[0054] In the image correction method provided in the embodiment of the present application, a first image captured by using a global shutter is matched with a second image captured by using a rolling shutter to determine a target correction parameter of the second image. Then, based on the target correction parameter, image correction is performed on the misaligned image in the second image captured by the rolling shutter. This allows the final corrected target image to have the advantages of both rolling shutter and global shutter. This improves the image anomalies caused by rolling shutter (such as partial exposure, slope graphics, shaking, etc.) while ensuring that rolling shutter can support scenes with higher resolutions and higher frame rates.

[0055] Optionally, in the embodiment of the present application, after the above step 203, the image correction method provided in the embodiment of the present application may further include the following steps:

[0056] Step B1: When the exposure time corresponding to the rolling shutter mode is greater than a first threshold, edge detection is performed on the image to obtain image contour information of the target object in the first image.

[0057] Step B2: Correcting the image contour of the target object in the target image according to the image contour information of the target object.

[0058] For example, when the exposure time of the Rolling shutter is greater than the first threshold, the image corresponding to the Rolling shutter will produce more serious ghosting due to the long exposure time and the large integration time. At this time, after the image correction device corrects the image misalignment problem in the second image, it is also necessary to perform a secondary correction on the second image to enhance the contour of the target object in the second image.

[0059] For example, combining Figure 3 ,like Figure 4 As shown, during the movement of object a, the image correction device uses Global shutter to collect the image 1 of the object a (such as Figure 4 As shown in (b) in FIG. 1 , a rolling shutter is used to collect the image 2 of the object a (as shown in FIG. 1 ). Figure 4 (c) in the figure), compared with the normal image (as shown in Figure 4 As shown in (a) in the figure, due to the long integration time of the Rollingshutter, the image of object a in image 2 has a serious smear. In order to solve this problem, the image correction device restores the image misalignment caused by line-by-line scanning in image 2 through image matching. The restored image is shown in Figure 4 Then, based on image 1, the edge of object a in the restored image 2 is corrected to restore the smear problem caused by the long integration time. The restored image 2 is as follows: Figure 4 For example, feature points 1 to 1 to 5 in image 1 correspond to feature points 1' to 5' in the restored image 2.

[0060] It should be noted that the image correction method provided in the embodiment of the present application can be executed by an image correction device, or a control module in the image correction device for executing the image correction method. In the embodiment of the present application, the image correction method is executed by an image correction device as an example to illustrate the device of the image correction method provided in the embodiment of the present application. However, in actual applications, the execution subject of the above-mentioned image correction method can also be other equipment or devices that can execute the image correction method, and the embodiment of the present application does not limit this.

[0061] The present application embodiment provides an image correction device, such as Figure 5 As shown, the device includes: an acquisition module 401, a determination module 402 and a correction module 403, wherein: the acquisition module 401 is used to acquire the first image and the second image captured by the camera for the target shooting object during the movement of the target shooting object, the first image is captured by a global shutter method, and the second image is captured by a rolling shutter method; the determination module 402 is used to match the first image and the second image acquired by the acquisition module 401, and determine the target correction parameters corresponding to the second image; the correction module 403 is used to perform image correction on the image misalignment generated by the image corresponding to the target shooting object in the second image according to the target correction parameters determined by the determination module 402, so as to obtain the target image.

[0062] Optionally, the target correction parameter includes a first correction parameter of the area to be corrected in the second image; the first correction parameter includes the amount to be offset corresponding to each pixel point in the area to be corrected; the correction module 403 is specifically used to: perform image offset on the area to be corrected according to the first correction parameter to obtain a target image.

[0063] Optionally, the above-mentioned area to be corrected is the area where the above-mentioned target photographed object is located; the above-mentioned area to be corrected includes N sub-areas, and image misalignment occurs between the N sub-images corresponding to the above-mentioned N sub-areas; the above-mentioned first correction parameter includes: the amount to be offset corresponding to each sub-image in the above-mentioned N sub-images.

[0064] Alternatively, if Figure 6 As shown, the device also includes: a detection module 404, wherein: the detection module 404 is used to perform edge detection on the first image acquired by the acquisition module 401 when the exposure time corresponding to the above-mentioned rolling shutter mode is greater than the first threshold value, so as to obtain the image contour information of the above-mentioned target photographed object; the above-mentioned correction module 403 is also used to correct the image contour of the upper target photographed object in the above-mentioned target image according to the above-mentioned image contour information detected by the detection module 404.

[0065] Optionally, the first image is an image captured by using the global shutter method when an exposure time corresponding to the global shutter method is less than a second threshold.

[0066] The image correction device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device can be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0067] The image correction device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0068] The image correction device provided in the embodiment of the present application can implement each process implemented by the image correction device in the method embodiments of Figures N to N+x, and will not be described again here to avoid repetition.

[0069] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0070] In the image correction device provided in the embodiment of the present application, a first image captured by using a global shutter is matched with a second image captured by using a rolling shutter to determine a target correction parameter of the second image. Then, based on the target correction parameter, image correction is performed on the misaligned image in the second image captured by the rolling shutter, so that the final corrected target image has the advantages of both rolling shutter and global shutter, thereby improving the image anomalies caused by rolling shutter (such as partial exposure, slope graphics, shaking, etc.) on the basis of ensuring that rolling shutter can support scenes with higher resolution and higher frame rate.

[0071] Optional, such as Figure 7 As shown, an embodiment of the present application also provides an electronic device, including a processor 501, a memory 502, and a program or instruction stored in the memory 502 and executable on the processor 501. When the program or instruction is executed by the processor 501, each process of the above-mentioned image correction method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0072] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0073] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0074] The electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110 and other components.

[0075] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0076] Among them, the processor 110 is used to obtain the first image and the second image captured by the camera for the target object during the movement of the target object, the first image is captured by using a global shutter method, and the second image is captured by using a rolling shutter method; the processor 110 is also used to match the first image and the second image to determine the target correction parameters corresponding to the second image; the processor 110 is also used to perform image correction on the image misalignment generated by the image corresponding to the target object in the second image according to the target correction parameters to obtain the target image.

[0077] Optionally, the target correction parameter includes a first correction parameter of the area to be corrected in the second image; the first correction parameter includes the amount to be offset corresponding to each pixel point in the area to be corrected; the processor 110 is specifically used to: perform image offset on the area to be corrected according to the first correction parameter to obtain a target image.

[0078] Optionally, the above-mentioned area to be corrected is the area where the above-mentioned target photographed object is located; the above-mentioned area to be corrected includes N sub-areas, and image misalignment occurs between the N sub-images corresponding to the above-mentioned N sub-areas; the above-mentioned first correction parameter includes: the amount to be offset corresponding to each sub-image in the above-mentioned N sub-images.

[0079] Optionally, the processor 110 is further used to perform edge detection on the first image to obtain image contour information of the target object when the exposure time corresponding to the rolling shutter mode is greater than a first threshold; the processor 110 is further used to correct the image contour of the target object in the target image according to the image contour information.

[0080] Optionally, the first image is an image captured by the global shutter when an exposure time corresponding to the global shutter is less than a second threshold.

[0081] In the electronic device provided in the embodiment of the present application, a first image captured by using a global shutter is matched with a second image captured by using a rolling shutter to determine a target correction parameter of the second image, and then, based on the target correction parameter, image correction is performed on the misaligned image in the second image captured by the rolling shutter, so that the final corrected target image has the advantages of both rolling shutter and global shutter, thereby improving the image anomalies caused by rolling shutter (such as partial exposure, slope graphics, shaking, etc.) on the basis of ensuring that rolling shutter can support scenes with higher resolution and higher frame rate.

[0082] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0083] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. Among them, the above-mentioned graphics processor 1041 also includes related devices of a rolling shutter and a global shutter. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 109 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 110.

[0084] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the method embodiment of the above-mentioned image correction method is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0085] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0086] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the method embodiment of the above-mentioned image correction method, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0087] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0088] The embodiment of the present application further provides a computer program product, which is stored in a non-volatile storage medium and is executed by at least one processor to implement the various processes of the method embodiment of the above-mentioned image correction method.

[0089] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0090] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0091] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image correction method, characterized in that: The method comprises: During the movement of the target photographed object, a first image and a second image captured by a camera for the target photographed object are acquired, wherein the first image is acquired by adopting a global shutter method, and the second image is acquired by adopting a rolling shutter method; feature point matching is performed on the first image and the second image, and relative positions of the same feature point in the to-be-corrected area of ​​the second image and the first image are determined, respectively, so as to acquire a first correction parameter of the to-be-corrected area in the second image according to the relative position, wherein the first correction parameter includes a to-be-offset amount corresponding to each pixel point in the to-be-corrected area; According to the first correction parameter, performing image shift on the area to be corrected to obtain a target image; When the exposure time corresponding to the rolling shutter mode is greater than a first threshold, edge detection is performed on the first image to obtain image contour information of the target object; The image contour of the target photographed object in the target image is corrected according to the image contour information.

2. The method according to claim 1, characterized in that The area to be corrected is the area where the target photographed object is located; the area to be corrected includes N sub-areas, and image misalignment occurs between N sub-images corresponding to the N sub-areas; the first correction parameter includes: the amount to be offset corresponding to each sub-image in the N sub-images.

3. The method according to claim 1, characterized in that The first image is an image acquired by using the global shutter method when the exposure time corresponding to the global shutter method is less than a second threshold.

4. An image correction device, characterized in that: The device comprises: An acquisition module, used to acquire a first image and a second image captured by a camera for the target object during its movement, wherein the first image is captured by a global shutter method and the second image is captured by a rolling shutter method; a determination module, configured to match feature points of the first image and the second image acquired by the acquisition module, determine relative positions of the same feature point in the area to be corrected of the second image and the first image, respectively, and determine first correction parameters of the area to be corrected in the second image according to the relative positions, wherein the first correction parameters include an amount to be offset corresponding to each pixel point in the area to be corrected; A correction module, configured to perform image shift on the area to be corrected according to the first correction parameter determined by the determination module to obtain a target image; a detection module, configured to perform edge detection on the first image acquired by the acquisition module to obtain image contour information of the target object when the exposure time corresponding to the rolling shutter mode is greater than a first threshold; The correction module is further configured to correct the image contour of the target object in the target image according to the image contour information detected by the detection module.

5. The device according to claim 4, characterized in that The area to be corrected is the area where the target photographed object is located; the area to be corrected includes N sub-areas, and image misalignment occurs between N sub-images corresponding to the N sub-areas; the first correction parameter includes: the amount to be offset corresponding to each sub-image in the N sub-images.

6. The device according to claim 4, characterized in that The first image is an image acquired by using the global shutter method when the exposure time corresponding to the global shutter method is less than a second threshold.

7. An electronic device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the image correction method according to any one of claims 1 to 3.

8. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the image correction method according to any one of claims 1 to 3 are implemented.

Images