Electronic image stabilization method, apparatus, and non-volatile machine-readable medium

Abstract

The present invention provides an electronic image stabilization method, device, and non-volatile machine-readable medium. The electronic image stabilization method includes: obtaining multiple video frames from the output of an image sensor, wherein each of the multiple video frames has a full field of view of the image sensor; obtaining motion information of the multiple video frames; dynamically estimating an EIS margin according to FOV changes of multiple cropped images respectively located in the multiple video frames; and performing stability correction on the multiple cropped images according to the motion information and the EIS margin to generate multiple stabilized images. The electronic image stabilization method, device, and non-volatile machine-readable medium of the present invention can achieve better EIS quality.

Description

[0001] [Cross-reference to related applications]

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 066,364 filed on August 17, 2020, the contents of which are incorporated herein by reference in their entirety. [Background technology]

[0004] Electronic image stabilization (EIS) is an image enhancement technique that uses electronic processing. In general, EIS can minimize blur and compensate for device shake, usually camera shake. For example, a video frame processed by EIS is divided into a cropped image (which has a desired field of view (FOV)) and an EIS margin outside the cropped image, where a stabilization correction is applied to the cropped image to derive a stabilized image, and the stabilization correction uses the EIS margin to compensate for camera motion. Specifically, the video frame loses some FOV to obtain a stabilized image, and the lost FOV is called the EIS margin. In various cases, a typical EIS design uses a fixed / predefined EIS margin (e.g., the EIS margin contains a fixed / predefined percentage of pixels in the horizontal direction and a fixed / predefined percentage of pixels in the vertical direction), regardless of FOV changes. Therefore, when the output video FOV is small in certain scenarios (eg, digital zoom scenarios), typical EIS designs degrade the EIS quality due to the use of a fixed / predefined EIS margin. [Summary of the invention]

[0005] The following summary is illustrative only and is not intended to be limiting in any way. That is, the following summary is provided to introduce the concepts, highlights, benefits, and advantages of the novel and non-obvious technologies described herein. Selected but not all implementations will be further described in the detailed description below. Therefore, the following summary is not intended to identify the essential features of the claimed subject matter, nor is it intended to be used to determine the scope of the claimed subject matter.

[0006] Some embodiments of the present disclosure provide an electronic image stabilization method, including: obtaining multiple video frames from the output of an image sensor, wherein each of the multiple video frames has a full field of view of the image sensor; acquiring motion information of the multiple video frames; dynamically estimating an EIS margin based on FOV changes of multiple cropped images respectively located in the multiple video frames; and performing stabilization correction on the multiple cropped images based on the motion information and the EIS margin to generate multiple stabilized images.

[0007] Another embodiment of the present invention provides an electronic image stabilization apparatus, comprising: a storage device for buffering a plurality of video frames derived from the output of an image sensor, wherein each of the plurality of video frames has a full field of view (FOV) of the image sensor; and a processing circuit for acquiring motion information of the plurality of video frames, dynamically estimating an EIS margin based on FOV changes of a plurality of cropped images within the plurality of video frames, and applying stabilization correction to the plurality of cropped images based on the motion information and the EIS margin to generate a plurality of stabilized images.

[0008] Another embodiment of the present invention provides a non-volatile machine-readable medium for storing program code, wherein when loaded and executed by a processing circuit, the program code instructs the processing circuit to perform the following steps: obtain multiple video frames from the output of an image sensor, wherein each of the multiple video frames has a full field of view of the image sensor; obtain motion information of the multiple video frames; dynamically estimate an EIS margin based on FOV changes of multiple cropped images respectively located within the multiple video frames; and perform stability correction on the multiple cropped images based on the motion information and the EIS margin to generate multiple stabilized images.

[0009] The electronic image stabilization method, apparatus and non-volatile machine-readable medium of the present invention can achieve better EIS quality.

Brief Description of the Drawings

[0010] The accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated into and constitute a part of the present disclosure. The accompanying drawings illustrate embodiments of the present disclosure and together with the description are used to explain the principles of the present disclosure. It is understood that the drawings are not necessarily drawn to scale, as some components may be shown out of proportion to the size in actual implementation in order to clearly illustrate the concepts of the present disclosure.

[0011] Figure 1 is a diagram illustrating an electronic image stabilization (EIS) apparatus according to an embodiment of the present invention.

[0012] Figure 2 is a flow chart illustrating an electronic image stabilization (EIS) method according to an embodiment of the present invention.

[0013] Figure 3 is a diagram illustrating dynamic EIS margin estimation based on FOV variation according to an embodiment of the present invention.

[0014] Figure 4 is a diagram illustrating a stabilized video sequence generated through stability correction based on motion information and an EIS margin according to an embodiment of the present invention.

[0015] Figure 5is a diagram illustrating another electronic image stabilization (EIS) apparatus according to an embodiment of the present invention. [Specific implementation method]

[0016] In the detailed description below, many specific details are set forth by way of example to provide a thorough understanding of the relevant teachings. Any changes, derivations, and / or extensions based on the teachings described herein are within the scope of protection of the present disclosure. In some cases, well-known methods, processes, components, and / or circuits related to one or more example implementations disclosed herein may be described at a relatively high level without detailed description to avoid unnecessary confusion of various aspects of the teachings of the present disclosure.

[0017] Figure 1 1 is a diagram illustrating an electronic image stabilization (EIS) device according to an embodiment of the present invention. The EIS device 100 may be part of an electronic device with a camera module, wherein the camera module may include an image sensor 101. For example, the EIS device 100 may be used in a mobile phone, a tablet computer, or a digital video recorder. The EIS device 100 may include a storage device 102 and a processing circuit 104. The storage device 102 may be implemented by one or more volatile memories, one or more non-volatile memories, or any component with storage capability. In the present embodiment, the input buffer BUF_1 and the output buffer BUF_2 are allocated in the storage device 102. The EIS device 100 is arranged to stabilize the video sequence VS. The video frames of the video sequence VS may be cached in the input buffer BUF_1. The processing circuit 104 may be a dedicated circuit designed to perform an EIS algorithm on the video frames buffered in the input buffer BUF_1 to generate a video sequence VS' including a stabilized image. The stabilized image of the video sequence VS' may be stored in the output buffer BUF_2. In the present embodiment, the processing circuit 104 adopts electronic image stabilization with dynamic margin. Further details of the proposed electronic image stabilization with dynamic margin are described below.

[0018] Please combine Figure 2 refer to Figure 1 . Figure 2 1 is a flow chart illustrating an electronic image stabilization (EIS) method according to an embodiment of the present invention. The EIS device 100 may adopt the EIS method. As long as the results are substantially the same, it is not necessary to follow Figure 2These steps are performed in the exact order shown. In step 202, the EIS device 100 obtains a video sequence VS of multiple video frames including output from the image sensor 101, and buffers the video frames in the input buffer BUF_1, where each video frame has the full field of view (FOV) of the image sensor 101. For example, each full FOV video frame fed into the EIS device 100 has the same resolution as the resolution of the image sensor 101. In other words, all full FOV video frames fed into the EIS device 100 have the same number of pixels. In some embodiments, the output of the image sensor 101 can be received by the EIS device 100 after certain processing in the image signal processor (ISP). However, this is not meant to be a limitation of the present invention.

[0019] In step 204, the processing circuit 104 obtains motion information INF_M of the video frames included in the video sequence VS. For example, the motion information INF_M includes motion data of each video frame, wherein the motion data of each video frame represents the camera motion that occurs when the video frame is captured by the image sensor 101. For example, the motion data of each video frame can be directly provided from a motion sensor such as a gyroscope sensor. For another example, the motion data of each video frame can be obtained by estimating a motion vector between a pair of images. In short, the present invention has no limitation on the manner of obtaining the motion information INF_M.

[0020] In step 206, the processing circuit 104 dynamically estimates the EIS margin based on the FOV changes of the multiple cropped images within the video frame. Each video frame is divided into a cropped image with a desired FOV and an EIS margin outside the cropped image, wherein the EIS margin is used for stabilization correction to compensate for camera movement. Contrary to the typical EIS design that uses a fixed / predefined EIS margin regardless of FOV changes (e.g., the EIS margin includes a fixed / predefined pixel percentage in the vertical direction and a fixed / predefined pixel percentage in the horizontal direction), the EIS design proposed by the present invention uses a dynamic EIS margin that is estimated from the FOV control.

[0021] Figure 3 is a diagram illustrating dynamic EIS margin estimation based on FOV change according to an embodiment of the present invention. The video sequence VS may include consecutive video frames 301, 302, 303. In this embodiment, the output video FOV is adjusted by a digital zoom ratio DZR selected by a user input. In other words, a change in the digital zoom ratio DZR causes a change in FOV. Based on the digital zoom ratio DZR, the EIS algorithm used by the processing circuit 504 determines the FOV and EIS margin of the cropped image. Figure 3As shown, when the digital zoom ratio DZR is set to 1x, a cropped image 311 can be selected from a full FOV video frame 301 having the same resolution as the image sensor 101 using a default FOV, and a default EIS margin 321 including a default percentage of pixels in the horizontal direction and a default percentage of pixels in the vertical direction can be estimated. For example, the default EIS margin 321 is defined by (x11+x12) pixels in the horizontal direction and (y11+y12) pixels in the vertical direction. The pixels included in the default EIS margin 321 can be used to compensate for camera motion, thereby allowing a region of the cropped image 311 to be moved horizontally and / or vertically by stabilization correction.

[0022] like Figure 3 As shown, when the digital zoom ratio DZR is set to 1.5x, a cropped image 312 can be selected from a full FOV video frame 302 having the same resolution as the resolution of the image sensor 101 (i.e., the full FOV video frames 301 and 302 have the same resolution without cropping) with a narrower FOV, and a dynamic EIS margin 322 containing a larger percentage of pixels in the horizontal direction and a larger percentage of pixels in the vertical direction can be estimated. For example, the dynamic EIS margin 322 is different from the default EIS margin 321 and is defined by (x21+x22) pixels in the horizontal direction and (y21+y22) pixels in the vertical direction, where (x21+x22)>(x11+x12) and (y21+y22)>(y11+y12). The pixels contained in the dynamic EIS margin 322 can be used to compensate for camera motion, thereby allowing the region of the cropped image 312 to be moved horizontally and / or vertically by stabilization correction.

[0023] like Figure 3 As shown, when the digital zoom ratio DZR is set to 2x, a narrower FOV can be used to select a cropped image 313 from a full FOV video frame 303 having the same resolution as the resolution of the image sensor 101 (i.e., the full FOV video frames 301, 302, 303 have the same resolution without cropping), and a dynamic EIS margin 323 containing a larger percentage of pixels in the horizontal direction and a larger percentage of pixels in the vertical direction can be estimated. For example, the dynamic EIS margin 323 is different from the default EIS margin 321 and the dynamic EIS margin 322, which is defined by (x31+x32) pixels in the horizontal direction and (y31+y32) pixels in the vertical direction, where (x31+x32)>(x21+x22) and (y31+y32)>(y21+y22). The pixels contained in the dynamic EIS margin 323 can be used to compensate for camera motion, thereby allowing the region of the cropped image 313 to be moved horizontally and / or vertically by stabilization correction.

[0024] When the output video FOV is reduced due to a digital zoom ratio greater than 1x, the digital zoom algorithm does not crop the full FOV video frame before the EIS algorithm estimates the EIS margin. In other words, when the output video FOV is reduced due to a digital zoom ratio greater than 1x, the EIS algorithm uses the full FOV video frame to estimate the EIS margin. In this way, the EIS algorithm used by the processing circuit 504 can implement dynamic EIS margin estimation to determine a larger EIS margin that can be used for subsequent stabilization correction, thereby achieving better EIS quality.

[0025] In step 208, the processing circuit 104 performs stabilization correction on the plurality of cropped images according to the motion information INF_M and the EIS margin, each cropped image being within one of the video frames of the video sequence VS, to generate a plurality of stabilized images. By integrating the dynamic margin, the source video sequence VS can be stabilized according to the camera motion information to generate a stabilized video sequence VS' with better EIS quality.

[0026] Please combine Figure 3 refer to Figure 4 . Figure 4 is a diagram illustrating a stabilized video sequence generated by stability correction based on motion information and EIS margin according to an embodiment of the present invention. Figure 4As shown, when the digital zoom ratio DZR is set to 1x, the EIS algorithm used by the processing circuit 104 performs a stabilization correction on the cropped image 311 according to the motion data of the video frame 301 and the EIS margin 321 estimated from the video frame 301, and generates a stabilized image 331 from the cropped image 311. Since the digital zoom ratio DZR is set to 1x, no resizing is applied to the cropped image 311, so that the stabilized image 331 is a part of the video frame 301 and is extracted from the video frame 301 by the EIS algorithm used by the processing circuit 104. When the digital zoom ratio DZR is set to 1.5x, the cropped image 312 is stabilized and corrected according to the motion data of the video frame 302 and the EIS margin 322 estimated from the video frame 302, and generates a stabilized image 332 from the cropped image 312. The FOV of the cropped image 312 is smaller than the FOV of the cropped image 311. Since the digital zoom ratio DZR is set to 1.5x, the EIS algorithm employed by the processing circuit 104 further resizes (enlarges) the cropped image 312 so that the resolution of the stabilized image 332 is the same as that of the stabilized image 331. When the digital zoom ratio DZR is set to 2x, the EIS algorithm employed by the processing circuit 104 applies a stabilization correction to the cropped image 313 based on the motion data of the video frame 303 and the EIS margin 323 estimated from the video frame 303, and generates a stabilized image 333 from the cropped image 313, wherein the FOV of the cropped image 313 is smaller than the FOV of the cropped image 312. Since the digital zoom ratio DZR is set to 2x, the EIS algorithm employed by the processing circuit 104 further resizes (enlarges) the cropped image 313 to set the stabilized image 333 having the same resolution as that of the stabilized image 331.

[0027] In the aforementioned embodiment, the proposed electronic image stabilization with dynamic margin is implemented using only hardware, i.e., the processing circuit 104 may be a dedicated hardware circuit. However, this is only for illustrative purposes and does not mean a limitation of the present invention. Alternatively, the proposed electronic image stabilization with dynamic margin may be implemented in a software-based manner.

[0028] Figure 5 is a diagram illustrating another electronic image stabilization (EIS) device according to an embodiment of the present invention. The EIS device 500 includes a storage device 502 and a processing circuit 504. In this embodiment, the processing circuit 504 can be implemented by a processor, a microcontroller unit, or any element with software execution capability. The storage device 502 is a machine-readable medium and can be implemented by one or more volatile memories, one or more non-volatile memories, or any element with storage capability. The main difference between the EIS devices 100 and 500 is that the processing circuit 504 of the EIS device 500 can implement specified functions through software execution. Figure 5As shown, the storage device 504 stores a program code PROG. In addition, the aforementioned input buffer BUF_1 and output buffer BUF_2 are also allocated in the storage device 502, but the present invention is not limited thereto. When the processing circuit 504 loads and executes the program code PROG, the program code PROG instructs the processing circuit 504 to perform the proposed electronic image stabilization with dynamic margin. For example, Figure 2 The steps of the proposed electronic image stabilization method are shown. Figure 2 The processing can be performed by the program code PROG running on the processing circuit 504. After reading the above paragraphs, those skilled in the art can easily understand the details of the EIS device 500, and for the sake of brevity, they will not be repeated here.

[0029] Some embodiments include electronic components, such as microprocessors, memory and storage that stores computer program instructions in machine-readable or computer-readable media (or alternatively referred to as computer-readable storage media, machine-readable media, or machine-readable storage media). Some examples of such computer-readable media include RAM, ROM, compact disk-read only (CD-ROM), compact disk-recordable (CD-R), compact disk-rewritable (CD-RW), read-only digital versatile disk (e.g., DVD-ROM, dual-layer DVD-ROM), various recordable / rewritable DVDs (e.g., DVD-RAM, DVD-RW, DVD+RW, etc.), flash memory (e.g., SD card, mini-SD card, micro-SD card, etc.), magnetic and / or solid-state hard drives, read-only and recordable CD-ROM, ultra-density CD-ROM, any other optical or magnetic medium, and floppy disk. The computer readable medium may store a computer program executable by at least one processing unit, and the computer program includes a set of instructions for performing various operations. Examples of computer programs or computer code include machine code such as generated by a compiler, and files including high-level code executed by a computer, electronic component, or microprocessor using an interpreter.

[0030] Although the above discussion refers primarily to microprocessors or multi-core processors that execute software, many of the above features and applications are performed by one or more integrated circuits, such as application specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs). In some embodiments, such integrated circuits execute instructions stored on the circuits themselves. In addition, some embodiments execute software stored in programmable logic devices (PLDs), ROM, or RAM devices.

[0031] As used in this specification and any claims of this application, the terms "computer," "server," "processor," and "memory" refer to electronic or other technical devices. These terms do not include individuals or groups of people. For the purpose of this description, the terms "display" or "displayed" refer to displaying on an electronic device. As used in this specification and any claims of this application, the terms "computer-readable medium," "computer-readable media," and "machine-readable medium" are entirely limited to tangible physical objects that store information in a form that can be read by a computer. These terms do not include any wireless signals, wired download signals, and any other temporary signals.

[0032] Although the present disclosure has been described with reference to many specific details, those skilled in the art will recognize that the present disclosure may be embodied in other specific forms without departing from the spirit of the present disclosure. In addition, the accompanying drawings of method flow charts conceptually illustrate the process. The specific operations of these processes may not be performed in the exact order shown and described. Specific operations may not be performed in a continuous series of operations, and different specific operations may be performed in different embodiments. In addition, the process may be implemented using several sub-processes, or as part of a larger macro process. Therefore, those skilled in the art will understand that the present disclosure is not limited to the foregoing illustrative details, but is defined by the appended claims.

[0033] The subject matter described herein sometimes shows different components contained in or connected to other different components. It should be understood that the architecture depicted in this way is only exemplary, and many other architectures that realize the same function can actually be implemented. In a conceptual sense, any arrangement of components that realize the same function is effectively "associated" so that the desired function is realized. Therefore, any two components that are combined to obtain a specific function in the text can be regarded as "associated" with each other to realize the desired function, regardless of the architecture or intermediate components. Similarly, any two components that are associated in this way can also be regarded as "operably connected" or "operably coupled" to each other to realize the desired function, and any two components that can be associated in this way can also be regarded as "operably coupled" to each other to realize the desired function. The specific examples of "operably coupled" include but are not limited to: components that can be physically connected and / or physically interact with each other, and / or components that can interact wirelessly and / or wirelessly interact, and / or components that can interact logically and / or logically interact.

[0034] Furthermore, with respect to the use of substantially any plural and / or singular terms herein, those having ordinary skill in the art can translate from the plural to the singular and / or from the singular to the plural as is appropriate to the context and / or application.

[0035] Those of ordinary skill in the art will understand that, in general, the terms used herein, particularly in the appended claims (e.g., the subject matter of the appended claims), are generally intended as "open" terms (e.g., the term "comprising" should be interpreted as "including but not limited to", the term "having" should be interpreted as "having at least", the term "comprising" should be interpreted as "including but not limited to", etc.). Those of ordinary skill in the art will also understand that if a specific number of an introduced claim recitation object is intended, such intent will be explicitly stated in the claim, and in the absence of such a statement, no such intent exists. For example, to aid understanding, the appended claims may include the use of the introductory phrases "at least one" and "one or more" to introduce claim recitation objects. However, the use of such phrases should not be interpreted as limiting any claim containing such introduced claim recitation with the indefinite article "a or an" to an invention containing only one such recitation, even if the same claim contains the introductory phrases "one or more" or "at least one" and an indefinite article such as "a" or "an" (e.g., "a" and / or "an" should generally be interpreted as meaning "at least one" or "one or more"); the same applies to the case where the claim recitation is introduced with a definite article. In addition, even if a specific number of introduced claim recitations is explicitly stated, a person of ordinary skill in the art will recognize that such a statement should generally be interpreted as meaning at least the stated number (e.g., a statement of "two recitations" without other modifiers generally means at least two recitations, or two or more recitations). Furthermore, where phrases similar to “at least one of A, B, and C, etc.” are used, generally such constructions are intended to have the meaning of the phrase as understood by those of ordinary skill in the art (e.g., “a system having at least one of A, B, and C” would include, but not be limited to, systems having A alone, B alone, C alone, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.). Where phrases similar to “at least one of A, B, or C, etc.” are used, generally such constructions are intended to have the meaning of the phrase as understood by those of ordinary skill in the art (e.g., “a system having at least one of A, B, or C” would include, but not be limited to, systems having A alone, B alone, C alone, A and B together, A and C together, B and C together, and / or A, B, and C together, etc.).Those skilled in the art will further understand that, whether in the specification, claims or drawings, almost any disjunctive word and / or phrase representing two or more interchangeable terms should be understood to include the possibility of one of the terms, any one of the terms, or both of the terms. For example, the phrase "A or B" should be understood to include the possibility of "A", "B", or "A and B".

[0036] Although different methods, devices, and systems have been used to describe and illustrate some exemplary techniques, it should be understood by those of ordinary skill in the art that various other modifications and equivalent substitutions may be made without departing from the claimed subject matter. In addition, many modifications may be made to adapt specific situations to the teachings of the claimed subject matter without departing from the central concept described herein. Therefore, it is intended that the claimed subject matter is not limited to the specific examples disclosed, and such claimed subject matter may also include all implementations and their equivalents that fall within the scope of the appended claims.

Claims

1. An electronic image stabilization method, comprising: obtaining a plurality of video frames from an output of an image sensor, wherein each of the plurality of video frames has a full field of view of the image sensor; Obtaining motion information of the multiple video frames; dynamically estimating a plurality of electronic image stabilization margins based on field of view changes of a plurality of cropped images respectively located within the plurality of video frames; as well as performing stabilization correction on the plurality of cropped images according to the motion information and the plurality of electronic image stabilization margins to generate a plurality of stabilized images, wherein one of the plurality of video frames includes one of the plurality of cropped images and one of the plurality of electronic image stabilization margins; in one of the plurality of video frames, one of the plurality of electronic image stabilization margins is located outside of one of the plurality of cropped images; and one of the plurality of electronic image stabilization margins is used for stabilization correction applied to one of the plurality of cropped images; and The plurality of cropped images include a plurality of cropped images with different fields of view, and the plurality of electronic image stabilization margins dynamically estimated according to field of view changes of the plurality of cropped images include a plurality of electronic image stabilization margins of different sizes set for the plurality of cropped images with different fields of view.

2. The electronic image stabilization method of claim 1 , wherein the multiple video frames include a first video frame and a second video frame, the multiple cropped images include a first cropped image within the first video frame and a second cropped image within the second video frame, a field of view of the second cropped image is different from a field of view of the first cropped image, and an electronic image stabilization margin within the first video frame is different from an electronic image stabilization margin within the second video frame.

3. The electronic image stabilization method according to claim 2, wherein: The field of view of the second cropped image is smaller than the field of view of the first cropped image, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

4. The electronic image stabilization method of claim 2, wherein the field of view of the second cropped image is set in response to a first digital zoom ratio, and the field of view of the first cropped image is set in response to a second digital zoom ratio, wherein the second digital zoom ratio is different from the first digital zoom ratio.

5. The electronic image stabilization method according to claim 4, wherein: The second digital zoom ratio is greater than the first digital zoom ratio, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

6. An electronic image stabilization device, comprising: a storage device for buffering a plurality of video frames derived from an output of an image sensor, wherein each of the plurality of video frames has a full field of view of the image sensor; as well as processing circuitry for acquiring motion information of the plurality of video frames, dynamically estimating a plurality of electronic image stabilization margins based on field of view changes of a plurality of cropped images within the plurality of video frames, and applying stabilization correction to the plurality of cropped images based on the motion information and the plurality of electronic image stabilization margins to generate a plurality of stabilized images, wherein one of the plurality of video frames includes one of the plurality of cropped images and one of the plurality of electronic image stabilization margins; in one of the plurality of video frames, one of the plurality of electronic image stabilization margins is located outside of one of the plurality of cropped images; and one of the plurality of electronic image stabilization margins is used for stabilization correction applied to one of the plurality of cropped images; and The multiple cropped images include multiple cropped images with different fields of view, and the multiple electronic image stabilization margins dynamically estimated according to field of view changes of the multiple cropped images include multiple electronic image stabilization margins of different sizes set for the multiple cropped images with different fields of view.

7. The electronic image stabilization device of claim 6, wherein the multiple video frames include a first video frame and a second video frame, the multiple cropped images include a first cropped image within the first video frame and a second cropped image within the second video frame, a field of view of the second cropped image is different from a field of view of the first cropped image, and an electronic image stabilization margin within the first video frame is different from an electronic image stabilization margin within the second video frame.

8. The electronic image stabilization device according to claim 7, wherein: The field of view of the second cropped image is smaller than the field of view of the first cropped image, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

9. The electronic image stabilization device according to claim 7, wherein: The processing circuitry sets the field of view of the second cropped image in response to a first digital zoom ratio and sets the field of view of the first cropped image in response to a second digital zoom ratio different than the first digital zoom ratio.

10. The electronic image stabilization device according to claim 9, wherein: The second digital zoom ratio is greater than the first digital zoom ratio, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

11. A non-volatile machine-readable medium for storing program code, wherein when loaded and executed by a processing circuit, the program code instructs the processing circuit to perform the following steps: obtaining a plurality of video frames from an output of an image sensor, wherein each of the plurality of video frames has a full field of view of the image sensor; Obtaining motion information of the multiple video frames; dynamically estimating a plurality of electronic image stabilization margins based on field of view changes of a plurality of cropped images respectively located within the plurality of video frames; and performing stabilization correction on the plurality of cropped images according to the motion information and the plurality of electronic image stabilization margins to generate a plurality of stabilized images, in, One of the plurality of video frames includes one of the plurality of cropped images and one of the plurality of electronic image stabilization margins; in one of the plurality of video frames, the one of the plurality of electronic image stabilization margins is located outside of the one of the plurality of cropped images; and the one of the plurality of electronic image stabilization margins is used for a stabilization correction applied to the one of the plurality of cropped images; and The multiple cropped images include multiple cropped images with different fields of view, and the multiple electronic image stabilization margins dynamically estimated according to field of view changes of the multiple cropped images include multiple electronic image stabilization margins of different sizes set for the multiple cropped images with different fields of view.

12. The non-volatile machine-readable medium of claim 11 , wherein the plurality of video frames comprises a first video frame and a second video frame, the plurality of cropped images comprises a first cropped image within the first video frame and a second cropped image within the second video frame, a field of view of the second cropped image is different from a field of view of the first cropped image, and an electronic image stabilization margin within the first video frame is different from an electronic image stabilization margin within the second video frame.

13. The non-volatile machine-readable medium of claim 12, wherein: The field of view of the second cropped image is smaller than the field of view of the first cropped image, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

14. The non-volatile machine-readable medium of claim 12, wherein the field of view of the second cropped image is set in response to a first digital zoom ratio, and the field of view of the first cropped image is set in response to a second digital zoom ratio, wherein the second digital zoom ratio is different from the first digital zoom ratio.

15. The non-volatile machine-readable medium of claim 14, wherein: The second digital zoom ratio is greater than the first digital zoom ratio, and the electronic image stabilization margin within the first video frame is greater than the electronic image stabilization margin within the second video frame.

Images