Panning shot image processing method and electronic device using the same
Patent Information
- Application Number
- TW114139857
- Authority / Receiving Office
- TW · TW
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-10-15
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2045-10-14
Smart Images

Figure TWG2TB001920849_001 
Figure TWG2TB001920849_002 
Figure TWG2TB001920849_003
Abstract
Claims
1. A focus-tracking image processing method for an electronic device, the method comprising: An image sequence comprising N short-exposure images is captured using an image capturing device, where N is an integer greater than 1; optical flow estimation is performed on the N short-exposure images to obtain integrated optical flow data; the integrated optical flow data is analyzed to obtain focus tracking information; the integrated optical flow data and the focus tracking information are recorded as pre-stored data; based on the pre-stored data, subject object identification is performed on the target image in the N short-exposure images to obtain object position information of multiple candidate subject objects in the target image; a target subject object is selected from the multiple candidate subject objects according to a user instruction; And perform a motion blur processing on the target image based on the pre-stored data and the object position information of the target subject object to generate a focus-tracking image; select another target subject object from the plurality of candidate subject objects according to another user instruction; and perform the motion blur processing on the target image based on the pre-stored data and the object position information of the other target subject object to generate another focus-tracking image.
2. The image processing method for tracking focus as described in claim 1, wherein the step of recording the integrated optical flow data and the tracking focus processing information as the pre-stored data includes: The integrated optical flow data and the focus tracking information are recorded into the extended marker segment of the image file of one of the N short exposure images.
3. The focus-tracking image processing method as described in claim 1, wherein the step of selecting the target subject object from the plurality of candidate subject objects according to the user instruction includes: The multiple candidate subject objects are displayed using a user interface; Receive the user command via the user interface; And select the target subject object from the plurality of candidate subject objects according to the user instruction.
4. The image tracking processing method as described in claim 1, wherein the step of analyzing the integrated optical flow data to obtain the focus tracking processing information includes: By comparing the integrated optical flow data with a movement threshold, a plurality of first object frames corresponding to the plurality of candidate subject objects are obtained; And generate a preliminary object mask map associated with a plurality of candidate subject objects based on the plurality of first object frames, wherein the focus tracking processing information includes the preliminary object mask map.
5. The focus-tracking image processing method as described in claim 4, wherein the step of identifying the subject object in the target image among the N short-exposure images based on the pre-stored data to obtain object position information of the plurality of candidate subject objects in the target image includes: The target image is segmented using the preliminary object masking map to obtain multiple image blocks to be identified; And perform object identification on the plurality of image blocks to be identified, so as to obtain the second object frame and object mask of each of the plurality of candidate subject objects in the target image.
6. The focus-tracking image processing method as described in claim 5, wherein the object identification is performed based on an image segmentation model.
7. The focus-tracking image processing method as described in claim 1, wherein the step of obtaining the integrated optical flow data by performing optical flow estimation on the N short-exposure images includes: Optical flow estimation is performed to obtain optical flow data between the i-th short exposure image and the (i+1)-th short exposure image in the N short exposure images, where i is an integer greater than or equal to 1 and less than N; and a statistical operation is performed on the optical flow data between the i-th short exposure image and the (i+1)-th short exposure image to generate integrated optical flow data.
8. The focus-tracking image processing method as described in claim 1, wherein the step of performing motion blur processing on the target image based on the pre-stored data and the object position information of the target subject to generate the focus-tracking image includes: Based on the integrated optical flow data and the object position information of the target object, the blur direction and blur intensity of each pixel position are determined; And based on the blur direction and blur intensity of each pixel position, the motion blur processing is performed on the target image to generate the focus-tracking image.
9. The focus-tracking image processing method as described in claim 1 further includes: After the focus-tracking image is generated, the pre-stored data is updated to include the object position information of the multiple candidate subject objects.
10. An electronic device comprising: An image capturing device; The system also includes a processor coupled to the image capturing device and configured to: capture an image sequence comprising N short-exposure images using the image capturing device, where N is an integer greater than 1; obtain integrated optical flow data by performing optical flow estimation on the N short-exposure images; analyze the integrated optical flow data to obtain focus tracking information; record the integrated optical flow data and the focus tracking information as pre-stored data; perform subject object identification on a target image in the N short-exposure images based on the pre-stored data to obtain object position information of multiple candidate subject objects in the target image; respond to receiving a user instruction and select a target subject object from the multiple candidate subject objects according to the user instruction; perform motion blur processing on the target image based on the pre-stored data and the object position information of the target subject object to generate a focus-tracked image; And select another target subject object from the plurality of candidate subject objects according to another user instruction; and perform the motion blur processing on the target image according to the pre-stored data and the object position information of the other target subject object to generate another focus-tracking image.
Citation Information
Patent Citations
Control device, imaging device, lens device, control method, and program
JP2024013792A
Electronic device and panning shot image generation method thereof
TWI901384B
Scene motion correction in fused image systems
US10277820B2
