Shooting method, electronic equipment and storage medium

Abstract

The invention relates to the technical field of shooting, and provides a shooting method, electronic equipment and a storage medium. According to the method provided by the embodiment of the invention, the electronic equipment can collect a plurality of images by adopting a plurality of exposure durations, and then selects one image from a plurality of first images with a first exposure duration in the plurality of images as a third image with a first shooting effect; and obtaining a fourth image with a second shooting effect based on a plurality of second images with a second exposure duration in the plurality of images. Therefore, the electronic equipment can obtain various images with different shooting effects by shooting once.

Description

Technical Field

[0001] This application relates to the field of photography technology, and more particularly to a photography method, electronic device, and storage medium. Background Technology

[0002] For the same shooting scene, users can use electronic devices with shooting functions (such as mobile phones, cameras, tablets, etc.) to take pictures using different shooting methods such as dynamic capture, slow shutter recording, and panning, and obtain images with different shooting effects.

[0003] For example, when shooting a moving scene, using a dynamic capture shooting method with a high shutter speed (e.g., a shutter speed of 1 / 2000s) can produce a relatively clear image of the moving target, while using a slow shutter recording shooting method with a low shutter speed (e.g., a shutter speed of 1 / 20s) can produce an image of the moving target with a light trailing effect.

[0004] However, the shooting parameters (such as shutter speed) corresponding to different shooting methods are independent of each other. In the current technology, electronic devices can only use one shooting method at a time to obtain one type of image effect, which cannot meet the need to obtain multiple image effects in one shot. Summary of the Invention

[0005] Some embodiments of this application provide a shooting method, an electronic device, and a storage medium. The following describes this application from multiple aspects, and the embodiments and beneficial effects of the following aspects can be referred to each other.

[0006] In a first aspect, this application provides a shooting method for an electronic device, the method comprising: detecting a shooting command to shoot via a first shooting mode; acquiring multiple images with multiple exposure durations, the multiple images including a first image with a first exposure duration and a second image with a second exposure duration, wherein the first exposure duration is less than the second exposure duration; obtaining a third image with a first shooting effect based on the first image, and obtaining a fourth image with a second shooting effect based on the second image.

[0007] The first shooting mode can be the multi-effect shooting mode mentioned in this application.

[0008] When an electronic device detects a command to take a picture in multi-shot mode and takes a picture, it can capture multiple images with various exposure times. Since images captured at different exposure times produce different effects, the electronic device can obtain images with different effects based on the images captured at different exposure times. In this way, the electronic device can obtain images with multiple effects in a single shot, instead of only one effect. This satisfies the user's need to obtain multiple images with different effects from a single shot.

[0009] In some implementations, multiple images are acquired using various exposure durations, including: acquiring multiple images alternately using a first exposure duration and a second exposure duration.

[0010] For example, when an electronic device acquires multiple images using a first exposure time and a second exposure time, it alternates between the first and second exposure times. Furthermore, it acquires only one image each time it acquires an image using the first and second exposure times; or, it acquires two images each time it acquires an image using the first exposure time and one image each time it acquires an image using the second exposure time; or, it acquires one image each time it acquires an image using the first exposure time and two images each time it acquires an image using the second exposure time; or, it acquires two images each time it acquires an image using both the first and second exposure times.

[0011] In some implementations, multiple images are acquired alternately by a first exposure duration and a second exposure duration, including: acquiring multiple images in multiple consecutive time periods, wherein at least one image is acquired in each time period by either a first exposure duration or a second exposure duration, and the exposure duration used in adjacent time periods is different.

[0012] In some implementations, the first shooting effect is a dynamic capture shooting effect, and the second shooting effect is a slow shutter recording shooting effect; and obtaining a third image of the first shooting effect based on the first image and obtaining a fourth image of the second shooting effect based on the second image includes: selecting an image from the first image as the third image, and fusing the second image into the fourth image.

[0013] In situations where an electronic device alternately acquires a first image and a second image using short exposure times (e.g., 1 / 1000s) (as the first exposure time) and long exposure times (1 / 20s) (as the second exposure time), the electronic device can arbitrarily select one image from the first image as the third image. Alternatively, it can use image recognition algorithms such as edge detection-based algorithms, frequency domain analysis-based algorithms, or deep learning-based algorithms to identify a relatively clear image of a dynamic target (such as a moving person) from the first image as the third image. Furthermore, the electronic device can perform frame interpolation, alignment, and fusion processing on the second image to obtain a fourth image; it can also perform frame interpolation and fusion processing on the second image to obtain a fourth image; it can perform alignment and fusion processing on the second image to obtain a fourth image; or it can perform fusion processing only on the second image to obtain a fourth image.

[0014] In some implementations, the first shooting effect is the shooting effect of dynamic capture using the first parameter, the second shooting effect is the shooting effect of dynamic capture using the second parameter; and obtaining a third image of the first shooting effect based on the first image and obtaining a fourth image of the second shooting effect based on the second image includes: selecting an image from the first image as the third image, and selecting an image from the second image as the fourth image.

[0015] The first and second parameters can be shutter speeds, and the first and second parameters are not equal.

[0016] For example, the first parameter is a shutter speed of 1 / 2000s, and the second parameter is a shutter speed of 1 / 1000s. That is, the electronic device alternately captures a first image with an exposure time of 1 / 2000s and a second image with an exposure time of 1 / 1000s using shutter speeds of 1 / 2000s and 1 / 1000s respectively. Then, the electronic device can select one image from the first image with an exposure time of 1 / 2000s as a third image representing a first shooting effect, and select one image from the second image with an exposure time of 1 / 1000s as a fourth image representing a second shooting effect.

[0017] In some implementations, the first shooting effect is the shooting effect of slow shutter recording using a third parameter, and the second shooting effect is the shooting effect of slow shutter recording using a fourth parameter; and obtaining a third image of the first shooting effect based on the first image and obtaining a fourth image of the second shooting effect based on the second image includes: fusing the first image into a third image and fusing the second image into a fourth image.

[0018] The third and fourth parameters can be shutter speeds, and the third and fourth parameters are not equal.

[0019] For example, the first parameter is a shutter speed of 1 / 30s, and the second parameter is a shutter speed of 1 / 20s. That is, the electronic device alternately captures a first image with an exposure time of 1 / 30s and a second image with an exposure time of 1 / 20s using shutter speeds of 1 / 30s and 1 / 30s respectively. Then, the electronic device can merge the first image with an exposure time of 1 / 30s into a third image representing a first shooting effect, and merge the second image with an exposure time of 1 / 20s into a fourth image representing a second shooting effect.

[0020] In some implementations, the first shooting mode is a shooting mode that captures an image with multiple shooting effects in a single shot, including a first shooting effect and a second shooting effect.

[0021] In some embodiments, the method further includes: displaying a third image and / or a fourth image; or, displaying a first thumbnail of the third image and / or a second thumbnail of the fourth image.

[0022] In some implementations, displaying a first thumbnail of the third image and / or a second thumbnail of the fourth image includes:

[0023] The first thumbnail is displayed in the first thumbnail display area on the shooting interface; or...

[0024] The second thumbnail is displayed in the first thumbnail display area on the shooting interface;

[0025] The first thumbnail is displayed in the third thumbnail display area on the shooting interface, and the second thumbnail is displayed in the fourth thumbnail display area on the shooting interface; or,

[0026] The first thumbnail is displayed in the first thumbnail display area on the shooting interface, and upon detecting a thumbnail switching command, the first thumbnail displayed in the first thumbnail display area is switched to the second thumbnail; or,

[0027] The second thumbnail is displayed in the first thumbnail display area on the shooting interface, and after detecting the thumbnail switching command, the second thumbnail displayed in the first thumbnail display area is switched to the first thumbnail.

[0028] Secondly, embodiments of this application provide an electronic device, including a memory for storing instructions executable by one or more processors of the electronic device; and a processor, which, when executing the instructions in the memory, causes the electronic device to perform the method described in any embodiment of the first aspect of this application. The beneficial effects achievable in the third aspect can be referred to the beneficial effects of the method provided in any embodiment of the first aspect, and will not be repeated here.

[0029] Thirdly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method described in any embodiment of the first aspect. The beneficial effects achievable in the fourth aspect can be found in the beneficial effects of the method provided in any embodiment of the first aspect, and will not be repeated here.

[0030] Fourthly, embodiments of this application provide a computer program product including computer program code. When the computer program code is run on a computer, it causes the computer to implement the method described in any embodiment of the first aspect. The beneficial effects achievable in this fourth aspect can be found in the beneficial effects of the method provided in any embodiment of the first aspect, and will not be repeated here. Attached Figure Description

[0031] Figure 1 Example diagrams illustrating dynamic capture methods provided in some embodiments;

[0032] Figure 2A Example diagrams illustrating slow shutter recording techniques provided in some embodiments;

[0033] Figure 2B A schematic diagram illustrating the principle of slow shutter recording for some embodiments;

[0034] Figure 2C A schematic diagram of a stacked simulation of slow shutter speed imaging provided for some embodiments;

[0035] Figure 3 Example diagrams illustrating panning shooting methods provided in some embodiments;

[0036] Figure 4 Example diagram of a multi-effect shooting method provided in the embodiments of this application;

[0037] Figure 5A Example of a method for entering the multi-effect mode provided in this application embodiment. Figure 1 ;

[0038] Figure 5B Figure 2 shows an example of the entry method for the multi-effect mode provided in this application embodiment;

[0039] Figure 5C Example of a method for entering the multi-effect mode provided in this application embodiment. Figure 3 ;

[0040] Figure 5D Example of a method for entering the multi-effect mode provided in this application embodiment. Figure 4 ;

[0041] Figure 6AExamples of short-exposure and long-exposure image acquisition methods provided in embodiments of this application Figure 1 ;

[0042] Figure 6B Figure 2 shows an example of the acquisition method for short-exposure and long-exposure images provided in the embodiments of this application;

[0043] Figure 6C Examples of short-exposure and long-exposure image acquisition methods provided in embodiments of this application Figure 3 ;

[0044] Figure 6D Examples of short-exposure and long-exposure image acquisition methods provided in embodiments of this application Figure 4 ;

[0045] Figure 7A Examples of display methods for images with different shooting effects taken by the mobile phone 100 using the multi-effect shooting mode in the embodiments of this application. Figure 1 :

[0046] Figure 7B Figure 2 is an example of how images with different shooting effects are captured by the mobile phone 100 using the multi-effect shooting mode provided in this application embodiment;

[0047] Figure 7C This is an example of how to demonstrate different shooting effects of images captured by the mobile phone 100 using the multi-effect shooting mode in the embodiments of this application. Figure 3 ;

[0048] Figure 7D Examples of display methods for images with different shooting effects taken by the mobile phone 100 using the multi-effect shooting mode in the embodiments of this application. Figure 4 ;

[0049] Figure 8A An example of a mobile phone 100 displaying an image captured in a multi-effect mode provided in this application embodiment. Figure 1 ;

[0050] Figure 8B Example Figure 2 shows an image captured in the multi-effect mode on a mobile phone 100 provided in this application embodiment;

[0051] Figure 8C Examples of images obtained by displaying images taken in multi-effect mode on a mobile phone 100 provided in this application embodiment. Figure 3 ;

[0052] Figure 9 A flowchart illustrating a shooting method provided in an embodiment of this application;

[0053] Figure 10AExamples of frame interpolation, alignment, and fusion processing of long-exposure images provided in this application embodiment Figure 1 ;

[0054] Figure 10B This is an example diagram illustrating the direct fusion processing of long-exposure images provided in this application embodiment;

[0055] Figure 10C Figure 2 is an example of frame interpolation, alignment, and fusion processing of long-exposure images provided in this application embodiment;

[0056] Figure 11 This is an example diagram illustrating the fusion processing of long-exposure images and inserted frame images provided in an embodiment of this application;

[0057] Figure 12 A schematic diagram illustrating a photographing method provided in an embodiment of this application;

[0058] Figure 13 An example diagram illustrating exposure compensation for short-exposure images during shooting in multi-effect mode, as provided in an embodiment of this application;

[0059] Figure 14 This is a structural example diagram of the mobile phone 100 provided in an embodiment of this application. Detailed Implementation

[0060] This application provides a shooting method. To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be described in detail below with reference to the accompanying drawings and specific implementation methods.

[0061] It should be noted that the shooting method provided in this application can be applied to any electronic device with shooting capabilities, including but not limited to mobile phones, tablets, cameras, computers, smartwatches, drones, and other electronic devices with shooting capabilities. The following uses a mobile phone as an example of an electronic device.

[0062] Terminology Explanation:

[0063] (1) Shutter speed

[0064] The shutter is a device that controls the duration (hereinafter referred to as exposure time) for light to enter the internal image sensor of an electronic device (such as a camera sensor, which includes, but is not limited to, charge-coupled devices (CCDs) and complementary metal-oxide-semiconductors (CMOS)). In this article, the duration from shutter opening to closing is referred to as shutter speed.

[0065] The faster the shutter speed, the shorter the exposure time of the image sensor, and the less image information the sensor records. The slower the shutter speed, the longer the exposure time of the image sensor, and the more image information the sensor records.

[0066] With different shutter speeds and exposure times, the image information recorded by the photosensitive elements of electronic devices varies. For the same dynamic scene, different shooting effects can be obtained when the electronic device shoots with different shutter speeds (e.g., both the background and the dynamic subject are clear, or the background is clear while the dynamic subject has a light trailing effect, or the dynamic subject is clear while the background has a light trailing effect, etc.).

[0067] To facilitate understanding, several different shooting methods will be introduced below, but this application is not limited to these.

[0068] (1) Dynamic capture (or "eagle eye snapshot")

[0069] Dynamic capture is a shooting method that uses a high-speed shutter to continuously capture dynamic targets (such as moving people, flowing water, drifting clouds, moving vehicles, trains, ships, and airplanes in flight), and selects the clearest image of the dynamic target from the multiple short-exposure images as the captured image.

[0070] For example, refer to Figure 1 After the camera application is launched, the phone 100 can display the shooting interface 10. When the phone 100 detects that the user clicks the function option "More" 11 on the shooting interface 10, the phone 100 displays the mode selection interface 20. When the phone 100 detects that the user clicks the dynamic capture icon 12 on the mode selection interface 20, the phone 100 returns to the shooting interface 10 and enters the dynamic capture mode. In the dynamic capture mode, when the phone 100 detects that the user clicks the shooting button 16 on the shooting interface 10, the phone 100 uses a high-speed shutter (e.g., a shutter speed of 1 / 1000s) (i.e., short exposure time) to continuously capture multiple images of scene A (hereinafter referred to as short exposure images). In scene A, the person moves along the x-direction shown in the figure. Then, the phone 100 can select one image from the multiple short exposure images, such as an image with a relatively clear person, as the capture image obtained by the phone 100 after capturing the person in scene A.

[0071] (2) Slow shutter recording

[0072] Slow shutter speed recording is a shooting method that uses a slow shutter speed to continuously capture multiple long-exposure images of a moving target, and then merges these multiple long-exposure images into a single image.

[0073] For example, refer to Figure 2A After the camera application on the mobile phone 100 enters the shooting interface 10, when the mobile phone 100 detects that the user clicks the function option "More" on the shooting interface 10, the mobile phone 100 displays the mode selection interface 20. When the mobile phone 100 detects that the user clicks the slow shutter recording icon 13 on the mode selection interface 20, the mobile phone 100 returns to the shooting interface 10 and enters the slow shutter recording mode. In the slow shutter recording mode, when the mobile phone 100 detects that the user clicks the shooting button 16 on the shooting interface 10, the mobile phone 100 uses a slow shutter speed (e.g., a shutter speed of 1 / 20s) (i.e., long exposure time) to continuously capture multiple images of scene A (hereinafter referred to as long exposure images). Then, the mobile phone 100 can merge these multiple long exposure images into one image to obtain a light trail image with a relatively clear background and a light trail effect on the subject.

[0074] Figure 2B The diagram illustrates the principle of slow shutter speed recording.

[0075] refer to Figure 2B Slow shutter speed photography involves capturing an image with an exposure time of T using a shutter speed of T. Slow shutter recording simulates slow shutter speed photography using image stacking (or "stacked slow shutter speed simulation"). For example, n images with an exposure time of ΔT (where ΔT = T / n) are captured, and then an image fusion algorithm is used to fuse these n images to obtain a single image used to simulate the slow shutter speed effect. In other words, the light originally captured in a single burst from 0 to T is divided into n time segments of length ΔT and captured separately. These n time segments of length ΔT are numbered sequentially as 0, 1, ..., n-1.

[0076] In some embodiments, a digital integration method can be used to simulate the light acquisition process during slow shutter shooting using the following formula.

[0077]

[0078] Where light is the brightness of the light collected per unit time, T is the duration of one light collection when using slow shutter speed (i.e., the total exposure time), n is the number of time segments of duration ΔT into which the total exposure time T is divided (i.e., the number of times light is collected in the simulated slow shutter speed shooting), ΔT is the duration of each of the n time segments into which the total exposure time T is divided (i.e., the duration of each light collection in the simulated slow shutter speed shooting), and i is the sequence number of the time segment.

[0079] In some embodiments, reference Figure 2CWhen an electronic device uses a stacked simulation method to capture images, there is a time interval v_blank between two adjacent images in the resulting n images. It can be understood that the smaller the time percentage of the time interval v_blank (v_blank / T), the better the simulated slow shutter effect, i.e., the better the slow shutter recording effect.

[0080] (3) Panning

[0081] Panning is a shooting technique that uses a slow shutter speed to continuously capture images of a moving target, moving the electronic device along with the target throughout the shooting process to keep the focus window always on the target. The resulting multiple long-exposure images are then merged into a single image. For example, in slow shutter recording mode, moving the electronic device to keep the focus window always on the moving target is essentially moving the electronic device while recording with a slow shutter speed.

[0082] For example, refer to Figure 3 When a user takes a picture of scene A using mobile phone 100 in slow shutter recording mode, after the user clicks the shooting button 16 on the shooting interface 10 of the camera application, the user can control mobile phone 100 to move along the x-direction in the image following the moving person in scene A, so that the focus window C0 of mobile phone 100 is always pointed at the person in scene A, ensuring that the person in the multiple long exposure images is relatively clear. After mobile phone 100 takes multiple long exposure images of scene A in succession, mobile phone 100 can perform fusion processing on the multiple long exposure images to obtain a panning image with a relatively clear moving person and a background with a light-flowing effect.

[0083] Panning is essentially moving the electronic device while recording with a slow shutter speed. Therefore, panning and slow shutter speed recording can use the same shooting parameters (such as shutter speed).

[0084] The following table 1 illustrates the differences between the three shooting modes offered by the mobile phone 100: dynamic capture, slow shutter recording, and panning.

[0085] Table 1

[0086]

[0087] As shown in Table 1 above, when the mobile phone 100 is in a static state and captures a moving target using the dynamic capture mode at a shutter speed of 1 / 1000s, a capture image Z1 with an exposure time of 1 / 1000s can be obtained. The moving target and static background in this image are relatively clear. When the mobile phone 100 is in a static state and captures a moving target using the dynamic capture mode at a shutter speed of 1 / 2000s, a capture image Z2 with an exposure time of 1 / 2000s can be obtained. Because the exposure time of capture image Z2 is shorter than that of capture image Z1, the moving target in capture image Z2 is clearer than that in image Z1 with an exposure time of 1 / 1000s.

[0088] When the phone 100 is in a static state and captures a moving target at a shutter speed of 1 / 30s using slow shutter recording mode, a slow shutter recording image Z3 with an exposure time of 1 / 30s can be obtained. In this image, the static background is relatively clear, and the moving target exhibits a light trailing effect. When the phone 100 is in a static state and captures a moving target at a shutter speed of 1 / 20s using slow shutter recording mode, a slow shutter recording image Z4 with an exposure time of 1 / 20s can be obtained. Because the exposure time of slow shutter recording image Z4 is longer than that of slow shutter recording image Z3, the light trailing effect of the moving target in slow shutter recording image Z4 is stronger than that in image Z3 with an exposure time of 1 / 30s.

[0089] When the phone 100 is moving and a moving target is photographed using a panning technique at a shutter speed of 1 / 30s, an image Z5 with an exposure time of 1 / 30s is obtained. In this image, the static background exhibits a light trailing effect, and the moving target is relatively clear. When the phone 100 is moving and a moving target is photographed using a panning technique at a shutter speed of 1 / 20s, an image Z6 with an exposure time of 1 / 20s is obtained. Because the exposure time of image Z6 is longer than that of image Z5, the light trailing effect of the static background in image Z6 is stronger than that of image Z5 with an exposure time of 1 / 30s.

[0090] It's understandable that the dynamic capture shooting method uses the dynamic capture mode of the phone 100. Slow shutter recording and panning shooting methods are both done using the slow shutter recording mode of the phone 100. Because the shooting parameters of the phone 100 (such as shutter speed) are independent, when a user uses the phone 100, they can only use one shooting mode and one shooting parameter to obtain one image effect. In other words, a user can only get one image effect from a single shot taken with the phone 100. However, in some cases, users may want to obtain multiple different image effects from a single shot taken with the phone 100.

[0091] For example, when a user uses a smartphone to capture the moment a soccer ball is shot, they might want to obtain images with various effects, such as a snapshot of the athlete shooting the ball or a trailing image of the ball as it slides across the goal. However, because the shot is very brief, if the user only uses one of the smartphone's shooting modes, they might miss the opportunity to use other modes, resulting in only one possible image and not multiple different effects. For instance, if the user uses the smartphone's dynamic capture mode, they can get a snapshot of the athlete shooting the ball. However, after using the dynamic capture mode, the ball may have already been shot. At this point, the user can no longer use other modes to capture the shot. Thus, the user will only get a snapshot of the athlete shooting the ball, and not other effects like a trailing image of the ball.

[0092] In view of this, this application provides a shooting method. In this method, the electronic device provides a new shooting mode—a multi-effect shooting mode (as the first shooting mode). This mode allows for obtaining images with multiple preset shooting effects in a single shot. Thus, a user can use the electronic device's multi-effect shooting mode to take a single shot (for example, after the electronic device enters multi-effect shooting mode, the user clicks the camera button once) to obtain images with multiple preset shooting effects. This satisfies the user's need to obtain multiple images with different shooting effects in a single shot using the electronic device.

[0093] In some embodiments, after an electronic device detects a user's instruction to capture an image using a multi-effect mode (such as user operation, gesture (such as air gesture), voice, etc.), it can continuously capture multiple images with various exposure durations and generate images with various preset shooting effects based on these multiple images.

[0094] Specifically, when the electronic device detects a shooting command to capture images in a multi-image mode, it can continuously acquire multiple images using various exposure durations. These multiple images include a first image with a first exposure duration and a second image with a second exposure duration, wherein the first exposure duration is shorter than the second exposure duration. Then, the electronic device obtains a first shooting effect based on the first image with the first exposure duration (e.g., as described above). Figure 1 The third image (showing the shooting effect) and the second image based on the second exposure time are used to generate a second shooting effect (such as the one described above). Figure 2A The fourth image (showing the flowing light effect).

[0095] For ease of description, the following text refers to exposure times less than or equal to the preset exposure time as short exposure times, and exposure times greater than the preset exposure time as long exposure times. The preset exposure time can be 1 / 40s, 1 / 45s, 1 / 50s, etc., without limitation. For example, short exposure times can be 1 / 35s, 1 / 25s, 1 / 20s, 1 / 10s, etc., and long exposure times can be 1 / 2000s, 1 / 1000s, 1 / 800s, 1 / 500s, etc.

[0096] In some embodiments, the first exposure time is a short exposure time, and the second exposure time is a long exposure time, for example, the first exposure time is 1 / 1000s and the second exposure time is 1 / 20s. Alternatively, both the first and second exposure times are short exposure times, and the first exposure time is shorter than the second exposure time, for example, the first exposure time is 1 / 1000s and the second exposure time is 1 / 500s. Or, both the first and second exposure times are long exposure times, and the first exposure time is shorter than the second exposure time, for example, the first exposure time is 1 / 25s and the second exposure time is 1 / 20s.

[0097] The following mainly uses the example of a short exposure time for the first exposure and a long exposure time for the second exposure to introduce the technical solution of this application, but this application is not limited to this.

[0098] In some embodiments, when the electronic device detects a shooting instruction to capture an image in a multi-shot mode, the electronic device may alternately use a short exposure duration (as the first exposure duration) and a long exposure duration (as the second exposure duration) to capture short exposure images and long exposure images. Then, it may select one image from the short exposure images as the third image of the first shooting effect, and perform frame interpolation, alignment and fusion processing on the long exposure image to obtain the fourth image of the second shooting effect.

[0099] It should be noted that the electronic device can arbitrarily select an image from the first image with the first exposure time as the third image, or it can use image recognition algorithms such as edge detection-based algorithms, frequency domain analysis-based algorithms, and deep learning-based algorithms to identify a relatively clear image of a dynamic target (such as a moving person) from the first image with the first exposure time as the third image.

[0100] For example, refer to Figure 4After the phone 100 launches the camera application and enters the multi-effect shooting mode, when the phone 100 detects that the user clicks the shooting button 16 on the shooting interface 10 (as an example of a shooting command) in the multi-effect shooting mode, the phone 100 can alternately shoot scene A using a high shutter speed (e.g., a shutter speed of 1 / 1000s) and a low shutter speed (e.g., a shutter speed of 1 / 20s). That is, it alternately shoots scene A using short exposure time (1 / 1000s) and long exposure time (1 / 20s), obtaining short exposure images P1 to P4 and long exposure images K1 to K4. Then, the phone 100 can select a short exposure image P3 with a relatively clear subject from the short exposure images P1 to P4 as the capture image (as an example of the third image). Furthermore, the phone 100 performs frame interpolation, alignment, and fusion processing on the long exposure images K1 to K4 to obtain a long exposure image M1 with a light trail effect as a light trail image (as an example of the fourth image).

[0101] The following describes the method for entering the multi-effect mode provided in the embodiments of this application.

[0102] In some embodiments, the mobile phone 100 detects an instruction to enter the multi-effect mode (such as user operation, voice and gesture (such as air gesture)) and enters the multi-effect mode.

[0103] For example, refer to Figure 5A When the phone 100 detects that the user clicks the camera application icon 18 on the desktop 30, it can launch the camera application and display the shooting interface 10. Then, when the phone 100 detects that the user clicks the function option "More" 11 on the shooting interface 10, the phone 100 can display the camera application's shooting mode selection interface 20. The shooting mode selection interface 20 includes a "One-Shot-Multiple-Effects" icon 14. When the phone 100 detects that the user clicks the "One-Shot-Multiple-Effects" icon 14 on the shooting mode selection interface 20, the phone 100 can return to the shooting interface 10 and enter the "One-Shot-Multiple-Effects" mode.

[0104] For example, refer to Figure 5B When the phone detects a voice prompt indicating to enter the multi-effect mode, such as "Open the camera and enter the multi-effect mode", the phone can display the message "Start the camera application and enter the multi-effect mode".

[0105] For example, refer to Figure 5CWhen the phone 100 detects that the user clicks the camera application icon 18 on the desktop 30, it can launch the camera application and display the shooting interface 10. Then, the phone 100 can perform scene recognition to detect whether there are moving targets in the current shooting scene. When the phone 100 detects a moving target, it can display a prompt message 51 to prompt the user "Moving target detected, do you want to enter the one-shot-multi-effects mode?" When the phone 100 detects that the user clicks the "Yes" option in the prompt message 51, the phone 100 enters the one-shot-multi-effects mode.

[0106] For example, see reference Figure 5D When the phone 100 detects that the user clicks the camera application icon 18 on the desktop 30, it can launch the camera application and display the shooting interface 10. Then, the phone 100 can perform scene recognition to detect whether there are dynamic targets in the current shooting scene. When the phone 100 detects a dynamic target, it directly enters the one-shot-multiple-effects mode and displays a prompt message 52 to inform the user that "Dynamic target detected, one-shot-multiple-effects mode has been entered".

[0107] It should be noted that, Figures 5A-5D This is merely an illustrative description of how the mobile phone 100 enters the one-shot-multiple-effects mode. In other embodiments, the mobile phone 100 may also enter the one-shot-multiple-effects mode in other ways, and there are no restrictions on this.

[0108] The image acquisition method provided in the embodiments of this application is described below.

[0109] In some embodiments, the mobile phone 100 can continuously capture multiple images alternately using various exposure durations. For example, the mobile phone 100 can continuously capture multiple images alternately using a first exposure duration and a second exposure duration, wherein the multiple images include multiple first images of the first exposure duration and multiple second images of the second exposure duration. Furthermore, at least two of the multiple images are non-adjacent first images of the first exposure duration, or at least two are non-adjacent second images of the second exposure duration.

[0110] Specifically, when the mobile phone 100 first captures an image, it first takes x images with a first exposure time, then takes y images with a second exposure time. When capturing images again, it still takes x images with the first exposure time, then takes y images with the second exposure time, and so on. Here, x and y are integers greater than or equal to 1, and x and y can be equal or unequal.

[0111] For example, refer to Figure 6A When the mobile phone 100 alternates between short exposure time and long exposure time to capture multiple images, it can alternate between capturing short exposure images and long exposure images.

[0112] For example, refer to Figure 6B When the mobile phone 100 alternates between short exposure time and long exposure time to capture multiple images, it captures two images each time it uses short exposure time to capture short exposure images, and captures one image each time it uses long exposure time to capture long exposure images.

[0113] For example, refer to Figure 6C When the mobile phone 100 alternates between short exposure time and long exposure time to capture multiple images, it captures one image each time it uses short exposure time to capture a short exposure image, and captures two images each time it uses long exposure time to capture a long exposure image.

[0114] For example, see reference Figure 6D When the mobile phone 100 alternates between short exposure time and long exposure time to capture multiple images, it captures two images each time it uses short exposure time to capture short exposure images, and it also captures two images each time it uses long exposure time to capture long exposure images.

[0115] It should be noted that the first and last images in the multiple images captured by the mobile phone 100 can be either long exposure images or short exposure images, without any limitation.

[0116] In some embodiments, after the mobile phone 100 captures images with multiple shooting effects through multiple exposure times in the multi-effect shooting mode, it can display thumbnails of one or more images of the multiple shooting effects in the thumbnail display area on the shooting interface 10 of the camera application.

[0117] It's understandable that a thumbnail is an image obtained by reducing the size of the original image by a certain ratio.

[0118] It is understood that the thumbnail display area is an area used to display thumbnails of the images recently captured by the mobile phone 100. This application does not limit the shape and size of the thumbnail display area. For example, the shape of the thumbnail display area can be a circle, ellipse, rectangle, parallelogram, trapezoid, or irregular shape, etc.

[0119] For example, refer to Figure 7A After the mobile phone 100 takes a picture of scene A in the multi-effect mode and obtains a short exposure image P3 and a long exposure image M1, the thumbnail of the short exposure image P3 is displayed in the thumbnail display area B01 on the shooting interface 10.

[0120] For example, refer to Figure 7B After the mobile phone 100 takes a picture of scene A in the multi-effect mode and obtains a short exposure image P3 and a long exposure image M1, the long exposure image M1 is displayed in the thumbnail display area B01 on the shooting interface 10.

[0121] For example, refer to Figure 7C After the mobile phone 100 captures a short-exposure image P3 and a long-exposure image M1 in scene A using the multi-effect shooting mode, a thumbnail of the short-exposure image P3 is displayed in the thumbnail display area B02 on the shooting interface 10, and a thumbnail of the long-exposure image M1 is displayed in the thumbnail display area B03. Alternatively, a thumbnail of the long-exposure image M1 can be displayed in the thumbnail display area B02 on the shooting interface 10, and a thumbnail of the short-exposure image P3 can be displayed in the thumbnail display area B03.

[0122] For example, see reference Figure 7D After the mobile phone 100 captures a short exposure image P3 and a long exposure image M1 in scene A using the multi-effect shooting mode, it displays a thumbnail of the short exposure image P3 in the thumbnail display area B01 on the shooting interface 10, along with the corresponding number "2". When the mobile phone 100 detects that the user clicks on the number "2" corresponding to the short exposure image P3, it switches the image displayed in the thumbnail display area B01 to the thumbnail of the long exposure image M3, and switches the number "2" displayed on the shooting interface 10 to the number "1" corresponding to the long exposure image M3.

[0123] In some embodiments, after the mobile phone 100 captures images with multiple shooting effects through multiple exposure times in the multi-effect shooting mode, it can save the captured images with multiple shooting effects. Then, the user can view the images with multiple shooting effects saved by the mobile phone 100 through applications such as the gallery, album, and file manager on the mobile phone 100.

[0124] For example, refer to Figure 8A After the phone 100 captures a short-exposure image P3 and a long-exposure image M1 with different shooting effects in scene A using the multi-effect shooting mode, when the phone 100 detects that the user can perform a back operation (such as swiping left along the right edge of the phone 100's screen), the phone 100 closes the camera application and returns to the desktop 30. Then, when the phone 100 detects that the user clicks the album application icon 17 on the desktop 30, the phone 100 launches the album application and displays the album interface 40 containing the short-exposure image P3 and the long-exposure image M1.

[0125] For example, refer to Figure 8B After the mobile phone 100 takes a picture of scene A in the multi-effect mode and obtains a short exposure image P3 and a long exposure image M1 with different shooting effects, when the mobile phone 100 detects that the user clicks on the thumbnail display area B01 on the shooting interface 10, the mobile phone 100 launches the album application and displays the album interface 40 containing the short exposure image P3 and the long exposure image M1.

[0126] For example, see reference Figure 8CAfter the mobile phone 100 takes a picture of scene A in the multi-effect mode and obtains a short exposure image P3 and a long exposure image M1 with different shooting effects, the mobile phone 100 can directly launch the album application and display the album interface 40 containing the short exposure image P3 and the long exposure image M1.

[0127] The technical solution of this application will be described below with reference to specific embodiments.

[0128] Figure 9 A flowchart illustrating an example of a shooting method provided in an embodiment of this application is shown.

[0129] refer to Figure 9 The shooting method includes the following steps:

[0130] S101: The electronic device detects a shooting command to capture an image through the first shooting mode, and acquires multiple images through multiple exposure durations. The multiple images include a second image with a first exposure duration and a second exposure duration, wherein the first exposure duration is shorter than the second exposure duration.

[0131] In some embodiments, the electronic device acquires multiple images alternately using a first exposure duration and a second exposure duration. For example, multiple images are acquired over several consecutive time periods, wherein at least one image is acquired in each time period using either the first exposure duration or the second exposure duration, and the exposure duration used in adjacent time periods is different.

[0132] For example, when an electronic device acquires multiple images using a first exposure time and a second exposure time, it alternates between the first and second exposure times. Furthermore, it acquires only one image each time it acquires an image using the first and second exposure times; or, it acquires two images each time it acquires an image using the first exposure time and one image each time it acquires an image using the second exposure time; or, it acquires one image each time it acquires an image using the first exposure time and two images each time it acquires an image using the second exposure time; or, it acquires two images each time it acquires an image using both the first and second exposure times.

[0133] It should be noted that the specific process of an electronic device acquiring multiple images through various exposure times can be found in the aforementioned introduction to image acquisition methods, and will not be repeated here.

[0134] For example, refer to the above Figure 4In scenario A, after the mobile phone 100 launches the camera application and enters the multi-effect shooting mode (as the first shooting mode), when the mobile phone 100 detects that the user clicks the shooting button 16 on the shooting interface 10 (as an example of a shooting command), the mobile phone 100 can alternately use short exposure time and long exposure time to collect short exposure time P1~P4 and long exposure image K1~K4.

[0135] It should be noted that the specific process of entering the multi-effect mode on the phone can be found in the aforementioned introduction on how to enter the multi-effect mode, and will not be repeated here.

[0136] For example, when the mobile phone 100 detects a voice command such as "Open the one-shot multi-effect mode and take a picture" (as an example of a shooting command), the mobile phone 100 can also alternately use short exposure time and long exposure time to collect short exposure time P1 to P4 and long exposure image K1 to K4.

[0137] S102: The electronic device obtains a third image with a first shooting effect based on a first image with a first exposure duration, and obtains a fourth image with a second shooting effect based on a second image with a second exposure duration.

[0138] In some embodiments, corresponding to the first shooting effect being a dynamic capture shooting effect and the second shooting effect being a slow shutter recording shooting effect, the electronic device can select an image from the first image as a third image and fuse the second image into a fourth image.

[0139] In other embodiments, corresponding to the first shooting effect being the shooting effect of dynamic capture using a first parameter (such as the dynamic capture shutter speed of 1 / 2000s shown in Table 1 above), and the second shooting effect being the shooting effect of dynamic capture using a second parameter (such as the dynamic capture shutter speed of 1 / 1000s shown in Table 1 above), the electronic device can select one image from the first image as the third image, and select one image from the second image as the fourth image.

[0140] In some other implementations, corresponding to the first shooting effect being a slow shutter recording effect using a third parameter (such as the slow shutter recording shutter speed of 1 / 30s shown in Table 1 above), and the second shooting effect being a slow shutter recording effect using a fourth parameter (such as the slow shutter recording shutter speed of 1 / 30s shown in Table 1 above), the electronic device can fuse the first image into a third image, and fuse the second image into a fourth image.

[0141] It is understandable that the first, second, third, and fourth parameters can be shooting parameters such as shutter speed or exposure time. Furthermore, the first and second parameters are not equal, and the third and fourth parameters are not equal.

[0142] The technical solution of this application will be introduced below, taking the first shooting effect as a dynamic capture and the second shooting effect as a slow shutter recording as examples.

[0143] For example, refer to Figure 10A In the multi-effect shooting mode, the mobile phone 100 takes photos of scene A alternately with short and long exposure times, obtaining short exposure images P1-P4 and long exposure images K1-K4. Then, the mobile phone 100 selects a short exposure image P3 (as an example of the third image) from the short exposure images P1-P4, where the dynamic target is relatively clear, and performs frame interpolation, alignment, and fusion processing on the long exposure images K1-K4 to obtain a long exposure image M1 (as an example of the fourth image).

[0144] For example, refer to Figure 10B After capturing scene A in multi-effect mode, the mobile phone 100 obtains long exposure images K1-K4. These images can be directly fused to obtain long exposure image M2 (as the fourth image). However, because the long exposure images K1-K4 are discontinuous, significant information is lost during the time intervals between K1 and K2, K2 and K3, and K3 and K4. This results in noticeable jitter in the moving figures in long exposure image M2, leading to poor light trailing effects. Therefore, before fusing the long exposure images K1-K4, frame interpolation and alignment can be performed to improve the light trailing effect of long exposure image M2.

[0145] The following section provides a detailed introduction to the processes of frame interpolation, alignment, and blending.

[0146] (1) Frame interpolation

[0147] In some embodiments, the electronic device may employ an inter-frame interpolation algorithm based on two discontinuous long-exposure images (e.g., ...). Figure 10B The display content of the long exposure images K1 and K2, K2 and K3, K3 and K4 in the image is used to generate an image to compensate for the image information (hereinafter referred to as the "inserted frame image"). Figure 10B Images L1, L2, and L3 from the image are inserted between the two long-exposure images.

[0148] It is understood that inter-frame interpolation algorithms include, but are not limited to, motion-compensated interpolation algorithms, bidirectional prediction algorithms, optical flow-based interpolation algorithms, and frame fusion algorithms.

[0149] Specifically, the electronic device can estimate the motion of the dynamic target in the image based on the position information of the same dynamic target in two discontinuous long exposure images, obtain the motion vector representing the motion direction and distance of the dynamic target, and use the linear interpolation method to predict the color and brightness of the dynamic target in the interpolated frame image. Then, based on the motion vector, color and brightness of the dynamic target, the interpolated frame image is generated and inserted between the two long exposure images.

[0150] In some embodiments, when an electronic device estimates the motion of a dynamic target in an image based on the position information of the same dynamic target in two discontinuous long exposure images, it can combine the position information of the dynamic target in the short exposure image between the two long exposure images to improve the accuracy of motion estimation and thus enhance the frame interpolation effect.

[0151] For example, when the mobile phone 100 estimates the motion of a moving person based on the position information of the moving person in the long exposure image K1 and the long exposure image K2, it can combine the position information of the moving person in the short exposure image P2 between the long exposure image K1 and the long exposure image K2 to estimate the motion more accurately and predict the position of the person in the inserted frame image L1, thereby improving the frame interpolation effect.

[0152] (2) Alignment processing

[0153] In some embodiments, during the acquisition of multiple images using a single-shot multi-effect mode, the electronic device can detect whether it has shifted. If so, the electronic device can align the background of the acquired long-exposure images with the background of the interpolated frame images inserted between the long-exposure images, so as to obtain an image with a clearer background and a flowing light effect on the moving target after fusion processing. If not, the electronic device can align the dynamic target in the acquired long-exposure images with the dynamic target in the interpolated frame images inserted between the long-exposure images, so as to obtain an image with a clearer dynamic target and a flowing light effect on the background after fusion processing.

[0154] In some embodiments, during the process of acquiring multiple images in the first shooting mode, the electronic device can obtain motion parameters such as linear acceleration and angular velocity of the electronic device through an inertial measurement unit (IMU) (a device that integrates sensors such as accelerometers and gyroscopes), and then determine whether the electronic device has been displaced based on the obtained motion parameters.

[0155] For example, refer to Figure 10BIn the multi-effect shooting mode, mobile phone 100 takes a picture of scene A without moving during the shooting process. In this case, mobile phone 100 can align the background in the long exposure images K1 to K4 obtained after shooting with the background in the inserted frame images L1 to L3, and then perform fusion processing to obtain a long exposure image M1 with a clear background and a flowing light effect on the person.

[0156] For example, refer to Figure 10C In the multi-effect shooting mode, the mobile phone 100 takes a picture of scene A and moves along the direction of the person's movement in scene A during the shooting process, so that its focus window is always focused on the person in scene A. In this case, the mobile phone 100 can align the person in the long exposure images K1 to K4 obtained after shooting with the person in the inserted frame images L1 to L3, and after fusion processing, obtain a long exposure image M3 with a clearer person and a background with a light flow effect (i.e., panning effect).

[0157] (3) Fusion processing

[0158] In some embodiments, the electronic device may employ image stacking fusion methods such as average stacking, maximum stacking, and median stacking to fuse multiple aligned long exposure images and multiple inserted frame images into a single image.

[0159] The average stacking method uses the average pixel value of the same pixel position in multiple images to be merged as the pixel value of the corresponding position in the merged image. It is suitable for stacking noise reduction.

[0160] The maximum value stacking method uses the maximum pixel value at the same pixel location in multiple images to be merged as the corresponding pixel value in the merged image. It is suitable for recording the trajectory of highlight objects.

[0161] The median stacking method uses the median value of the same pixel position in multiple images to be merged as the pixel value of the corresponding position in the merged image. It is suitable for eliminating moving objects (or "non-target subjects") that may interfere with the image, such as pedestrians, vehicles, clouds, or fallen leaves that occasionally enter the frame.

[0162] In some embodiments, the electronic device may employ average stacking, maximum stacking, and median stacking methods to fuse static regions, globally consistent dynamic regions, and non-globally consistent dynamic regions in the above-mentioned aligned long exposure images and multiple inserted frame images, respectively, to obtain a fused image.

[0163] In some embodiments, the static region can be a region in which no dynamic objects exist in any of the multiple images to be merged, such as... Figure 11The V1 region in the middle.

[0164] In some embodiments, the globally consistent dynamic region can be the union region of the areas where the dynamic target of interest is located in multiple images to be fused, such as... Figure 11 The V2 region is the union of the areas where the moving figure is located in the long exposure images K1-K4 and the inserted frame images L1-L3.

[0165] In some embodiments, a non-globally consistent dynamic region can be the union of regions where a disturbing dynamic object is located in some of the images to be fused, for example... Figure 11 The V3 region is the union of the regions where the drifting white clouds (as an example of a "dynamic object with interference") are located in the long exposure images K1, K2, and the inserted frame-filled image L1.

[0166] For example, refer to Figure 11 When the mobile phone 100 performs fusion processing on the long exposure images K1~K4 and the inserted frame images L1~L3, the mobile phone 100 can use the average value stacking method to perform fusion processing on the V1 region of the long exposure images K1~K4 and the inserted frame images L1~L3, use the maximum value stacking method to perform fusion processing on the V2 region of the long exposure images K1~K4 and the inserted frame images L1~L3, and use the median value stacking method to perform fusion processing on the V3 region of the long exposure images K1~K4 and the inserted frame images L1~L3, to obtain the long exposure image M1.

[0167] It should be noted that, in the embodiments of this application, the shape and size of static regions, globally consistent dynamic regions, and non-globally consistent dynamic regions are not limited.

[0168] S103, the electronic device displays a first thumbnail of the third image and / or a second thumbnail of the fourth image.

[0169] In some embodiments, after the electronic device captures a third image and a fourth image using a first shooting mode, the electronic device can display a first thumbnail of the third image and / or a second thumbnail of the fourth image in the thumbnail display area of ​​the camera application's shooting interface. See the foregoing for details. Figures 7A to 7D The relevant information will not be repeated here.

[0170] In other embodiments, the electronic device may display a third and / or fourth image on the shooting interface of a camera application.

[0171] S104, the electronic device starts the first application and displays the third and fourth images through the first application.

[0172] In some embodiments, after the electronic device captures the third and fourth images through the first shooting mode, the electronic device can directly launch the first application, or launch the first application after detecting the instruction to launch the first application, and then display the third and fourth images through the first application.

[0173] The first application is used to manage images captured by electronic devices, such as gallery, photo album, and file manager applications. The display process for the third and fourth images can be referenced above. Figures 8A to 8C The relevant information will not be repeated here.

[0174] It should be noted that steps S103 and S104 are optional steps.

[0175] In this embodiment, because the third and fourth images have different exposure times, their shooting effects are different. Thus, in the first shooting mode, the electronic device can obtain multiple images with different shooting effects in a single shot.

[0176] Figure 12 A flowchart illustrating another shooting method provided in an embodiment of this application.

[0177] refer to Figure 12 After launching the camera app on the phone, the phone can perform scene detection (see above). Figure 5C and Figure 5D (as described above) or user-selected (see above) Figure 5A and Figure 5B The phone enters the multi-effect mode via a process described in the introduction. After entering multi-effect mode, the phone can configure shooting parameters such as shutter speed and digital gain. After configuring the shooting parameters, the phone uses alternating short and long shutter speed image sequences. Then, the phone recommends the best image from the short shutter speed image sequence (as the third image), such as an image with a relatively clear moving subject, and performs frame interpolation, alignment, and fusion processing on the long shutter speed images to obtain the fused image (as the fourth image).

[0178] A long shutter speed is a shutter speed that is open for a relatively long time, also known as a slow shutter speed.

[0179] A short shutter speed is a shutter speed with a short opening time, also known as a high-speed shutter.

[0180] A long shutter speed image sequence, also known as a long exposure image sequence, consists of multiple long exposure images taken using a long shutter speed.

[0181] A short shutter speed image sequence, also known as a short exposure image sequence, consists of multiple short exposure images taken using a short shutter speed.

[0182] Digital gain includes, but is not limited to, exposure gain, sharpness gain, color gain, contrast gain, etc.

[0183] In some embodiments, when configuring shooting parameters for long and short shutter speeds on the mobile phone 100, the 3A algorithm (referring to three algorithms that automatically adjust camera parameters: auto focus (AF), auto exposure (AE), and auto white balance (AWB)) can be used to control the parameters of the camera sensor and image signal processor (ISP) and the exposure gain, thereby achieving alternating shooting of short shutter speeds (e.g., 1 / 1000s) and long shutter speeds (e.g., 1 / 20s) (similar to the shooting concept of high dynamic range (HDR) images, except that for short shutter speeds, the exposure gain needs to be adjusted so that the brightness of the captured image is basically the same as that of the captured image with a long shutter speed).

[0184] It's understandable that a shorter shutter speed results in less light entering the camera, leading to a darker image. Conversely, a longer shutter speed allows more light in, resulting in a brighter image. When the phone uses alternating short and long shutter speeds, without exposure compensation for the short shutter speed image, it will be darker than the long shutter speed image. This will cause inconsistencies in brightness between the two final images (the third and fourth images) obtained from the phone's shutter speed.

[0185] Based on this, in some embodiments, reference is made to Figure 13 In a scenario where the mobile phone 100 alternates between short and long shutter speeds when shooting scene A in its multi-effect mode, when the mobile phone 100 uses a short shutter speed, it can use the 3A algorithm to perform exposure compensation (exposure gain) on the short shutter speed image. This ensures that the brightness difference between the average brightness of the short-exposure images P1-P4 captured by the short shutter speed and the average brightness of the long-exposure images K1-K4 captured by the long shutter speed is greater than the average brightness of the long-exposure images K1-K4 captured by the long shutter speed. The brightness difference ratio is less than the preset brightness difference ratio (e.g., 5%, 6%, 7%, 8%, etc., which is not limited), so that the brightness of the short exposure image P3 and the long exposure image M1 obtained after shooting by the mobile phone 100 is basically the same.

[0186] In some embodiments, the brightness difference between the average brightness of short-exposure images P1-P4 captured by a short shutter speed and the average brightness of long-exposure images K1-K4 captured by a long shutter speed is... The calculation formula is as follows:

[0187]

[0188] Where light_1 is the average brightness of short-exposure images P1 to P4 taken with a short shutter speed, and light_2 is the average brightness of long-exposure images K1 to K4 taken with a long shutter speed.

[0189] Figure 14 A schematic diagram of the structure of mobile phone 100 is shown. Mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a screen 10, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0190] In some embodiments, the mobile phone 100 can capture multiple images using multiple exposure durations in a multi-image mode via the camera 193. Then, the mobile phone 100 can use the processor 110 to select one image from the multiple first images with the first exposure duration as a third image, and perform frame interpolation, alignment, and fusion processing on the multiple second images with the second exposure duration to obtain a fourth image.

[0191] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the mobile phone 100. In other embodiments of this application, the mobile phone 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0192] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). In some embodiments, processor 110 may include one or more interfaces. Interfaces may include inter-integrated circuit (I2C) interfaces, inter-integrated circuit sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industry processor interfaces (MIPI), general-purpose input / output (GPIO) interfaces, and subscriber identification module (SIM) interfaces.

[0193] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the mobile phone 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0194] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, screen 10, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0195] The wireless communication function of mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0196] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the mobile phone 100. The wireless communication module 160 can provide wireless communication solutions, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies, for use on the mobile phone 100. In some embodiments, antenna 1 of the mobile phone 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, enabling the mobile phone 100 to communicate with networks and other devices via wireless communication technologies.

[0197] The mobile phone 100 implements display functions through a GPU, screen 10, and application processor. The GPU is a microprocessor for image processing, connected to the screen 10 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0198] Screen 10 is used to display images, videos, etc. Screen 10 includes a display panel. In some embodiments, mobile phone 100 may include one or N screens 10, where N is a positive integer greater than 1.

[0199] The mobile phone 100 can achieve shooting functions through ISP, camera 193, video codec, GPU, screen 10 and application processor.

[0200] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0201] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. Mobile phone 100 can implement audio functions, such as music playback and recording, through an audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0202] The embodiments disclosed in this application can be implemented in hardware, software, firmware, or a combination of these implementation methods. Embodiments of this application can be implemented as computer programs or program code executable on a programmable system, the programmable system including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0203] Program code can be applied to input instructions to execute the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, the processing system includes any system having a processor such as, for example, a digital signal processor, a microcontroller, an application-specific integrated circuit, or a microprocessor.

[0204] The program code can be implemented using a high-level procedural language or an object-oriented programming language to communicate with the processing system. Assembly language or machine language can also be used when needed. In fact, the mechanisms described in this application are not limited to any particular programming language. In either case, the language can be a compiled language or an interpreted language.

[0205] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored thereon on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or through other computer-readable media. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a machine-readable (e.g., computer-readable) form, including but not limited to floppy disks, optical disks, optical discs, read-only memory, magneto-optical disks, random access memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, magnetic cards or optical cards, flash memory, or tangible machine-readable storage for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in the form of electrical, optical, acoustic, or other propagation signals. Therefore, machine-readable media include any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a machine-readable (e.g., computer-readable) form.

[0206] In the accompanying drawings, some structural or methodological features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be necessary. Rather, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. Furthermore, the inclusion of structural or methodological features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments, these features may be omitted or may be combined with other features.

[0207] It should be noted that all units / modules mentioned in the device embodiments of this application are logical units / modules. Physically, a logical unit / module can be a physical unit / module, a part of a physical unit / module, or a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important factor; the combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed in this application. Furthermore, to highlight the innovative aspects of this application, the above-described device embodiments of this application have not introduced units / modules that are not closely related to solving the technical problems proposed in this application. This does not mean that the above-described device embodiments do not contain other units / modules.

[0208] It should be noted that in the examples and description of this application, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0209] Although this application has been illustrated and described with reference to certain preferred embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made thereto without departing from the scope of this application.

Claims

1. A shooting method for electronic devices, characterized in that, The method includes: A shooting command was detected to be taking pictures in the first shooting mode; Multiple images are acquired through various exposure durations, including a first image with a first exposure duration and a second image with a second exposure duration, wherein the first exposure duration is shorter than the second exposure duration; A third image with a first shooting effect is obtained based on the first image, and a fourth image with a second shooting effect is obtained based on the second image.

2. The method according to claim 1, characterized in that, The acquisition of multiple images through various exposure durations includes: The multiple images are acquired by alternating between the first exposure time and the second exposure time.

3. The method according to claim 2, characterized in that, The process of alternately acquiring the multiple images using the first exposure time and the second exposure time includes: The multiple images are acquired over several consecutive time periods, wherein at least one image is acquired in each time period using either the first exposure duration or the second exposure duration, and the exposure durations used in adjacent time periods are different.

4. The method according to claim 1, characterized in that, The first shooting effect is a dynamic capture shooting effect, and the second shooting effect is a slow shutter recording shooting effect; Furthermore, the process of obtaining a third image with a first shooting effect based on the first image, and obtaining a fourth image with a second shooting effect based on the second image, includes: Select one image from the first image as the third image, and merge the second image into the fourth image.

5. The method according to claim 1, characterized in that, The first shooting effect is the shooting effect of dynamic capture using the first parameter, and the second shooting effect is the shooting effect of dynamic capture using the second parameter; Furthermore, the step of obtaining a third image with a first shooting effect based on the first image, and obtaining a fourth image with a second shooting effect based on the second image, includes: One image is selected from the first image as the third image, and one image is selected from the second image as the fourth image.

6. The method according to claim 1, characterized in that, The first shooting effect is the shooting effect of slow shutter speed recording using the third parameter, and the second shooting effect is the shooting effect of slow shutter speed recording using the fourth parameter; Furthermore, the step of obtaining a third image with a first shooting effect based on the first image, and obtaining a fourth image with a second shooting effect based on the second image, includes: The first image is merged into the third image, and the second image is merged into the fourth image.

7. The method according to claim 1, characterized in that, The first shooting mode is a shooting mode that captures images with multiple shooting effects in one shot, and the multiple shooting effects include the first shooting effect and the second shooting effect.

8. The method according to claim 1, characterized in that, The method further includes: Display the third image and / or the fourth image; or... Display a first thumbnail of the third image and / or a second thumbnail of the fourth image.

9. An electronic device, characterized in that, include: A memory for storing instructions executed by one or more processors of the electronic device; A processor, when executing the instructions in the memory, causes the electronic device to perform the imaging method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the shooting method according to any one of claims 1 to 8.

11. A computer program product comprising computer program code, wherein when the computer program code is run on a computer, the computer implements the shooting method according to any one of claims 1 to 8.

Images