Processing method and apparatus, and electronic device

Abstract

The present application discloses a processing method and apparatus, and an electronic device. The method comprises: activating an image acquisition apparatus (S101), wherein the image acquisition apparatus is used for sensing ambient light to generate acquired images; and in response to a target instruction, continuously saving M photos (S102), wherein the M photos are images obtained by fusing multiple frames of acquired images acquired by the image acquisition apparatus, and M is a positive integer greater than or equal to 2.

Description

Processing method, device and electronic equipment

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 23, 2023, with application number 202311068731.5 and invention name “Processing Method, Device and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of image processing, and in particular to a processing method, device, and electronic device. Background Art

[0003] The image acquisition device is an important module of smart devices (such as mobile phones, cameras, camcorders, etc.). In special modes, it is necessary to collect a specified number of captured images and generate a photo before the shutter is allowed to be activated to obtain the second photo. Obviously, when the user needs to take multiple photos continuously, each time the shutter is activated, it takes a certain amount of time to wait for the image acquisition device to collect the captured images. The shooting delay time is long, resulting in a poor user experience.

[0004] Summary of the Invention

[0005] The present application provides a processing method, device, and electronic device, the purpose of which is to reduce shooting delay time and improve the user experience of continuous shooting.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] A processing method comprising:

[0008] Activating an image acquisition device, wherein the image acquisition device is used to sense ambient light and generate an acquired image;

[0009] In response to the target instruction, M photos are continuously saved, wherein the M photos are images fused based on multiple frames of captured images captured by the image acquisition device; and M is a positive integer greater than or equal to 2.

[0010] Optionally, the continuously saving M photos in response to the target instruction includes:

[0011] In response to the Nth shooting instruction, synthesize an Nth photo based on the Nth group of collected images, wherein the Nth group of collected images are images collected by the image acquisition device;

[0012] In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of captured images, wherein the N+1th group of captured images are images captured by the image capture device;

[0013] Before obtaining the Nth photo based on the Nth group of captured images, responding to the N+1th shooting instruction, N is greater than or equal to 1.

[0014] Optionally, after responding to the Nth shooting instruction and before synthesizing the Nth photo based on the Nth group of collected images, the method further includes:

[0015] Get target parameters;

[0016] If the target parameter meets the target value, respond to the N+1th shooting instruction;

[0017] The target parameter includes one of the following:

[0018] Shooting parameters corresponding to the N+1th shooting instruction;

[0019] Parameters used to characterize the shooting environment before the N+1th shooting instruction are determined.

[0020] Optionally, the Nth group of acquired images and the N+1th group of acquired images include common acquired images.

[0021] Optionally, in response to the Nth shooting instruction, synthesizing the Nth photo based on the Nth group of collected images includes:

[0022] Based on the Nth shooting instruction, a first number of captured images are obtained, where the first number of captured images are images captured by the image capture device;

[0023] Generating an Nth photo based on the acquired images of the target number and the target image processing algorithm; wherein the target number is determined by the target parameter of the Nth shooting instruction;

[0024] In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of collected images includes:

[0025] obtaining a second number of captured images based on the target parameter of the N+1th shooting instruction, where the second number of captured images are images captured by the image acquisition device; the first number and the second number are different; the target number is greater than or equal to the first number; and the target number is greater than the second number;

[0026] Based on the target number of acquired images and the target image processing algorithm, an N+1th photo is generated.

[0027] Optionally, obtaining a first number of captured images based on the Nth shooting instruction includes:

[0028] If the Nth shooting instruction is characterized as the first shooting instruction, the first number captured by the image capture device is the target number.

[0029] A processing device, comprising:

[0030] A device starting unit, used to start an image acquisition device, wherein the image acquisition device is used to sense ambient light and generate an acquired image;

[0031] The instruction response unit is used to continuously save M photos in response to the target instruction, wherein the M photos are images fused based on multiple frames of captured images captured by the image acquisition device; M is a positive integer greater than or equal to 2.

[0032] Optionally, the instruction response unit is used to:

[0033] In response to the Nth shooting instruction, synthesize an Nth photo based on the Nth group of collected images, wherein the Nth group of collected images are images collected by the image acquisition device;

[0034] In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of captured images, wherein the N+1th group of captured images are images captured by the image capture device;

[0035] Before obtaining the Nth photo based on the Nth group of captured images, responding to the N+1th shooting instruction, N is greater than or equal to 1.

[0036] Optionally, the instruction response unit is further configured to:

[0037] Get target parameters;

[0038] If the target parameter meets the target value, respond to the N+1th shooting instruction;

[0039] The target parameter includes one of the following:

[0040] Shooting parameters corresponding to the N+1th shooting instruction;

[0041] Determine the parameters used to characterize the shooting environment before the N+1th shooting instruction.

[0042] Optionally, the Nth group of acquired images and the N+1th group of acquired images include common acquired images.

[0043] Optionally, the instruction response unit is used to:

[0044] Based on the Nth shooting instruction, a first number of captured images are obtained, where the first number of captured images are images captured by the image capture device;

[0045] Generating an Nth photo based on the acquired images of the target number and the target image processing algorithm; wherein the target number is determined by the target parameter of the Nth shooting instruction;

[0046] In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of collected images includes:

[0047] obtaining a second number of captured images based on the target parameter of the N+1th shooting instruction, where the second number of captured images are images captured by the image acquisition device; the first number and the second number are different; the target number is greater than or equal to the first number; and the target number is greater than the second number;

[0048] Based on the target number of acquired images and the target image processing algorithm, an N+1th photo is generated.

[0049] Optionally, the instruction response unit is used to:

[0050] If the Nth shooting instruction is characterized as the first shooting instruction, the first number captured by the image capture device is the target number.

[0051] An electronic device comprises: a processor, a memory and a bus; the processor and the memory are connected via the bus;

[0052] The memory is used to store a program, and the processor is used to run the program, wherein the processing method is executed when the program is run by the processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0054] FIG1 is a schematic flow chart of a processing method provided in an embodiment of the present application;

[0055] FIG2 is a schematic flow chart of another processing method provided in an embodiment of the present application;

[0056] FIG3 is a flow chart of another processing method provided in an embodiment of the present application;

[0057] FIG4 is a schematic diagram of an image data flow provided by an embodiment of the present application;

[0058] FIG5 is a schematic diagram of another image data flow provided by an embodiment of the present application;

[0059] FIG6 is a schematic diagram of another image data flow provided by an embodiment of the present application;

[0060] FIG7 is a schematic diagram of another image data flow provided by an embodiment of the present application;

[0061] FIG8 is a schematic diagram of the architecture of a processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0063] In this application, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. The terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or apparatus comprising the element.

[0064] As shown in FIG1 , a flowchart of a processing method provided in an embodiment of the present application is shown, which is applied to a smart device and includes the following steps.

[0065] S101: Start the image acquisition device.

[0066] The image acquisition device is used to sense ambient light and generate an acquired image.

[0067] In some examples, the image acquisition device may be a local module of the smart device or a module remotely controlled by the smart device. For example, the image acquisition device may be a camera on a drone remotely controlled by a mobile phone.

[0068] S102: In response to the target instruction, continuously save M photos.

[0069] Among them, the M photos are images fused based on multiple frames of captured images captured by the image acquisition device, and M is a positive integer greater than or equal to 2.

[0070] It should be noted that, in response to the target instruction, the execution process of continuously saving M photos can realize continuous shooting without waiting in a mode in which the smart device needs to wait for the image acquisition device to process the acquired image. Whether the smart device executes the process shown in S102 can be manually set by the user. For example, when the night scene shooting mode is set, the smart device can execute the process shown in S102. In a possible implementation, it can also determine that the light is insufficient based on the preview image provided by the smart device and automatically enter the night scene shooting mode.

[0071] In some examples, the embodiments of the present application can be applied to shooting scenes such as night scene shooting scenes, multi-frame noise reduction shooting scenes, long-range shooting scenes, and high dynamic range imaging (HDRI) scenes. Accordingly, each shooting scene corresponds to an exclusive shooting mode. Users can set the shooting mode to achieve continuous shooting without waiting in any shooting scene.

[0072] In some examples, the target instruction may be triggered by a shooting control based on a target input operation.

[0073] In some examples, the target input operation is pressing and holding the shooting control for a long time, or sliding the shooting control, or pressing the shooting control multiple times in a short period of time, or other shooting control triggering actions that can be determined as continuous shooting.

[0074] In some examples, the shooting control can be software or hardware. The so-called software can be a virtual button on the smart device for controlling shooting, and the so-called hardware can be a physical button (such as a shutter) on the smart device for controlling shooting.

[0075] In some examples, the target instruction can be split into multiple image acquisition instructions during the time the shooting control is pressed, and images can be continuously acquired, processed and saved. After processing one photo, the next image acquisition instruction can be executed.

[0076] In a possible implementation, the shooting control is held down for a total of 5 seconds. To this end, the target instruction can be split into 5 image acquisition instructions. A group of acquired images is acquired every 1 second using the image acquisition device, and the group of acquired images are fused to obtain a corresponding photo.

[0077] In some examples, the target instruction can be split into multiple image capture instructions during the time the shooting control is pressed, and images can be captured continuously and some of the captured images can be shared. After enough images are captured, the next image capture instruction can be executed before the photo corresponding to the current image capture instruction is processed.

[0078] In one possible embodiment, the shooting control is pressed for a total of 5 seconds. To this end, the target instruction can be split into 5 image acquisition instructions, and a group of acquisition images is acquired every 1 second using the image acquisition device. If an acquisition image that can be shared with the next second is acquired in any 1 second, the next image acquisition instruction can be executed before the photo synthesis corresponding to the current 1 second image acquisition instruction is completed.

[0079] In some examples, for continuous shooting of multiple frames of captured images processed by the algorithm, a target input operation of the shooting control can be obtained, and a target instruction is determined based on the target input operation, which includes the Nth shooting instruction and the N+1th shooting instruction, where N is greater than or equal to 1.

[0080] It should be noted that, for the implementation process of determining the target instruction based on the target input operation and obtaining M photos using the target instruction, reference can be made to the steps shown in Figures 2 and 3 and the explanations of the steps.

[0081] The process shown in the above S101-S102 can reduce the shooting delay time. Even in the situation where it takes time to process multiple captured images to synthesize a photo, continuous shooting can be achieved without waiting for a long time, thereby optimizing the user's shooting experience. Moreover, in the continuous shooting scenario, since the waiting time for restarting the shooting control is reduced, the processing time of multiple photos obtained by continuous shooting will also be shortened, so that the shooting delay time of continuous shooting is shortened, and the user's shooting experience is better.

[0082] As shown in FIG2 , a flow chart of another processing method provided in an embodiment of the present application is provided, which includes the following steps.

[0083] S201: In response to the Nth shooting instruction, obtain target parameters.

[0084] The Nth group of captured images is images captured by the image capture device, and N is greater than or equal to 1.

[0085] It should be noted that the target parameters include the following: shooting parameters corresponding to the N+1th shooting instruction; parameters used to characterize the shooting environment before the N+1th shooting instruction is determined.

[0086] In some examples, the shooting parameters include, but are not limited to, exposure values ​​(EV), depth of field, focal length, white balance, and other parameters.

[0087] In some examples, in a night scene shooting scenario with too low brightness, the captured image obtained by the image acquisition device at the baseline exposure may have the problem of overexposure in the bright area or too dark in the dark area. For this reason, in the night scene shooting scenario, the image acquisition device will obtain captured images at different exposure amounts again, and synthesize multiple frames of captured images obtained at different exposure amounts into a photo, so as to darken the areas in the photo that may be overexposed and brighten the areas that are too dark.

[0088] In some examples, the captured image obtained based on the exposure amount can be regarded as exposure data. According to the different exposure amounts, the exposure data can be divided into first exposure data (EV0), second exposure data (EV+) and third exposure data (EV-). The first exposure data is used to characterize the captured image obtained by the image capture device using the specified baseline exposure amount, the second exposure data is used to characterize the captured image obtained by the image capture device using the first exposure amount (i.e., an exposure amount higher than the specified baseline exposure amount), and the third exposure data is used to characterize the captured image obtained by the image capture device using the second exposure amount (i.e., an exposure amount lower than the specified baseline exposure amount).

[0089] In some examples, in a long-range shooting scene with a focal length that is too far, the captured images obtained by the image acquisition device at the reference focal length may have unclear close-up or mid-range shots. For this reason, in a long-range shooting scene, the image acquisition device will obtain captured images at different focal lengths again, and synthesize multiple frames of captured images obtained at different focal lengths into one photo, so that the focus of the photo is focused at the appropriate distance.

[0090] In some examples, the captured image obtained based on the focal length can be regarded as focal length data. According to the different focal lengths, the focal length data can be divided into first focal length data, second focal length data and third focal length data. The first focal length data is used to characterize the captured image obtained by the image capture device using a specified reference focal length. The second focal length data is used to characterize the captured image obtained by the image capture device using the first focal length (i.e., a focal length higher than the specified reference focal length). The third focal length data is used to characterize the captured image obtained by the image capture device using the second focal length (i.e., a focal length lower than the specified reference focal length).

[0091] It can be understood that exposure data and focal length data are both data types of captured images. For captured images of any data type, the data type and data volume involved in the captured image group required for the synthetic photo can be determined based on multiple factors such as the illumination and sensitivity of the image capture device.

[0092] In one possible implementation, the set of captured images required for synthesizing a photograph can be obtained by training a machine learning model based on sample data (the sample data includes illumination, sensitivity, captured images, and images). The data type and amount of the captured image set are not limited. In an embodiment where captured images are acquired based on exposure, when a shooting control (e.g., a shutter) is first activated, the image capture device determines the set of captured images required to produce an optimal photograph based on illumination and / or sensitivity.

[0093] In one possible embodiment, based on factors such as the illumination and sensitivity of the image acquisition device, it is determined that four first exposure data (EV0) are required to form a first acquired image, and one second exposure data (EV+) and one third exposure data (EV-) are required to form a second acquired image in order to synthesize a photo with optimal effect in a night scene shooting scenario. Similarly, in long-range shooting, it can be determined that two first focal length data are required to form a first acquired image, and one second focal length data and one third focal length data are required to form a second acquired image in order to synthesize a photo with optimal effect in a long-range shooting scenario. Alternatively, it can be determined that two first exposure data (EV0) are required to form a first acquired image, and one second exposure data (EV+) and one third exposure data (EV-) are required to form a second acquired image in order to synthesize a photo with optimal effect in an HDRI scene.

[0094] In some examples, for night scene shooting scenes, the shooting parameters corresponding to the second exposure data and the third exposure data can be regarded as exposure compensation, that is, the overly bright area can be darkened or the overly dark area can be brightened, and the shooting parameters corresponding to the first exposure data can be regarded as basic exposure. Accordingly, the image acquisition device obtains the corresponding captured image based on the exposure compensation and the basic exposure.

[0095] As shown in Figure 4, in a possible implementation, the image group required to synthesize the best photo effect includes 6 exposure data continuously acquired by the image acquisition device, and the acquisition order of the 6 exposure data is: first exposure data (EV0), first exposure data (EV0), first exposure data (EV0), second exposure data (EV+), and third exposure data (EV-).

[0096] It should be noted that the parameters used to characterize the shooting environment can be referred to as environmental parameters. The so-called environmental parameters include but are not limited to: brightness, humidity, weather, temperature and other parameters.

[0097] Optionally, environmental parameters may be determined by a sensor unit of the image acquisition device.

[0098] In a possible implementation, for brightness, the sensing unit may be a photosensitive unit for collecting brightness data within the viewing range of the image acquisition device; for humidity, the sensing unit may be a humidity sensor for collecting humidity data around the image acquisition device.

[0099] In some examples, the environmental parameters acquired by the sensing unit may be displayed externally, for example, by displaying the current image captured by the lens of the image acquisition device through a preview interface and displaying the current environmental parameters in the preview interface.

[0100] S202: Determine whether the target parameter meets the target value.

[0101] If the target parameter meets the target value, execute S203, otherwise execute S205.

[0102] Generally speaking, the target parameters satisfying the target values ​​may mean that the difference between the target parameters corresponding to the Nth shooting instruction and the N+1th shooting instruction is small. Of course, it may also mean that the shooting scenes corresponding to the Nth shooting instruction and the N+1th shooting instruction do not change much.

[0103] In some examples, when the shooting target is an animal, the image acquisition device may shoot in a scene with changing light. For example, the framing direction moves from facing the light sideways to facing the light head-on. The difference in target parameters corresponding to the Nth shooting instruction and the N+1th shooting instruction can be understood as the amount of change in ambient light. If the difference meets the specified threshold range, it means that the amount of change in ambient light is small, which means that the target parameter of the N+1th shooting instruction meets the target value.

[0104] S203: Respond to the N+1th shooting instruction, and then synthesize the Nth photo based on the Nth group of collected images.

[0105] After executing S203 , continue to execute S204 .

[0106] Among them, since the target parameters meet the target values, it can be determined that part of the captured images can be shared between the Nth group of captured images captured by the image acquisition device and the future N+1th group of captured images. Therefore, there is no need to wait for the image acquisition device to synthesize the Nth photo and the N+1th shooting instruction can be responded to in advance.

[0107] In some examples, the triggering of the N+1th shooting instruction, taking the second shooting instruction as an example, may be triggered by the user using a shooting control (eg, pressing a physical shooting button).

[0108] In one possible implementation, the shooting instruction can be divided into n sub-instructions. The i-th sub-instruction captures part of the captured images required for a photo, and the remaining captured images and processed images required to synthesize a photo are all after the i+1-th target sub-instruction. Of course, the remaining captured images need to meet specified conditions. If the remaining captured images do not meet the specified conditions, the processed images are also after the i+1-th target sub-instruction. At this time, the captured images are processed by the background and there is no need to wait for processing time.

[0109] In some examples, the specified condition refers to the remaining captured images, which must be able to be combined with the previously obtained captured images to form an optimal photo. Taking the exposure data as the captured image as an example, if the previously obtained captured image is the first exposure data (EV0), then the remaining captured images are exposure compensation (i.e., EV+ and EV-). The exposure compensation needs to be able to solve the exposure problem of the first exposure data to determine that the exposure compensation meets the specified condition.

[0110] In the related art, the user is required to keep the image acquisition device stable to capture multiple captured images and synthesize them into one image, and is not allowed to activate the shutter again before the composite photo is taken, or the shutter can be pressed but the captured image cannot be captured. The present application can activate the shutter and capture the captured image of the next shooting scene before synthesizing the photo, and the target parameters of the next shooting scene need to meet the target values. For example, in the process of taking two photos continuously, the existing technology usually requires the image acquisition device to collect a group of EV0, EV0, EV0, EV0, EV+, EV- before allowing the shutter to be activated again to collect another group of EV0, EV0, EV0, EV0, EV+, EV-. However, the embodiment of the present application allows the shutter to be activated after collecting EV0, EV0, EV0, EV0 in the first group and before collecting EV+ in the first group. After activating the shutter, EV+, EV- and the second group of EV0, EV0, EV0, EV0 can be continuously collected. Obviously, the user does not need to wait for a long time before being allowed to activate the shutter when taking a photo, thereby improving the user's shooting experience.

[0111] It should be noted that responding to the N+1th capture command before composing the Nth photo to obtain the N+1th set of captured images reduces the time users have to wait for capture controls to be enabled, significantly improving the user's shooting experience. Furthermore, in scenarios involving multiple consecutive photos, allowing capture commands to be responded to in advance can reduce shooting delays and shorten overall shooting time.

[0112] In some examples, each time the image acquisition device activates the shutter, a set of captured images can be captured. Each time the shutter is activated, it represents a response to a shooting instruction. When the shutter is activated for the first time, it will determine which captured images the image acquisition device needs to collect. Taking Figure 5 as an example, when the shutter is activated for the first time, that is, in response to the first shooting instruction, the image acquisition device uses an algorithm engine to determine that four EV0, EV+, and EV- need to be collected based on the illumination and sensitivity to synthesize a photo with the best effect. In addition, before obtaining the second captured image data (i.e., EV+ and EV-), it is necessary to determine whether the target parameters corresponding to the second shooting instruction meet the target values. If the target parameters corresponding to the second shooting instruction meet the target values, the shutter is allowed to be activated again to respond to the second shooting instruction. After obtaining the second captured image data, the first photo is synthesized based on the first captured image data and the second captured image data.

[0113] As shown in Figure 5, in one possible implementation, the image acquisition device requires a set of EV0, EV0, EV0, EV0, EV+, and EV- to generate a photo with the best effect. To this end, two photos usually require two sets of EV0, EV0, EV0, EV0, EV+, and EV-. The existing technology allows the image acquisition device to respond to the shooting instruction again and obtain another set of EV0, EV0, EV0, EV0, EV+, and EV- only after the image acquisition device has collected a set of EV0, EV0, EV0, EV0, EV+, and EV-. However, based on the method shown in the present application, the first sub-image data and the second sub-image data can be regarded as the captured images obtained by the image acquisition device in response to the first shooting instruction, the second sub-image data and the third sub-image data can be regarded as the captured images obtained by the image acquisition device in response to the second shooting instruction, the first sub-image data includes EV0, EV0, EV0, EV0, the second sub-image data can be regarded as obtained after the first sub-image data, the second sub-image data includes EV+, EV-, and the third sub-image data includes EV0, EV0, EV0, EV0. After obtaining the last EV0 in the first sub-image data and before obtaining EV+ in the second sub-image data, respond to the second shooting instruction, that is, before the first photo is synthesized, respond to the second shooting instruction to obtain the captured image required for synthesizing the second photo, that is, the synthesis process of the second photo can share the second sub-image data with the Nth photo, thereby saving shooting time and increasing user experience.

[0114] S204: Synthesizing the N+1th photo based on the N+1th group of collected images.

[0115] The Nth group of acquired images and the N+1th group of acquired images include common acquired images.

[0116] In some examples, since the Nth group of captured images and the N+1th group of captured images include common captured images, the collection time of the N+1th group of captured images will be advanced, thereby improving the synthesis efficiency of the N+1th photo.

[0117] As shown in FIG5 , in one possible embodiment, the first photo and the second photo share the EV+ and EV- shown in the second sub-image data. In another possible embodiment, the Nth photo and the N+1th photo may also share other sub-image data (e.g., EV0, EV0, EV0, EV0).

[0118] It can be understood that in a continuous shooting scenario, the synthesis of two photos obtained by continuous shooting can share some of the captured images. Compared with the existing technology, it can effectively reduce the collection time of the captured image group, thereby increasing the speed of photo generation, and can advance the response time of the shooting command, thereby improving the user's shooting experience.

[0119] S205: Synthesize the Nth photo based on the Nth group of collected images, and then respond to the N+1th shooting instruction.

[0120] After executing S205 , continue to execute S206 .

[0121] S206: Synthesizing the N+1th photo based on the N+1th group of collected images.

[0122] There is no intersection between the Nth group of collected images and the N+1th group of collected images, that is, the Nth group of collected images and the N+1th group of collected images do not share any collected images.

[0123] It can be understood that the essence of S205-S206 is the photo synthesis in the related technology. Obviously, in order to respond to the N+1th shooting instruction before synthesizing the Nth photo, the target parameters corresponding to the N+1th shooting instruction need to meet the target values.

[0124] In the process shown in S201-S206 above, since the N+1th shooting instruction is responded to before the Nth photo is synthesized, the waiting time for the N+1th shooting instruction is reduced. Therefore, the generation time of the N+1th photo will be advanced, which shortens the shooting delay time of continuous shooting and provides a better user shooting experience.

[0125] As shown in FIG3 , a flow chart of another processing method provided in an embodiment of the present application is provided, which includes the following steps.

[0126] S301: Based on the Nth shooting instruction, a first number of captured images are obtained.

[0127] The first number of captured images are images captured by an image capture device.

[0128] Optionally, if the Nth shooting instruction is characterized as the first shooting instruction, the first number captured by the image capture device is the target number.

[0129] In some examples, a shooting parameter is used as a target parameter. The shooting parameter can be an exposure amount, which can be divided into a baseline exposure and an exposure compensation. The image acquisition device can obtain 4 EV0s using the baseline exposure and can obtain 1 EV+ and 1 EV- using the exposure compensation. Therefore, when the target parameter corresponding to the Nth shooting instruction is the baseline exposure, the first number is 4. When the target parameter corresponding to the Nth shooting instruction is the exposure compensation, the first number is 2.

[0130] S302: Generate an Nth photo based on the target number of acquired images and the target image processing algorithm.

[0131] The number of targets is determined by the target parameter of the Nth shooting instruction.

[0132] In one possible embodiment, before obtaining a captured image group in response to the first shooting instruction, the image acquisition device will also use a built-in algorithm engine to synthesize a photo with the best effect based on the illumination and sensitivity analysis, and the data type and data volume of the required captured images, for example, analyzing how many EV0s, how many EV+s and the level of EV+ may be needed for the first photo. The data volume is the first data volume. For example, in response to the first shooting instruction, the captured image group required to synthesize a photo with the best effect includes EV0, EV0, EV0, EV0, EV+, and EV-. For this reason, the target number can be regarded as 6.

[0133] S303: Obtain a second number of captured images based on the target parameters of the (N+1)th shooting instruction.

[0134] The second number of captured images are images captured by the image capture device, the first number is different from the second number, the target number is greater than or equal to the first number, and the target number is greater than the second number.

[0135] In some examples, a shooting parameter is used as a target parameter. The shooting parameter can be an exposure amount, which can be divided into a baseline exposure and an exposure compensation. The image acquisition device can obtain 4 EV0s using the baseline exposure, and can obtain 1 EV+ and 1 EV- using the exposure compensation. Therefore, when the target parameter corresponding to the N+1th shooting instruction is the baseline exposure, the second number is 4, and when the target parameter corresponding to the N+1th shooting instruction is the exposure compensation, the second number is 2.

[0136] S304: Generate the N+1th photo based on the target number of acquired images and the target image processing algorithm.

[0137] As shown in Figure 6, in a possible implementation, the first shooting instruction is responded to to obtain the first sub-image data (the corresponding number of acquired images is 4), and before synthesizing the first photo, the second shooting instruction is responded to to obtain the second sub-image data (the corresponding number of acquired images is 2), and before synthesizing the second photo, the third shooting instruction is responded to to obtain the third sub-image data (the corresponding number of acquired images is 4), and before synthesizing the third photo, the fourth shooting instruction is responded to to obtain the fourth sub-image data (the corresponding number of acquired images is 2), and before synthesizing the fourth photo, the fifth shooting instruction is responded to to obtain the fifth sub-image data and the sixth sub-image data (the corresponding number of acquired images is 6), and then the fifth photo is synthesized.

[0138] As shown in Figure 6, in a possible implementation, based on the first sub-image data and the second sub-image data, a first photo is synthesized as a first group of captured images; based on the second sub-image data and the third sub-image data, a second photo is synthesized as a second group of captured images; based on the third sub-image data and the fourth sub-image data, a third photo is synthesized as a third group of captured images; based on the fourth sub-image data and the fifth sub-image data, a fourth photo is synthesized as a fourth group of captured images; based on the fifth sub-image data and the sixth sub-image data, a fifth photo is synthesized as a fifth group of captured images.

[0139] As shown in Figure 6, in one possible implementation, the first photo and the second photo share the second sub-image data, the second photo and the third photo share the third sub-image data, the third photo and the fourth photo share the fourth sub-image data, the fourth photo and the fifth photo share the fifth sub-image data, and so on, the Nth photo and the N+1th photo share the N+1th sub-image data.

[0140] Furthermore, when responding to the first capture command, the image acquisition device analyzes the type and amount of captured images required to synthesize an optimal photo. Furthermore, before acquiring the second, third, fourth, and fifth sub-image data, the image acquisition device determines, based on the target parameters corresponding to each capture command, whether to respond to the next capture command before synthesizing the photo corresponding to the current capture command.

[0141] In a possible implementation, in the case of continuous shooting as shown in Figure 6, the target parameters corresponding to the second shooting instruction, the target parameters corresponding to the third shooting instruction, the target parameters corresponding to the fourth shooting instruction, and the target parameters corresponding to the fifth shooting instruction all meet the corresponding target values.

[0142] Obviously, before obtaining the collected image data each time, the sensor unit of the image acquisition device can be used to obtain the target parameters corresponding to each shooting instruction, and decide whether to respond to the shooting instruction in advance based on the target parameters, so that two photos that are adjacent in time sequence share part of the collected image data, thereby shortening the waiting time required to generate each photo.

[0143] As shown in Figure 7, in a possible implementation, some of the captured images in the first group of captured images (i.e., the second sub-image data) do not meet the sharing conditions (i.e., the target parameters corresponding to the second shooting instruction do not meet the target values, and the first photo and the second photo cannot share the second sub-image data). In this case, the second shooting instruction will not be responded to before the third sub-image data is acquired, and the second shooting instruction will not be responded to until the capture of the second sub-image data is completed. If the subsequent third sub-image data, fourth sub-image data, and fifth sub-image data all meet the sharing conditions, the shooting instruction will be responded to in advance before the corresponding photos are synthesized. Compared with the number of photos obtained in Figure 6, since the second sub-image data cannot be shared for the synthesis of the first photo and the second photo, one less photo will be obtained for the same captured image data.

[0144] Obviously, in a continuous shooting scenario, the embodiment of the present application can use fewer captured images than the number of captured images required by the prior art to synthesize the same number of photos as the prior art. Since the number of captured images required is reduced, the speed of generating multiple photos will be faster than the prior art.

[0145] In some examples, the principle of accelerating the generation of M photos can be summarized as follows: in the process of continuously shooting to obtain M photos, the captured images obtained by historical shooting are combined with the captured images obtained by current shooting to determine the photos taken at the current moment, thereby accelerating the generation speed of the photos taken at the current moment.

[0146] In some examples, the prior art requires 2n sub-image data to take n photos. If each of the remaining subset image data except the first sub-image data (EV0, EV0, EV0, EV0 obtained in response to the first shooting instruction) meets the common conditions, then the embodiment of the present application may only need n+1 sub-image data to synthesize n photos. Obviously, the amount of collected image data required is less than that of the prior art.

[0147] In some examples, if except the first sub-image data (EV0, EV0, EV0, EV0), there is one sub-image data in each of the remaining sub-image data that does not meet the sharing condition, then n is m+1+1; if there are two sub-image data in the remaining sub-image data that do not meet the sharing condition, then n is m+1+2. Therefore, it can be concluded that if except the first sub-image data, there are s sub-image data in the remaining sub-image data that do not meet the sharing condition, then n is m+1+s, where s is a positive integer.

[0148] Furthermore, the method described in the embodiments of the present application can be applied to continuous shooting scenarios and allows for slight misalignment of the target in continuous shooting scenarios. Furthermore, the captured images involved in the embodiments of the present application, in addition to exposure data such as EV0, EV+, and EV-, can also be captured images of other data types such as focal length data. Of course, the application of captured images of other data types and the implementation methods for continuous shooting are essentially the same as those in the embodiments of the present application.

[0149] In the related art, in continuous shooting scenarios such as night scene mode and HDRI mode, photos can only be taken one by one, and a long waiting time is required for each photo shooting. Based on the method shown in the embodiment of the present application, the N+1th shooting instruction can be responded to before the Nth photo is synthesized to obtain the N+1th group of captured images in advance, thereby reducing the waiting time for shooting each photo, and enabling users to achieve continuous photo shooting through target input operations, enriching the user's shooting experience.

[0150] The process shown in the above S301-S304 can realize the synthesis of two adjacent photos using a common part of the captured images in a continuous shooting scenario, that is, rationally utilizing part of the captured images in the Nth group of captured images to synthesize the N+1th photo, so as to speed up the synthesis of multiple images. Accordingly, it can further improve the response speed of multiple shooting instructions, thereby reducing the shooting delay time and improving the user shooting experience.

[0151] Corresponding to the processing method provided in the above-mentioned embodiment of the present application, the embodiment of the present application also provides a processing device.

[0152] As shown in FIG8 , it is a schematic diagram of the architecture of a processing device provided in an embodiment of the present application, which includes the units shown below.

[0153] The device starting unit 100 is used to start an image acquisition device, which is used to sense ambient light and generate an acquired image.

[0154] The instruction response unit 200 is used to continuously save M photos in response to the target instruction, wherein the M photos are images fused based on multiple frames of captured images captured by the image capture device; and M is a positive integer greater than or equal to 2.

[0155] Optionally, the instruction response unit 200 is used to: respond to the Nth shooting instruction, synthesize the Nth photo based on the Nth group of captured images, wherein the Nth group of captured images is the images captured by the image capture device; respond to the N+1th shooting instruction, synthesize the N+1th photo based on the N+1th group of captured images, wherein the N+1th group of captured images is the images captured by the image capture device; wherein, before obtaining the Nth photo based on the Nth group of captured images, respond to the N+1th shooting instruction, and N is greater than or equal to 1.

[0156] Optionally, the instruction response unit 200 is also used to: obtain target parameters; if the target parameters meet the target values, respond to the N+1th shooting instruction; the target parameters include one of the following: shooting parameters corresponding to the N+1th shooting instruction; determine the parameters used to characterize the shooting environment before the N+1th shooting instruction.

[0157] Optionally, the Nth group of acquired images and the N+1th group of acquired images include common acquired images.

[0158] Optionally, the instruction response unit 200 is used to: obtain a first number of captured images based on the Nth shooting instruction, the first number of captured images being images captured by the image capture device; generate an Nth photo based on the target number of captured images obtained and the target image processing algorithm; wherein the target number is determined by the target parameters of the Nth shooting instruction; in response to the N+1th shooting instruction, synthesize the N+1th photo based on the N+1th group of captured images, including: obtaining a second number of captured images based on the target parameters of the N+1th shooting instruction, the second number of captured images being images captured by the image capture device; the first number is different from the second number; the target number is greater than or equal to the first number; the target number is greater than the second number; and generate the N+1th photo based on the target number of captured images obtained and the target image processing algorithm.

[0159] Optionally, the instruction response unit 200 is configured to: if the Nth shooting instruction is characterized as the first shooting instruction, the first quantity captured by the image capture device is the target quantity.

[0160] The various units shown above can reduce the shooting delay time and realize continuous shooting without waiting, thereby optimizing the user's shooting experience. Moreover, in the continuous shooting scenario, since the waiting time for restarting the shooting control is reduced, the processing time of multiple photos obtained by continuous shooting will also be shortened, so that the shooting delay time of continuous shooting is shortened and the user's shooting experience is better.

[0161] The present application also provides an electronic device, comprising: a processor, a memory, and a bus. The processor and the memory are connected via the bus, the memory is used to store a program, and the processor is used to run the program, wherein the processing method provided by the present application is executed when the program is run.

[0162] If the functions described in the embodiments of the present application are implemented in the form of software functional units and sold or used as independent products, they can be stored in a storage medium readable by a computing device. Based on this understanding, the part of the embodiment of the present application that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computing device (which can be a personal computer, server, mobile computing device or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0163] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0164] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A processing method comprising: Activating an image acquisition device, wherein the image acquisition device is used to sense ambient light and generate an acquired image; In response to the target instruction, M photos are continuously saved, wherein the M photos are images fused based on multiple frames of captured images captured by the image acquisition device; and M is a positive integer greater than or equal to 2.

2. The method according to claim 1, wherein the step of continuously saving M photos in response to the target instruction comprises: In response to the Nth shooting instruction, synthesize the Nth photo based on the Nth group of collected images, wherein the Nth group of collected images are images collected by the image acquisition device; In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of collected images, wherein the N+1th group of collected images are images collected by the image acquisition device; Wherein, before obtaining the Nth photo based on the Nth group of collected images, respond to the N+1th shooting instruction, where N is greater than or equal to 1.

3. The method according to claim 2, after responding to the Nth shooting instruction and before synthesizing the Nth photo based on the Nth group of collected images, further comprising: Get target parameters; If the target parameter meets the target value, respond to the N+1th shooting instruction; The target parameter includes one of the following: The shooting parameters corresponding to the N+1th shooting instruction; Determine the parameters used to characterize the shooting environment before the N+1th shooting instruction. 4 . The method according to claim 3 , wherein the Nth group of acquired images and the N+1th group of acquired images include common acquired images.

5. The method according to claim 4, wherein in response to the Nth shooting instruction, synthesizing the Nth photo based on the Nth group of collected images comprises: Based on the Nth shooting instruction, a first number of captured images are obtained, where the first number of captured images are images captured by the image acquisition device; Based on the acquired images of the target quantity and the target image processing algorithm, an Nth photo is generated; wherein the target quantity is determined by the target parameter of the Nth shooting instruction; In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of collected images includes: Based on the target parameter of the N+1th shooting instruction, a second number of acquired images are obtained, where the second number of acquired images are images acquired by the image acquisition device; the first number is different from the second number; the target number is greater than or equal to the first number; and the target number is greater than the second number; Based on obtaining the target number of captured images and a target image processing algorithm, an N+1th photo is generated.

6. The method according to claim 5, wherein obtaining a first number of captured images based on the Nth shooting instruction comprises: If the Nth shooting instruction is characterized as the first shooting instruction, the first number captured by the image acquisition device is the target number.

7. A processing device comprising: A device starting unit, used to start an image acquisition device, wherein the image acquisition device is used to sense ambient light to generate a captured image; The instruction response unit is used to respond to the target instruction and continuously save M photos, wherein the M photos are images fused based on multiple frames of captured images captured by the image acquisition device; M is a positive integer greater than or equal to 2.

8. The device according to claim 7, wherein the instruction response unit is used for: In response to the Nth shooting instruction, synthesize the Nth photo based on the Nth group of collected images, wherein: The Nth group of collected images are images collected by the image collection device; In response to the N+1th shooting instruction, synthesizing the N+1th photo based on the N+1th group of collected images, wherein the N+1th group of collected images are images collected by the image acquisition device; Wherein, before obtaining the Nth photo based on the Nth group of collected images, respond to the N+1th shooting instruction, where N is greater than or equal to 1.

9. The device according to claim 8, wherein the instruction response unit is further used for: Get target parameters; If the target parameter meets the target value, respond to the N+1th shooting instruction; The target parameter includes one of the following: The shooting parameters corresponding to the N+1th shooting instruction; Determine the parameters used to characterize the shooting environment before the N+1th shooting instruction.

10. An electronic device comprising: processor, memory, and bus; The processor is connected to the memory via the bus; The memory is used to store programs, and the processor is used to run programs, wherein the program executes the processing method according to any one of claims 1 to 6 when run by the processor.

Images