Image processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an image processing method and device, electronic equipment and a storage medium. The method comprises the following steps: in response to a detected first shooting operation, obtaining a first image and executing the first operation; wherein the first operation comprises an operation for processing the first image; in response to the detected second shooting operation, executing the first operation and the second operation in parallel; wherein the second operation comprises an operation of acquiring a second image. According to the embodiment of the invention, the first operation for processing the first image and the second operation for obtaining the second image can be executed in parallel after the first image is obtained, so that the first image and the second image can be rapidly and continuously obtained, and the image obtaining speed is improved.

Description

Technical Field

[0001] The present invention relates to the field of image processing but is not limited to the field of image processing, and in particular to an image processing method, device, electronic device and storage medium. Background Art

[0002] In the application scenario of taking pictures, it is generally necessary to process the image after acquiring it. The process of acquiring and processing the image in the related technology is complicated. For example, in the Android Camera (AC) system, a user's photo taking process includes three steps: clicking the photo button of the camera application, waiting for the camera system to return the photo result to the camera system, and saving the photo output by the camera system into the album. Here, the process of acquiring and processing the image in the Android Camera system is relatively complicated.

[0003] In the related art, complex steps of acquiring and processing images need to be performed during each photographing process. At this time, a lot of time is needed to acquire and process images during each photographing process, which makes it difficult to quickly and continuously acquire and process multiple images in the related art. Therefore, it can be seen that the efficiency of acquiring and processing images in the related art is low. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure disclose an image processing method, device, electronic device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method, the method comprising:

[0006] In response to detecting a first shooting operation, acquiring a first image and performing a first operation; wherein the first operation includes an operation of processing the first image;

[0007] In response to detecting a second photographing operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0008] In one embodiment, in response to obtaining a preview image corresponding to the first image, the first operation and the second operation are performed in parallel; wherein the size of the preview image of the first image is smaller than the size of the first image, and / or the preview image of the first image is an unprocessed image; and the preview image of the first image is used to preview the processed first image.

[0009] In one embodiment, the method is applied to an electronic device, which performs image processing and / or image transmission operations in a functional layer, and the functional layer of the electronic device includes a first functional layer and a second functional layer, the first functional layer is used to process images, and the second functional layer is used to acquire images from an image acquisition component of the electronic device; the image includes the first image and the second image; the first operation is performed in the first functional layer, and the second operation is performed in the second functional layer.

[0010] In one embodiment, the functional layer of the electronic device further includes a third functional layer, and the method further includes:

[0011] The third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; and the task is a task of acquiring a single frame of the first image or the second image;

[0012] The third functional layer receives a processed image sent by the first functional layer in response to the first information; wherein the processed image is the processed first image or the processed second image.

[0013] In one embodiment, the first information further indicates an image mode of the image to be acquired, and the method further comprises:

[0014] In response to receiving the first information, in the first functional layer, an algorithm type for processing the image is determined according to the image mode; wherein different image modes correspond to different algorithm types.

[0015] In one embodiment, the method further comprises:

[0016] In response to receiving the first information, in the first functional layer, second information is determined according to the image mode; wherein the second information indicates a first number of subtasks to be performed; the subtasks are tasks obtained after the task fission, and each subtask is used to obtain a single frame of the first image or the second image;

[0017] The first functional layer sends the second information to the second functional layer;

[0018] The first functional layer receives a first number of the first images or the second images sent by the second functional layer in response to the second information.

[0019] In one embodiment, determining the second information according to the image mode includes:

[0020] In response to the image mode being a first mode, determining the first number to be a single number; wherein the information complexity of the processed image obtained in the first mode is less than a complexity threshold; the information complexity is used to characterize the complexity of at least one of a color feature, a texture feature, a shape feature, and a spatial feature in the image;

[0021] or,

[0022] In response to the image mode of the image being a second mode, the first number is determined to be at least two; wherein, in the second mode, the information complexity of the processed image obtained is greater than a complexity threshold.

[0023] In one embodiment, performing the first operation includes:

[0024] At the first functional layer, according to the type of algorithm used to process the first images, a first number of the first images are processed respectively to obtain a first number of first images to be fused;

[0025] At the first functional layer, a first number of the first images to be fused are fused to obtain the processed first image.

[0026] In one embodiment, the method further comprises:

[0027] In response to receiving a first number of the second images, a third operation is performed at the first functional layer to obtain the processed second images; wherein the third operation is used to process the second images.

[0028] In one embodiment, the method further comprises:

[0029] In response to the image mode corresponding to the first image and the image mode corresponding to the second image being inconsistent, the first operation and the third operation are performed in parallel.

[0030] In one embodiment, the first image or the second image received by the first functional layer is an image acquired by the second functional layer from the image acquisition component.

[0031] In one embodiment, the subtask is used to obtain a single frame of the first image and a single frame preview image corresponding to the first image; or, the subtask is used to obtain a single frame of the second image and a single frame preview image corresponding to the second image; the preview image is an image of a first size and / or an unprocessed image; the first size is smaller than the size of the first image and / or the second image; the preview image is an image for display on the electronic device.

[0032] In one embodiment, the method further comprises:

[0033] The first functional layer receives a first number of preview images sent by the second functional layer in response to the second information;

[0034] At the first functional layer, determining a preview image corresponding to the task from the first number of preview images;

[0035] The first functional layer sends a preview image of the task to the third functional layer.

[0036] In one embodiment, the image mode includes at least one of the following: portrait mode, night scene mode, dynamic mode, macro mode, backlight mode, blur mode, panoramic mode and landscape mode.

[0037] According to a second aspect of an embodiment of the present disclosure, there is provided an image acquisition device, the device comprising:

[0038] A processing module, the processing module is used to: in response to detecting a first shooting operation, acquire a first image and perform a first operation; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation, perform the first operation and the second operation in parallel; the second operation includes an operation of acquiring a second image.

[0039] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0040] processor;

[0041] a memory for storing instructions executable by the processor;

[0042] The processor is configured to implement the method described in any embodiment of the present disclosure when running the executable instructions.

[0043] According to a fourth aspect of an embodiment of the present disclosure, a computer storage medium is provided, wherein the computer storage medium stores a computer executable program, and when the executable program is executed by a processor, the method described in any embodiment of the present disclosure is implemented.

[0044] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0045] In an embodiment of the present disclosure, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image. Here, since after acquiring the first image, in response to detecting the second shooting operation, the first operation and the second operation are performed in parallel, the first operation includes an operation of processing the first image, and the second operation includes an operation of acquiring the second image, therefore, after acquiring the first image, the first image can be processed and the second image can be acquired simultaneously. At this time, there is no need to waste time waiting for the first image to be processed before acquiring the second image. Compared with the method in the related art that cannot quickly and continuously acquire and process multiple images, in the embodiment of the present disclosure, after acquiring the first image, the first operation of processing the first image and the second operation of acquiring the second image can be performed in parallel, so that the second operation of acquiring the second image can be unaffected by the first operation of processing the first image, and there is no need to waste time waiting for the first image to be processed before acquiring the second image. In this way, the first image and the second image can be acquired quickly and continuously, and the speed of acquiring images is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0047] Figure 1 is a flowchart of an image processing method according to an exemplary embodiment;

[0048] Figure 2 is a schematic diagram of a display interface according to an exemplary embodiment;

[0049] Figure 3 is a flowchart of an image processing method according to an exemplary embodiment;

[0050] Figure 4 is a flowchart of an image processing method according to an exemplary embodiment;

[0051] Figure 5 is a flowchart of an image processing method according to an exemplary embodiment;

[0052] Figure 6 is a flowchart of an image processing method according to an exemplary embodiment;

[0053] Figure 7 is a flowchart of an image processing method according to an exemplary embodiment;

[0054] Figure 8 is a flowchart of an image processing method according to an exemplary embodiment;

[0055] Fig. 9 is a flowchart of an image processing method according to an exemplary embodiment;

[0056] Fig.10 is a flowchart of an image processing method according to an exemplary embodiment;

[0057] Fig.11 is a flowchart of an image processing method according to an exemplary embodiment;

[0058] Fig.12 is a flowchart of an image processing method according to an exemplary embodiment;

[0059] Fig.13 is a flowchart of an image processing method according to an exemplary embodiment;

[0060] Fig.14 is a flowchart of an image processing method according to an exemplary embodiment;

[0061] Fig.15 is a flowchart of an image processing method according to an exemplary embodiment;

[0062] Fig.16 is a flowchart of an image processing method according to an exemplary embodiment;

[0063] Fig.17 is a flowchart of an image processing method according to an exemplary embodiment;

[0064] Fig.18 is a schematic structural diagram of an image processing device according to an exemplary embodiment;

[0065] Fig.19 The figure is a schematic diagram showing the structure of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present invention. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present invention.

[0067] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0068] In the following description, the terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the invention described herein can be implemented in an order other than that illustrated or described herein.

[0069] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present invention belongs. The terms used herein are only for the purpose of describing the embodiments of the present invention and are not intended to limit the present invention.

[0070] like Figure 1 As shown, the embodiment of the present disclosure provides an image processing method, the method comprising:

[0071] Step S0011, in response to detecting a first shooting operation, acquiring a first image and performing a first operation; wherein the first operation includes an operation of processing the first image;

[0072] Step S0012: in response to detecting a second photographing operation, executing the first operation and the second operation in parallel; wherein the second operation includes an operation of acquiring a second image.

[0073] In one embodiment, the shooting operation may be a touch operation performed by a user on the first control, and / or the shooting operation may be an operation in which a user outputs a voice with predetermined content. The shooting operation includes a first shooting operation and a second shooting operation.

[0074] Exemplarily, the predetermined content may be "take an image" content, and in response to detecting a voice carrying the predetermined content output by a user, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a voice carrying the predetermined content output by the user again, the first operation and a second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0075] Exemplarily, in response to detecting a first touch operation acting on a first control, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a second touch operation acting on the first control, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0076] In one embodiment, the first control may be a control located in a display interface of an application. The first control may be used to obtain an image, and the application may be used to output a processed image. Here, the processed image may be an image obtained after being processed by the application, in which case the application may have the ability to process the image. Alternatively, the processed image may also be a processed image obtained by the application from another application or a functional layer of an electronic device, in which case the application may not have the ability to process the image.

[0077] For example, see Figure 2 , the application may be a camera provided in an electronic device, and the first control may be a control located in a display page of the camera for taking photos, and the control is filled with display content of "taking photos". At this time, in response to detecting a touch operation acting on the first control, an image may be acquired and processed to obtain a processed image; and the processed image may be output.

[0078] In one embodiment, outputting the processed image may include storing the processed image in an album; or outputting the processed image may include displaying the processed image in a display interface of an application.

[0079] In one embodiment, the operation of processing an image may include an operation of adjusting the entire or a portion of the image. For example, the operation of processing an image may include an operation of adjusting at least two pixels of the image. The operation of processing an image may also refer to an operation of adjusting at least two pixels of the image using an algorithm.

[0080] In one embodiment, the operation of processing the image may include but is not limited to at least one of the following operations: filtering, denoising, sharpening, blurring, and adjusting brightness values.

[0081] In one embodiment, the operation of acquiring an image and the operation of processing an image may be performed in parallel at the same functional layer of the electronic device.

[0082] Exemplarily, the first operation and the second operation may be performed in parallel in the same functional layer of the electronic device. The first operation includes an operation of processing a first image, and the second operation includes an operation of acquiring a second image.

[0083] In one embodiment, a first thread and a second thread may be created in the same functional layer, the first thread may be used to perform an operation of processing an image, and the second thread may be used to perform an operation of acquiring an image. In this case, the operation of acquiring an image and the operation of processing an image may be performed in parallel by executing the first thread and the second thread at the same time. In this way, in a scenario where images need to be acquired continuously, there is no need to wait for all previously acquired images to be processed, and images can continue to be acquired when the previously acquired images have not been processed, thereby improving the efficiency of acquiring images and bringing a good experience to users.

[0084] Exemplarily, a first thread and a second thread may be created at the same functional layer, the first thread may be used to perform the first operation, and the second thread may be used to perform the second operation. In this case, the first operation and the second operation may be performed in parallel by executing different threads simultaneously.

[0085] In one embodiment, the operation of acquiring an image and the operation of processing an image may be respectively performed in different functional layers of the electronic device.

[0086] Here, since the operation of acquiring an image and the operation of processing an image can be respectively performed in different functional layers of the electronic device, the operation of processing an image and the operation of acquiring an image can be respectively performed using different functional layers, so that the operation of processing an image and the operation of acquiring an image of the electronic device can be decoupled. At this time, there is no need to wait for the electronic device to process the image before continuing to acquire the image. In this way, the electronic device can be used to continuously acquire images, improve the efficiency of acquiring images, and bring a good experience to the user.

[0087] Exemplarily, the first operation and the second operation may be respectively performed in different functional layers of the electronic device. The first operation includes an operation of processing the first image, and the second operation includes an operation of acquiring the second image.

[0088] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation and without stopping execution of the first operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0089] In one embodiment, in response to detecting a first number of shooting operations, an operation of acquiring an image corresponding to any shooting operation and an operation of processing an image corresponding to other shooting operations may be performed in parallel. The first number may be greater than 2. The shooting operations include at least a first shooting operation and a second shooting operation. The images include at least the first image and the second image. It should be noted that, in the embodiments of the present disclosure, "greater than" may mean greater than or equal to.

[0090] Exemplarily, in response to detecting three shooting operations, the three shooting operations are the first shooting operation, the second shooting operation and the third shooting operation, respectively. For the first shooting operation, a first image is acquired and a first operation is performed, and the first operation is an operation of processing the first image; the first operation and the second operation can be performed in parallel, and the second operation is an operation of acquiring a second image corresponding to the second shooting operation; the third operation and the fourth operation can be performed in parallel, and the third operation includes an operation of processing the second image; the first operation and the fourth operation can be performed in parallel, and the fourth operation is an operation of acquiring an image corresponding to the third shooting operation. It can be understood that the technical solution in the embodiment of the present disclosure can be applied to any application scenario where images need to be acquired multiple times in succession.

[0091] In an embodiment of the present disclosure, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image. Here, since after acquiring the first image, in response to detecting the second shooting operation, the first operation and the second operation are performed in parallel, the first operation includes an operation of processing the first image, and the second operation includes an operation of acquiring the second image, therefore, after acquiring the first image, the first image can be processed and the second image can be acquired simultaneously. At this time, there is no need to wait until the first image is processed before acquiring the second image. Compared with the method in the related art that cannot acquire multiple images quickly and continuously, in the embodiment of the present disclosure, after acquiring the first image, the first operation of processing the first image and the second operation of acquiring the second image can be performed in parallel, so that the second operation of acquiring the second image can be unaffected by the first operation of processing the first image, and there is no need to waste time waiting for the first image to be processed before acquiring the second image. In this way, the first image and the second image can be acquired quickly and continuously, and the speed of acquiring images is improved.

[0092] In one embodiment, the parallel execution of the first operation and the second operation includes: in response to obtaining a preview image corresponding to the first image, parallel execution of the first operation and the second operation; wherein, a size of the preview image of the first image is smaller than a size of the first image, and / or, the preview image of the first image is an unprocessed image; and the preview image of the first image is used to preview the processed first image.

[0093] Here, on the one hand, since the second operation is performed only after the preview image of the first image is obtained, and the second operation is the operation of obtaining the second image, it can be ensured that the second image will continue to be obtained after the preview image of the first image is displayed to the user. At this time, in the process of continuously acquiring images, the user will not be unable to view the preview image normally due to too many tasks of displaying preview images. In this way, it can be ensured that the preview image corresponding to each acquired image can be displayed to the user, and the user experience can be ensured to be good. On the other hand, since the size of the preview image of the first image is smaller than the size of the first image, and / or the preview image of the first image is an unprocessed image, before obtaining the processed first image, the preview image of the first image with a small size can be quickly displayed, without wasting time on processing the preview image, reducing the time spent in the process of displaying the preview image to the user, improving the efficiency of returning the image, and ensuring a good user experience.

[0094] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation and acquiring a preview image of the first image, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0095] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to not acquiring a preview image of the first image, no response is given to a shooting operation detected after the first shooting operation. Here, the shooting operation may be an operation for triggering the electronic device to acquire an image. No response to the shooting operation detected after the first shooting operation may refer to not performing an operation of acquiring an image corresponding to the shooting operation. It should be noted that the shooting operation here may be any of the second shooting operations described in the embodiments of the present disclosure, or may be other shooting operations different from the first shooting operation, and the operation time corresponding to the shooting operation is later than the operation time corresponding to the first shooting operation.

[0096] Here, since the response to not acquiring the preview image of the first image will not respond to the shooting operation detected after the first shooting operation, and the shooting operation is an operation for triggering the electronic device to acquire an image, even if a new shooting operation is detected, before the preview image of the first image is acquired, the new shooting operation will not be responded to acquire a new image. At this time, the impact of the new shooting operation on the operation of acquiring the preview image can be reduced, ensuring that the preview image of the first image for display to the user can be acquired. In this way, it can be ensured as much as possible that the preview image can be displayed to the user in a timely manner, ensuring a good user experience.

[0097] Exemplarily, the shooting operation may be a touch operation on the first control, and in response to not acquiring a preview image of the first image, the touch operation on the first control detected after the first shooting operation is not responded to. The first control may be a control in an application for acquiring images. At this time, if a preview image of the first image is not acquired, even if the user clicks the first control in the application, the electronic device will not respond to the touch operation on the first control, that is, the electronic device will not continue to acquire images.

[0098] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to not acquiring a preview image of the first image, images other than the first image and / or the preview image of the first image are not acquired. It can be understood that images other than the first image and / or the preview image of the first image can be any second image described in the embodiments of the present disclosure. Here, since images other than the first image and / or the preview image of the first image are not acquired in response to not acquiring a preview image of the first image, therefore, regardless of whether a new shooting operation is detected, as long as the preview image of the first image is not acquired, acquisition of a new image (here, the new image refers to an image other than the first image and the preview image of the first image) will not be performed, that is, only after ensuring that a preview image of the first image that can be used to display to the user is acquired, a new image will be acquired, thereby reducing the impact of the operation of acquiring a new image on the operation of acquiring a preview image. In this way, it can be ensured that the user can acquire a preview image of the first image, and the user experience is good.

[0099] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in response to not acquiring a preview image of the first image, stopping detecting whether there is a shooting operation (of course, in response to acquiring a preview image of the first image, detecting whether there is a shooting operation can be detected). Here, since detecting whether there is a shooting operation is stopped in response to not acquiring a preview image of the first image, there is no need to continuously detect whether there is a shooting operation, and when a new shooting operation is detected, the operation of acquiring the preview image will not be affected due to responding to the new shooting operation. In this way, the waste of detection resources caused by continuously detecting whether there is a shooting operation can be reduced, ensuring that the user can acquire a preview image of the first image, and ensuring a good user experience.

[0100] In one embodiment, when a preview image of the first image is not obtained and a second shooting operation is detected, the first operation and the second operation are performed in parallel. That is, in some application scenarios, even if a preview image of the first image is not obtained, as long as the second shooting operation is detected, the second operation of obtaining the second image will still be performed.

[0101] In one embodiment, the shooting mode corresponding to the first shooting operation and / or the second shooting operation described in any of the embodiments of the present disclosure may be a snapshot mode. Alternatively, the shooting mode corresponding to the first shooting operation and / or the second shooting operation may be a non-snapshot mode.

[0102] In one embodiment, the snapshot mode may be a mode for acquiring at least two frames of images through one shooting operation, and the non-snapshot mode may be a mode for acquiring a single frame of image through one shooting operation.

[0103] In one embodiment, the snapshot mode may refer to a mode in which the interval between two adjacent shooting operations is less than a time threshold, and the non-snapshot mode may refer to a mode in which the interval between two adjacent shooting operations is greater than or equal to the time threshold.

[0104] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; when the first shooting operation is an operation in a snapshot mode, in response to detecting a second shooting operation and acquiring a preview image of the first image, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0105] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed; wherein the first operation includes an operation of processing the first image; in a case where the first shooting operation is an operation in a non-snapshot mode, in response to detecting a second shooting operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

[0106] In one embodiment, Figure 3 As shown, the method is applied to an electronic device, which performs image processing and / or image transmission operations in a functional layer, and the functional layer of the electronic device includes a first functional layer and a second functional layer, the first functional layer is used to process images, and the second functional layer is used to acquire images from an image acquisition component of the electronic device; the image includes the first image and the second image; the first operation is performed in the first functional layer, and the second operation is performed in the second functional layer.

[0107] Here, since the first functional layer is used to process images and the second functional layer is used to acquire images from the image acquisition component of the electronic device, the first functional layer and the second functional layer with different functions can be used to respectively perform image processing operations and image acquisition operations, so that the image processing operations and image acquisition operations of the electronic device can be decoupled. At this time, there is no need to wait for the electronic device to process the image before continuing to acquire the image. In this way, the electronic device can be used to continuously acquire images, improve the efficiency of acquiring images, and bring a good experience to the user.

[0108] In one embodiment, in response to detecting a first shooting operation, a first image is acquired and a first operation is performed in a first functional layer; wherein the first operation includes an operation of processing the first image; and the first functional layer is used to process images. In response to detecting a second shooting operation, the first operation is performed in the first functional layer and the second operation is performed in the second functional layer; wherein the second operation includes an operation of acquiring a second image, and the second functional layer is used to acquire an image from an image acquisition component of the electronic device.

[0109] In one embodiment, both the first functional layer and the second functional layer may be hardware abstract layers (HAL, Hardware Abstract Layer).

[0110] In one embodiment, the image acquisition component may include a component for acquiring images. For example, the image acquisition component may include camera hardware of an electronic device, and the camera hardware is used to acquire images. Alternatively, the image acquisition component is used to store images acquired by the camera hardware.

[0111] In one embodiment, the second functional layer is used to acquire images from an image acquisition component of an electronic device, which may mean that in the second functional layer, images can be acquired from images stored in the image acquisition component of the electronic device; or, the second functional layer is used to acquire images from the image acquisition component of the electronic device, which may mean that the second functional layer can output instructions that trigger the image acquisition component to acquire images, and images temporarily acquired by the image acquisition component of the electronic device can be acquired from the image acquisition component of the electronic device in the second functional layer.

[0112] In one embodiment, Figure 3 and Figure 4 As shown, the functional layer of the electronic device further includes a third functional layer, and the method further includes:

[0113] Step S0041, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the first image or the second image;

[0114] Step S0042: The third functional layer receives a processed image sent by the first functional layer in response to the first information; wherein the processed image is a processed first image or a processed second image.

[0115] It should be noted that if Figure 3 As shown, the task to be performed indicated by the first information may refer to Figure 3 The third functional layer sends a simple photo-taking task to the first functional layer. The processed image can be Figure 3 The photographing result shown is sent from the first functional layer to the third functional layer.

[0116] Here, since the third functional layer sends the first information to the first functional layer, the first information is used to indicate the task to be performed, the task is a task for acquiring the image, and the third functional layer receives the processed image sent by the first functional layer for the image, therefore, in the embodiment of the present disclosure, the task of acquiring the image and the operation of processing the image are decoupled to the functional layer outside the third functional layer, and the third functional layer only needs to perform simple operations of sending tasks and receiving processed images. In this way, the load of the third functional layer can be reduced, and it is convenient to use the functional layer outside the third functional layer to expand and select the corresponding services of acquiring and processing images.

[0117] In one embodiment, in response to detecting a first shooting operation, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the first image; and the third functional layer receives the processed first image sent by the first functional layer in response to the first information.

[0118] In one embodiment, in response to detecting a second shooting operation, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the second image; and the third functional layer receives the processed second image sent by the first functional layer in response to the first information.

[0119] In one embodiment, the third functional layer may be a Multimedia Framework (MF) layer.

[0120] In one embodiment, in response to detecting a first shooting operation, the third functional layer sends first information corresponding to the first shooting operation to the first functional layer; wherein the first information corresponding to the first shooting operation indicates information of a first task to be performed; and the first task is a task of acquiring a single frame of the first image. In response to detecting a second shooting operation, a first operation is performed at the first functional layer and a second operation is performed at the second functional layer respectively; wherein the first operation is an operation of processing the first image, and the second operation includes an operation of acquiring the second image. A third operation is performed at the first functional layer, and the third operation is an operation of processing the second image. The third functional layer receives the processed image sent by the first functional layer in response to the first information; wherein the processed image is a processed first image and a processed second image; and the first information includes the first information corresponding to the first shooting operation and the first information corresponding to the second shooting operation.

[0121] In one embodiment, in response to detecting a shooting operation, a first message is sent to the first function layer at the third function layer. The first message indicates information of a task to be performed; the task is a task of acquiring the first image or the second image of a single frame. The shooting operation may be any of the first shooting operation or the second shooting operation described in the present disclosure.

[0122] In one embodiment, for different shooting operations, the tasks to be performed indicated by the first information may be the same. In this case, the tasks to be performed indicated in different first information may not be distinguished, and for different first information, the tasks to be performed may be uniformly set as the tasks of acquiring a single frame of image. Here, since for different first information, the tasks to be performed may be uniformly set as the tasks of acquiring a single frame of image, in this case, the process of compiling the information corresponding to the tasks to be performed may be simplified.

[0123] In one embodiment, the first information further indicates the identifier of the image to be acquired, and different identifiers correspond to different images to be acquired. Exemplarily, the identifier corresponding to the first image may be the first identifier, and the identifier corresponding to the second image may be the second identifier. At this time, in the case where at least two images need to be acquired, the same task to be performed may be set in different first information, thereby simplifying the process of compiling the content of the first information; the identifiers of the images indicated by different first information may be used to distinguish the images to be acquired corresponding to the same task of acquiring a single-frame image.

[0124] In one embodiment, the identifier corresponding to the image may be a timestamp.

[0125] In one embodiment, in response to detecting a shooting operation, the first information is sent to the first functional layer at the third functional layer. The first information indicates a timestamp corresponding to the image to be acquired, and different images to be acquired have different timestamps. Here, the timestamp may detect a timestamp corresponding to the shooting operation, or the timestamp may be a timestamp corresponding to when the first information is started to be generated. Here, the specific type of the timestamp may not be limited, and it is only necessary to limit that different timestamps can be used to indicate different images to be acquired.

[0126] In one embodiment, the first sub-information of the first information can be determined by the third functional layer and the first functional layer through a protocol, wherein the first sub-information indicates information about the task to be performed. The length of the field corresponding to the first sub-information can be less than the first length. And / or, the content complexity of the encoded content corresponding to the first sub-information can be less than the first threshold. Here, a simple first sub-information can be determined by the third functional layer and the first functional layer through a protocol. When the content of the first sub-information is simple and / or the field is short, the first functional layer can quickly determine through the protocol and the predetermined first sub-information that the first sub-information indicates information about the task to be performed, thereby performing related operations on the task to be performed. In this way, the information about the task to be performed can be transmitted from the third functional layer to the first functional layer without complex compilation of the first sub-information, thereby simplifying the process of compiling the first sub-information at the third functional layer and improving the efficiency of transmitting the first sub-information.

[0127] In one embodiment, Figure 5 As shown, the first information also indicates an image mode of the image to be acquired, and the method further includes:

[0128] Step S0051, in response to receiving the first information, in the first functional layer, determining the type of algorithm for processing the image according to the image mode; wherein different image modes correspond to different algorithm types.

[0129] Please note that, see Figure 3 The process of determining the type of algorithm for processing an image according to the image mode in the embodiment of the present disclosure can be understood as Figure 3 The process of algorithmic decision making.

[0130] In one embodiment, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the first image or the second image, and the first information further indicates an image mode of the image to be acquired. In response to receiving the first information, the first functional layer determines an algorithm type for processing the image according to the image mode; wherein different image modes correspond to different algorithm types. The third functional layer receives a processed image sent by the first functional layer in response to the first information; wherein the processed image is a processed first image or a processed second image.

[0131] Here, since the type of algorithm used to process the image can be determined according to the image mode, the type of algorithm used to process the image in the first functional layer can adapt to the image mode corresponding to the image. At this time, the processed image obtained after processing the image using the algorithm of the corresponding algorithm type in the first functional layer can also adapt to the image mode corresponding to the image. In this way, both the image processing process and the processing result can adapt to the image mode of the image.

[0132] In one embodiment, the image mode may refer to a scene mode in the process of capturing an image. Different capture parameters are used to capture images in different scene modes. The capture parameters may include at least one of the following: an aperture parameter, a focal length parameter, a light metering method parameter, a flash state parameter, and a shutter parameter.

[0133] In one embodiment, the image mode includes at least one of the following: portrait mode, night scene mode, dynamic mode, macro mode, backlight mode, blur mode, panoramic mode and landscape mode.

[0134] In one embodiment, the portrait mode may be a shooting mode for a portrait subject, in which the portrait subject can be highlighted. For example, in this shooting mode, a non-portrait area may be blurred to highlight the portrait subject.

[0135] In one embodiment, the night scene mode may be a shooting mode for subjects in night scenes, in which the brightness of the subjects in the night scenes can be enhanced. For example, in this shooting mode, the exposure time may be extended to enhance the brightness of the subjects in the night scenes.

[0136] In one embodiment, the dynamic mode may be a shooting mode for acquiring dynamic images, in which a dynamic image sequence can be formed. For example, in this shooting mode, at least two frames of images may be continuously acquired to obtain a dynamic image sequence (which may be output for display).

[0137] In one embodiment, the macro mode may be a shooting mode for a subject within a preset distance, where the preset distance is less than a distance threshold. Here, the macro mode may be understood as a shooting mode capable of shooting a subject at a close distance, in which the subject at a close distance may be clearly presented, for example, in which the subject may be magnified to clearly present the subject at a close distance.

[0138] In one embodiment, the backlight mode may be a shooting mode for a backlit subject, in which the backlit subject can be highlighted. For example, in this shooting mode, the backlit subject and the background may be separated to highlight the backlit subject.

[0139] In one embodiment, the blur mode may be a shooting mode for a subject, in which the subject can be highlighted. For example, in this shooting mode, the background area may be blurred to highlight the subject.

[0140] In one embodiment, the panoramic mode may be a shooting mode for an entire scene, in which a single-frame image for displaying the entire scene may be obtained. For example, in this shooting mode, at least two frames of images may be spliced ​​to obtain a single-frame image for displaying the entire scene.

[0141] In one embodiment, the landscape mode may be a shooting mode for scenery, which can clearly present scenery at different distances. For example, in this shooting mode, the depth of field effect corresponding to the scenery can be adjusted to clearly present scenery at different distances.

[0142] In one embodiment, the image mode can be determined according to the current display interface of the application when the shooting operation is detected. The application can be a camera application. Different display interfaces of the application correspond to different image modes. For example, the current display interface can be as follows: Figure 2 The first display interface or the second display interface shown in the figure, at this time, it can be determined that the image mode is the portrait mode. Figure 2 In the third display interface or the fourth display interface shown, at this time, it can be determined that the image mode is the night scene mode.

[0143] In one embodiment, the image mode may be determined according to the detected click operation on the second control. Different second controls correspond to different image modes.

[0144] Here, since the image mode is essentially determined according to the user's shooting operation or click operation, in the process of determining the type of algorithm used to process the image according to the image mode, the type of algorithm used to process the image in the first functional layer can adapt to the image mode determined by the user. At this time, the processed image obtained after processing the image using the algorithm of the corresponding algorithm type in the first functional layer can also adapt to the image mode determined by the user. In this way, both the image processing process and the processing result can adapt to the user's choice of image mode, and the user experience is good.

[0145] In one embodiment, in response to receiving the first information and the first information indicating that the image to be acquired is the first image, in the first functional layer, the type of algorithm for processing the first image is determined according to the image mode. In response to acquiring the first image in the first functional layer, the first image can be processed in the first functional layer according to the algorithm type corresponding to the first image to obtain the processed first image.

[0146] In one embodiment, in response to receiving the first information and the first information indicating that the image to be acquired is the second image, in the first functional layer, the type of algorithm for processing the second image is determined according to the image mode. In response to acquiring the second image in the first functional layer, the second image may be processed in the first functional layer according to the algorithm type corresponding to the second image to obtain the processed second image.

[0147] In one embodiment, Figure 6 As shown, the method also includes:

[0148] Step S0061, in response to receiving the first information, determining second information in the first functional layer according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to obtain a single frame of the first image or the second image;

[0149] Step S0062: the first functional layer sends the second information to the second functional layer;

[0150] Step S0063: The first functional layer receives a first number of the first images or the second images sent by the second functional layer in response to the second information.

[0151] In one embodiment, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be executed; the task is a task of acquiring a single frame of the first image or the second image, and the first information also indicates an image mode of the image to be acquired. In response to receiving the first information, the first functional layer determines second information according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single frame of the first image or the second image. The first functional layer sends the second information to the second functional layer. The first functional layer receives the first number of the first images or the second images sent by the second functional layer in response to the second information. The third functional layer receives the processed image sent by the first functional layer in response to the first information; wherein the processed image is the processed first image or the processed second image. It should be noted that, please refer to Figure 3 The process of determining the second information according to the image mode in the embodiment of the present disclosure can be understood as Figure 3 The process of task fission is carried out in Figure 3 As shown, the task n indicated by the first information can be split into subtasks to obtain a subtask queue.

[0152] Here, since in the first functional layer, the second information can be determined according to the image mode indicated by the first information, the second information is used to indicate the first number of subtasks to be executed, the subtask is the task obtained after the task indicated by the first information is fissioned, the task indicated by the first information is the task of acquiring a single-frame image, and each subtask is used to acquire the first image or the second image of a single frame. Therefore, on the one hand, the number of subtasks after fission can adapt to the image mode corresponding to the image to be acquired, thereby ensuring that the acquired image can meet the requirements for the image in the image mode. On the other hand, the process of fissioning the task indicated by the first indication information can be sunk to the first functional layer. At this time, the number of frames of the image that actually needs to be acquired can be determined in the first functional layer by determining the number of subtasks. In the third functional layer, only the simple task of acquiring a single-frame image needs to be sent to the first functional layer, and the third functional layer does not need to determine the number of frames of the image to be acquired. In this way, the load of the third functional layer can be reduced and the rate at which the third functional layer sends tasks can be increased.

[0153] In one embodiment, in response to receiving the first information and the first information indicating a task of acquiring a first image of a single frame, in the first functional layer, second information is determined according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire the first image of a single frame; the first functional layer sends the second information to the second functional layer; the first functional layer receives the first number of the first images sent by the second functional layer in response to the second information.

[0154] In one embodiment, in response to receiving the first information and the first information indicating a task of acquiring a second image of a single frame, the first functional layer determines second information according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire the second image of a single frame; the first functional layer sends the second information to the second functional layer; the first functional layer receives the first number of second images sent by the second functional layer in response to the second information.

[0155] In one embodiment, the computing power resources in the first functional layer may be greater than the computing power resources in the third functional layer.

[0156] In one embodiment, the first number may be at least two.

[0157] In one embodiment, in response to receiving the first information, in the first functional layer, second information is determined. The second information indicates a first number of subtasks to be executed, and the first number is at least two. The subtask is a task obtained after the task fission, and each subtask is used to obtain a single frame of the first image or the second image. The first functional layer sends the second information to the second functional layer. The first functional layer receives at least two frames of first images or at least two frames of second images sent by the second functional layer in response to the second information. In the first functional layer, for the at least two frames of first images received, image information in the at least two frames of first images is extracted and fused to obtain a processed first image; or, for the at least two frames of second images received, image information in the at least two frames of second images is extracted and fused to obtain a processed second image.

[0158] Here, for the image to be acquired, all simple tasks issued by the third functional layer can be uniformly fissioned in the first functional layer, and the simple task of acquiring a single-frame image issued by the third functional layer can be customized in the first functional layer into a complex task of acquiring multiple-frame images, and the image information in the acquired multiple-frame images can be fused to obtain a processed image. In this way, the information richness in the processed image can be improved, so that the image processing effect is good.

[0159] In the second functional layer, in response to receiving the second information, a first quantity of the first images or the second images is acquired from the image acquisition component according to the second information; and the second functional layer sends a first quantity of the first images or the second images to the first functional layer in response to the second information.

[0160] Here, since the second functional layer can obtain images from the image acquisition component according to the first quantity indicated in the second information after receiving the second information, the first functional layer only needs to send the task of obtaining images to the second functional layer, and the operation of obtaining images can be transferred to the second functional layer. In this way, the load of the first functional layer can be reduced.

[0161] In one embodiment, in the same image mode, multiple first information sent by the third functional layer can be received, and each first information indicates a task of acquiring a single frame image. In the first functional layer, for each first information, second information can be determined according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single frame of the first image or the second image. The first functional layer sends the second information to the second functional layer.

[0162] For example, Figure 3 As shown, in the same image mode, the second functional layer can receive n first information sent by the third functional layer, each of which is used to indicate a task of acquiring a single frame image. For task n indicated by the nth first information, the second information can be determined according to the image mode. At this time, task n will fission to generate a subtask queue, which includes at least two subtasks n1 and n2.

[0163] In one embodiment, Figure 7 As shown, the determining the second information according to the image mode includes:

[0164] Step S0071, in response to the image mode being the first mode, determining the first quantity to be single; wherein the information complexity of the processed image obtained in the first mode is less than a complexity threshold; or, in response to the image mode of the image being the second mode, determining the first quantity to be at least two; wherein in the second mode, the information complexity of the processed image obtained is greater than a complexity threshold.

[0165] In one embodiment, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the first image or the second image, and the first information also indicates an image mode of the image to be acquired. In response to receiving the first information, in the first functional layer, second information is determined according to the image mode; wherein the second information is used to indicate a first number of subtasks to be performed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single frame of the first image or the second image. In response to the image mode being the first mode, the first number is determined to be single; wherein the information complexity of the processed image obtained in the first mode is less than a complexity threshold; or, in response to the image mode of the image being the second mode, the first number is determined to be at least two; wherein the information complexity of the processed image obtained in the second mode is greater than a complexity threshold. The first functional layer sends the second information to the second functional layer. The first functional layer receives the first number of the first images or the second images sent by the second functional layer for the second information. The third functional layer receives a processed image sent by the first functional layer in response to the first information; wherein the processed image is the processed first image or the processed second image.

[0166] Here, the first number of acquired images can be substantially adapted to the information complexity of the processed images. Thus, in the process of processing the first number of images to obtain the processed images, the number of acquired images can meet the requirements of the processed images for information complexity, so that the information richness of the processed images meets the requirements.

[0167] In one embodiment, the information complexity is used to characterize the complexity of at least one of color features, texture features, shape features, and spatial features in an image.

[0168] In one embodiment, in response to the first information indicating the task of acquiring a single-frame first image and the image mode of the first image is the first mode, the first number of subtasks indicated by the second information is determined to be single at the first functional layer; wherein the information complexity of the processed first image obtained in the first mode is less than a complexity threshold; or, in response to the first information indicating the task of acquiring a single-frame first image and the image mode of the first image is the second mode, the first number is determined to be at least two at the first functional layer; wherein, in the second mode, the information complexity of the processed first image obtained is greater than a complexity threshold.

[0169] In one embodiment, in response to the first information indicating the task of acquiring a single-frame second image and the image mode of the second image is the first mode, the first number of subtasks indicated by the second information is determined to be single at the first functional layer; wherein the information complexity of the processed second image obtained in the first mode is less than a complexity threshold; or, in response to the first information indicating the task of acquiring a single-frame second image and the image mode of the second image is the second mode, the first number is determined to be at least two at the first functional layer; wherein, in the second mode, the information complexity of the processed second image obtained is greater than the complexity threshold.

[0170] In one embodiment, the first mode and / or the second mode may be pre-set image modes. For example, the panoramic mode and the dynamic mode may be pre-set as the second mode, and the portrait mode, the night scene mode, the macro mode, the backlight mode, the blur mode and the landscape mode may all be pre-set as the first mode.

[0171] In one embodiment, all image modes may be set to the second mode by default.

[0172] In one embodiment, the target image mode may be determined from the image modes according to the detected input operation of the user, and the target image mode may be adjusted from the second mode to the first mode.

[0173] In one embodiment, Figure 8 As shown, the performing of the first operation includes:

[0174] Step S0081: at the first functional layer, respectively processing a first number of the first images according to the type of algorithm used to process the first images, to obtain a first number of first images to be fused;

[0175] Step S0082: at the first functional layer, fuse a first number of the first images to be fused to obtain the processed first image.

[0176] Here, the processed first image may be obtained by fusing a first number of first images to be fused, so that the processed first image has high information richness.

[0177] In one embodiment, fusing the first number of the first images to be fused to obtain the processed first image includes: extracting and fusing image information of the first number of the first images to be fused to obtain image information of the processed first image.

[0178] In one embodiment, Figure 3 As shown, an asynchronous algorithm engine may be provided in the first functional layer, and the asynchronous algorithm engine is used to process the image using the algorithm type corresponding to the image.

[0179] In one embodiment, a first number of first images sent by a second functional layer may be received in a first functional layer through an asynchronous algorithm engine. In response to receiving any first image, a first operation may be performed on the received first image to obtain a processed first image to be fused. The first operation includes an operation of processing the first image. In response to completing the first operation on the first number of first images, the first number of first fused images are fused to obtain a processed first image.

[0180] In one embodiment, a first number of first images sent by a second functional layer may be received in a first functional layer through an asynchronous algorithm engine. In response to receiving all the first number of first images, a first operation may be performed. The first operation includes an operation of processing the first images.

[0181] In one embodiment, in response to the image mode corresponding to the first image being the third mode, the third functional layer sends a second number of first information to the first functional layer; the first information indicates a task of acquiring a single-frame first image. For each first information, in response to receiving the first information, the first functional layer determines second information according to the image mode; wherein the second information is used to indicate a first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single-frame first image. The first functional layer sequentially sends the second information corresponding to each first information to the second functional layer; the first functional layer receives the first number of first images sent by the second functional layer for each second information. In the first functional layer, for the first number of first images corresponding to each second information, the first number of first images are processed respectively according to the type of algorithm used to process the first image to obtain a first number of first images to be fused; the first number of first images to be fused are fused to obtain a second image to be fused corresponding to each second information; and the second number of second images to be fused are fused to obtain a processed first image.

[0182] In one embodiment, the third mode may be a panoramic mode or a dynamic mode.

[0183] In one embodiment, Fig. 9 As shown, the method also includes:

[0184] Step S0091: In response to receiving a first number of the second images, performing a third operation at the first functional layer to obtain the processed second images; wherein the third operation is used to process the second images.

[0185] In one embodiment, the third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; the task is a task of acquiring a single frame of the first image or the second image, and the first information also indicates an image mode of the image to be acquired. In response to receiving the first information, in the first functional layer, second information is determined according to the image mode; wherein the second information is used to indicate a first number of subtasks to be performed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single frame of the first image or the second image. The first functional layer sends the second information to the second functional layer. The first functional layer receives the first number of the first images or the second images sent by the second functional layer in response to the second information. In response to receiving the first number of the second images, the first functional layer performs a third operation to obtain the processed second image; wherein the third operation is used to process the second image. The third functional layer receives the processed second image sent by the first functional layer in response to the first information.

[0186] In one embodiment, the performing of the third operation includes: at the first functional layer, processing a first number of the second images respectively according to the type of algorithm used to process the second image, to obtain a first number of third images to be fused; at the first functional layer, fusing the first number of the third images to be fused, to obtain the processed second image. Here, the processed second image can be obtained by fusing the first number of the third images to be fused, so that the processed first image has high information richness.

[0187] In one embodiment, fusing the first number of the third images to be fused to obtain the processed second image includes: extracting and fusing image information of the first number of the third images to be fused to obtain image information of the processed second image.

[0188] In one embodiment, a first number of second images sent by a second functional layer may be received in a first functional layer through an asynchronous algorithm engine. In response to receiving any second image, a third operation may be performed on the received second image to obtain a processed third image to be fused. The third operation includes an operation of processing the second image. In response to completing the third operation on the first number of second images, the first number of third fused images are fused to obtain a processed second image.

[0189] In one embodiment, the first number of second images sent by the second functional layer can be received in the first functional layer through the asynchronous algorithm engine. In response to receiving all the first number of second images, a third operation can be performed, the third operation including an operation of processing the second images.

[0190] In one embodiment, in response to the image mode of the first image being consistent with the image mode of the second image, the asynchronous algorithm engine may serially execute a first operation and a third operation, wherein the first operation is an operation of processing the first image, and the third operation is an operation of processing the second image.

[0191] Exemplarily, the first number of first images sent by the second functional layer to the first functional layer may refer to Figure 3 The task 1 large image queue shown in the figure, the first number of second images sent by the second functional layer to the first functional layer may refer to Figure 3 The task n large image queue is shown. In the asynchronous algorithm engine, the images in the task 1 large image queue can be processed first, and after the images in the task 1 large image queue are processed, the images in the task n large image queue can be processed.

[0192] In one embodiment, in response to the image mode corresponding to the second image being the third preset mode, the third functional layer sends a second number of first information to the first functional layer; the first information indicates a task of acquiring a single-frame second image. For each first information, in response to receiving the first information, the first functional layer determines the second information according to the image mode; wherein the second information is used to indicate the first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to acquire a single-frame first image. The first functional layer sequentially sends the second information corresponding to each first information to the second functional layer; the first functional layer receives the first number of second images sent by the second functional layer for each second information. In the first functional layer, for the first number of second images corresponding to each second information, according to the type of algorithm used to process the second image, the first number of second images are processed respectively to obtain the first number of third images to be fused; the first number of third images to be fused are fused to obtain the fourth image to be fused corresponding to each second information; the second number of fourth images to be fused are fused to obtain the processed second image.

[0193] In one embodiment, Fig.10 As shown, the method also includes:

[0194] Step S1001: in response to the image mode corresponding to the first image and the image mode corresponding to the second image being inconsistent, executing the first operation and the third operation in parallel.

[0195] Here, in response to the inconsistency between the image mode corresponding to the first image and the image mode corresponding to the second image, the first operation and the third operation are performed in parallel. Therefore, when the image modes of the images processed twice are different, the first image and the second image in different image modes can be processed simultaneously, without waiting for the first image to be processed before switching to a different image mode to process the second image. In this way, asynchronous image processing can be performed on different image modes, thereby improving the image processing speed.

[0196] In one embodiment, Fig.11 As shown, an asynchronous algorithm engine is provided in the first functional layer, and the asynchronous algorithm engine is used to process the image using the algorithm type corresponding to the image. In one embodiment, a first number of first images or second images sent by the second functional layer can be received in the first functional layer through the asynchronous algorithm engine. After receiving the first image, a first operation can be performed. The first operation includes an operation of processing the first image. After receiving the second image, a third operation can be performed, and the third operation includes an operation of processing the second image.

[0197] In one embodiment, in response to receiving the second image in the asynchronous algorithm engine without stopping the execution of the first operation, the first operation and the third operation may be executed in parallel.

[0198] In one embodiment, see again Fig.11 A mode management unit is also provided in the first functional layer, and the mode management unit is used to manage the algorithm type corresponding to each image mode.

[0199] In one embodiment, the image mode includes an offline state and an active state, the offline state is a state of stopping acquiring images in the image mode, and the active state is a state of being able to acquire images in the image mode. Here, the image mode in the active state can also be understood as the current image mode managed by the mode management unit.

[0200] In one embodiment, the image mode corresponding to the first image is the first image mode, and the image mode corresponding to the second image is the second image mode. In response to the inconsistency between the first image mode and the second image mode, the current image mode can be switched from the first image mode to the second image mode in the mode management unit. At this time, the first image mode processes the offline state, and the second image mode is in the active state. In response to the first operation not being stopped in the asynchronous algorithm engine, the first operation and the third operation can be executed in parallel in the asynchronous algorithm engine. The first operation includes an operation of processing the first image, and the third operation includes an operation of processing the second image. Here, after the image mode is switched, the first image in the first image mode in the offline state and the second image in the second mode in the active state can still be processed in parallel. In this way, the efficiency of image processing can be improved. Exemplarily, the image mode corresponding to the first image can be Fig.11 The image mode 2 in the offline state shown in FIG. 1 , the image mode corresponding to the second image may be Fig.11 The active picture mode is shown in .

[0201] In one embodiment, in response to the image mode corresponding to the first image or the second image being in an active state and receiving the first information sent by the third functional layer, in the first functional layer, the second information is determined according to the image mode of the first image or the second image; wherein the second information is used to indicate the first number of subtasks to be executed; the subtasks are tasks obtained after the task fission, and each subtask is used to obtain a single frame of the first image or the second image; the first functional layer sends the second information to the second functional layer; the first functional layer receives the first number of the first images or the second images sent by the second functional layer for the second information. Here, when the image mode is in an active state, the first functional layer can send the second information indicating the task of obtaining the image to the second functional layer. That is, the first image or the second image can be obtained at this time.

[0202] In one embodiment, in response to the image mode corresponding to the first image or the second image being in an offline state, the second information is stopped from being determined according to the image mode of the first image or the second image. At this time, when the image mode is in an offline state, the first functional layer stops sending the second information indicating the task of acquiring the image to the second functional layer. That is, the first image or the second image cannot be acquired at this time.

[0203] In one embodiment, the first image or the second image received by the first functional layer is an image acquired by the second functional layer from the image acquisition component.

[0204] In one embodiment, the first number of the first images sent by the second functional layer and received by the first functional layer are the first images acquired by the second functional layer from the image acquisition component, and / or the first number of the second images sent by the second functional layer and received by the first functional layer are the second images acquired by the second functional layer from the image acquisition component.

[0205] In one embodiment, Fig.12 As shown, acquiring the first image includes:

[0206] Step S1201, in response to receiving the second information and the second information indicating that the image to be acquired is the first image, acquiring a first number of the first images from the image acquisition component according to the second information in the second functional layer;

[0207] In one embodiment, Fig.12 As shown, the method also includes:

[0208] Step S1202: In response to the second information, the second functional layer sends a first number of the first images to the first functional layer.

[0209] Here, since the second functional layer can obtain the first image from the image acquisition component according to the first quantity indicated in the second information after receiving the second information, the first functional layer only needs to send the task of obtaining the first image to the second functional layer, and the operation of obtaining the first image can be transferred to the second functional layer. In this way, the load of the first functional layer can be reduced.

[0210] In one embodiment, a second operation may be performed on the second functional layer, where the second operation includes an operation of acquiring a second image.

[0211] In one embodiment, Fig.13 As shown, performing the second operation at the second functional layer includes:

[0212] Step S1301: in response to receiving the second information and the second information indicating that the image to be acquired is the second image, the second functional layer acquires a first number of the second images from the image acquisition component according to the second information;

[0213] In one embodiment, Fig.13 As shown, the method also includes:

[0214] Step S1302: In response to the second information, the second functional layer sends a first number of the second images to the first functional layer.

[0215] Here, since the second functional layer can obtain the second image from the image acquisition component according to the first quantity indicated in the second information after receiving the second information, the first functional layer only needs to send the task of obtaining the second image to the second functional layer, and the operation of obtaining the second image can be transferred to the second functional layer. In this way, the load of the first functional layer can be reduced.

[0216] In one embodiment, Fig.14 As shown, the method also includes:

[0217] Step S1401: in response to receiving the second information, obtaining, at the second functional layer, a preview image of the first image or the second image; wherein the preview image has the same content as the first image or the second image, and a size of the preview image is smaller than a size of the first image or the second image;

[0218] Step S1402: Send the preview image to the third functional layer at the second functional layer.

[0219] Please note that, see Figure 3 and Fig.11 , where the preview image can be Figure 3 and / or Fig.11 The first image and the second image may be a small image sent by the second functional layer to the first functional layer. Figure 3 and / or Fig.11 The big picture in .

[0220] Here, since the preview image has the same content as the first image or the second image, and the size of the preview image is smaller than the size of the first image or the second image, the preview image is sent to the third functional layer at the second functional layer. Therefore, the unprocessed preview image with a smaller size can be directly sent from the second functional layer to the third functional layer. In this way, the unprocessed preview image can be quickly obtained before the real processed image is obtained, thereby improving the image return rate and bringing a good user experience.

[0221] In one embodiment, at the second functional layer, the preview image is forwarded to the third functional layer through the first functional layer.

[0222] In one embodiment, before sending the first image or the second image to the first functional layer, a first preview image of the first image or the second image may be sent to the third functional layer.

[0223] In one embodiment, the subtask is used to obtain a single frame of the first image and a single frame preview image corresponding to the first image; or, the subtask is used to obtain a single frame of the second image and a single frame preview image corresponding to the second image; the preview image is an image of a first size and / or an unprocessed image; the first size is smaller than the size of the first image and / or the second image; the preview image is an image for display on the electronic device.

[0224] Here, since the preview image is an image of a first size and / or an unprocessed image, the first size is smaller than the size of the first image and / or the second image; the preview image is an image for display on the electronic device, therefore, before obtaining the real processed image, the unprocessed preview image of a smaller size can be quickly displayed. In this way, the image return rate is increased, giving users a good experience.

[0225] In one embodiment, the content of the preview image and the first image or the second image may be the same.

[0226] In one embodiment, the size of the preview image may be a first size, and the size of the first image or the second image may be a second size. The second size may be a predetermined multiple of the first size. The predetermined multiple may be 5 times. Alternatively, the predetermined multiple may be 10 times.

[0227] In one embodiment, the first number of subtasks is used to obtain a first number of first images and a first number of preview images corresponding to the first images. Alternatively, the first number of subtasks is used to obtain a second number of second images and a first number of preview images corresponding to the second images.

[0228] In one embodiment, Fig.15 As shown, the method also includes:

[0229] Step S1501, the first functional layer receives a first number of preview images sent by the second functional layer in response to the second information;

[0230] Step S1502: at the first functional layer, determining a preview image corresponding to the task from the first number of preview images;

[0231] Step S1503: The first functional layer sends a preview image of the task to the third functional layer.

[0232] Please note that, see Fig.16 and Fig.17 , the first functional layer may store the received first number of preview images, at which time the first number of preview images may refer to Fig.16 and Fig.17 The preview queue in the first functional layer includes the preview result (i.e., preview image) returned by the third functional layer. The preview image of the corresponding task sent from the first functional layer to the third functional layer may refer to the small image (such as the small image) determined from the preview queue and returned to the third functional layer. Fig.16 and Fig.17 shown).

[0233] Here, since the preview image is a preview image of the corresponding task determined by the first functional layer from the first number of preview images, only the preview image of the corresponding task determined can be sent to the third functional layer, and not all preview images are sent to the third functional layer. In this way, the number of preview images to be previewed in the third functional layer in the same task can be reduced, and the preview image corresponding to a task can be more intuitively displayed to the user, thereby improving the user experience.

[0234] In one embodiment, a preview image of the corresponding task may be displayed using the third functional layer.

[0235] In one embodiment, in the second functional layer, in response to receiving the second information and the second information indicating that the image to be acquired is the first image, in the second functional layer, a first number of first images and a first number of first preview images corresponding to the first images are acquired; wherein the first preview images have the same content as the first images, and the size of the first preview images is smaller than the size of the first images; in the second functional layer, the first number of first images and the first number of first preview images are sent to the first functional layer. The first preview images are images used to preview the first images.

[0236] In one embodiment, at the first functional layer, a first number of first images and a first number of first preview images corresponding to the first images sent by the second functional layer for the second information are received; wherein the first preview images have the same content as the first images; the size of the first preview images is smaller than the size of the first images; at the first functional layer, a preview image corresponding to a task is determined from the first number of first preview images; at the first functional layer, the preview image corresponding to the task is sent to the third functional layer. Here, the task, such as Fig.16 and Fig.17 As shown, it may refer to a simple photographing task sent by the third functional layer to the first functional layer, and the simple photographing task may be used to acquire the first image.

[0237] In one embodiment, in the second functional layer, in response to receiving the second information and the second information indicating that the image to be acquired is the second image, a first number of second images and a first number of second preview images corresponding to the second images are acquired in the second functional layer; wherein the second preview image and the second image have the same content, and the size of the second preview image is smaller than the size of the second image; the second functional layer sends the first number of second images and the first number of second preview images to the first functional layer. The second preview images are preview images used to preview the second images.

[0238] In one embodiment, the first functional layer receives a first number of second images and a first number of second preview images corresponding to the second images sent by the second functional layer for the second information; wherein the second preview images have the same content as the second images; the size of the second preview images is smaller than the size of the second images; at the first functional layer, a preview image of a corresponding task is determined from the first number of second preview images; at the first functional layer, the preview image of the corresponding task is sent to the third functional layer. Here, the task, such as Fig.16 and Fig.17 As shown, it may refer to a simple photographing task sent by the third functional layer to the first functional layer, and the simple photographing task may be used to obtain the second image.

[0239] In one embodiment, before the first functional layer sends the processed image to the third functional layer, the first functional layer sends a preview image to the third functional layer. The preview image may be an unprocessed image. Here, the preview image is an unprocessed image, which may also be understood as an image that has not been processed by any of the asynchronous algorithm engines described in the embodiments of the present disclosure.

[0240] like Fig.18 The present disclosure provides an image acquisition device, the device comprising:

[0241] Processing module 181, the processing module is used to: in response to detecting a first shooting operation, acquire a first image and perform a first operation; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation, perform the first operation and the second operation in parallel; the second operation includes an operation of acquiring a second image.

[0242] Fig.19 6 is a block diagram of an electronic device 600 according to an exemplary embodiment. The disclosed method can be applied to the electronic device.

[0243] Reference Fig.19, the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .

[0244] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0245] The memory 604 is configured to store various types of data to support operations on the device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0246] The power supply component 606 provides power to the various components of the electronic device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.

[0247] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0248] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operation mode, such as a call mode, a recording mode, and a voice determination mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.

[0249] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0250] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the device 600, the relative positioning of components, such as the display and keypad of the electronic device 600, and the sensor assembly 614 can also detect the position change of the electronic device 600 or a component of the electronic device 600, the presence or absence of contact between the user and the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and the temperature change of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0251] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency determination (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0252] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0253] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the instructions can be executed by the processor 820 of the electronic device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0254] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed in this disclosure.

[0255] It will be appreciated that the present invention is not limited to the exact construction that has been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof.

Claims

1. An image processing method, characterized in that: The method comprises: In response to detecting a first shooting operation, acquiring a first image and performing a first operation; wherein the first operation includes an operation of processing the first image; In response to detecting a second photographing operation, the first operation and the second operation are performed in parallel; wherein the second operation includes an operation of acquiring a second image.

2. The method according to claim 1, characterized in that The performing the first operation and the second operation in parallel includes: In response to obtaining a preview image corresponding to the first image, the first operation and the second operation are performed in parallel; wherein the size of the preview image of the first image is smaller than the size of the first image, and / or the preview image of the first image is an unprocessed image; and the preview image of the first image is used to preview the processed first image.

3. The method according to claim 1, characterized in that The method is applied to an electronic device, which performs image processing and / or image transmission operations in a functional layer. The functional layer of the electronic device includes a first functional layer and a second functional layer. The first functional layer is used to process images, and the second functional layer is used to acquire images from an image acquisition component of the electronic device; the image includes the first image and the second image; the first operation is performed in the first functional layer, and the second operation is performed in the second functional layer.

4. The method according to claim 3, characterized in that The functional layer of the electronic device further includes a third functional layer, and the method further includes: The third functional layer sends first information to the first functional layer; wherein the first information indicates information of a task to be performed; and the task is a task of acquiring a single frame of the first image or the second image; The third functional layer receives a processed image sent by the first functional layer in response to the first information; wherein the processed image is the processed first image or the processed second image.

5. The method according to claim 4, characterized in that The first information further indicates an image mode of the image to be acquired, and the method further includes: In response to receiving the first information, in the first functional layer, an algorithm type for processing the image is determined according to the image mode; wherein different image modes correspond to different algorithm types.

6. The method according to claim 5, characterized in that The method further comprises: In response to receiving the first information, in the first functional layer, second information is determined according to the image mode; wherein the second information indicates a first number of subtasks to be performed; the subtasks are tasks obtained after the task fission, and each subtask is used to obtain a single frame of the first image or the second image; The first functional layer sends the second information to the second functional layer; The first functional layer receives a first number of the first images or the second images sent by the second functional layer in response to the second information.

7. The method according to claim 6, characterized in that The determining the second information according to the image mode includes: In response to the image mode being a first mode, determining the first number to be a single number; wherein the information complexity of the processed image obtained in the first mode is less than a complexity threshold; the information complexity is used to characterize the complexity of at least one of a color feature, a texture feature, a shape feature, and a spatial feature in the image; or, In response to the image mode of the image being a second mode, the first number is determined to be at least two; wherein, in the second mode, the information complexity of the processed image obtained is greater than a complexity threshold.

8. The method according to claim 7, characterized in that The performing of the first operation includes: At the first functional layer, according to the type of algorithm used to process the first images, a first number of the first images are processed respectively to obtain a first number of first images to be fused; At the first functional layer, a first number of the first images to be fused are fused to obtain the processed first image.

9. The method according to claim 6, characterized in that The method further comprises: In response to receiving a first number of the second images, a third operation is performed at the first functional layer to obtain the processed second images; wherein the third operation is used to process the second images.

10. The method according to claim 9, characterized in that The method further comprises: In response to the image mode corresponding to the first image and the image mode corresponding to the second image being inconsistent, the first operation and the third operation are performed in parallel.

11. The method according to claim 6, characterized in that The first image or the second image received by the first functional layer is an image acquired by the second functional layer from the image acquisition component.

12. The method according to claim 6, characterized in that The subtask is used to obtain the first image of a single frame and a preview image of a single frame corresponding to the first image; or, the subtask is used to obtain the second image of a single frame and a preview image of a single frame corresponding to the second image; the preview image is an image of a first size and / or an unprocessed image; The first size is smaller than the size of the first image and / or the second image; the preview image is an image used for display on the electronic device.

13. The method according to claim 12, characterized in that The method further comprises: The first functional layer receives a first number of preview images sent by the second functional layer in response to the second information; At the first functional layer, determining a preview image corresponding to the task from the first number of preview images; The first functional layer sends a preview image of the task to the third functional layer.

14. The method according to any one of claims 4 to 13, characterized in that The image mode includes at least one of the following: portrait mode, night scene mode, dynamic mode, macro mode, backlight mode, blur mode, panoramic mode and landscape mode.

15. An image acquisition device, characterized in that: The device comprises: A processing module, the processing module is used to: in response to detecting a first shooting operation, acquire a first image and perform a first operation; wherein the first operation includes an operation of processing the first image; in response to detecting a second shooting operation, perform the first operation and the second operation in parallel; the second operation includes an operation of acquiring a second image.

16. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: implement the method described in any one of claims 1 to 14 when running the executable instructions.

17. A computer-readable storage medium, characterized in that: The readable storage medium stores an executable program, wherein the executable program implements the method according to any one of claims 1 to 14 when executed by a processor.

Images