An image processing method and an electronic device

By acquiring the original image data of multiple frames with different exposure time and the current system power consumption, selecting the appropriate exposure type according to the preset exposure type sorting list, image processing of the original image data, and generating shooting images with high brightness satisfaction, solving the problems of poor shooting effects and low shooting intelligence in the existing technology, and achieving efficient image processing and intelligent shooting.

CN116095454BActive Publication Date: 2025-07-01伟光有限公司(CN)
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111275993.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-29
Publication Date
2025-07-01
Estimated Expiration
2041-10-29

AI Technical Summary

Technical Problem

When the existing continuous shooting technology is not satisfied with the brightness of multiple images, the next round of continuous shooting operation is required, resulting in shifting of the subject and changing the shooting environment, which leads to poor shooting effect and low shooting intelligence.

Method used

By acquiring the original image data of multiple frames of different exposure time and the current system power consumption, selecting the appropriate exposure type according to the preset exposure type sorting list, image processing of the original image data, and generating a captured image with high brightness satisfaction.

Benefits of technology

It realizes instant shooting of images with high brightness satisfaction, improving shooting effect and shooting intelligence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116095454B_ABST
    Figure CN116095454B_ABST
Patent Text Reader

Abstract

An embodiment of the present application provides an image processing method and an electronic device, including: obtaining multi-frame original image data with different exposure durations and the current system power consumption; sequentially selecting at least one exposure type from a preset exposure type sorting list according to the current system power consumption; the preset exposure type sorting list includes the sorting result based on historical selections, the exposure type corresponding to each exposure duration, and the exposure merging type corresponding to multiple exposure durations; determining at least one frame of original image data to be processed based on the at least one exposure type and the multi-frame original image data; and performing image processing on the at least one frame of original image data to be processed to obtain at least one captured image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of image processing, and in particular, to an image processing method and an electronic device. Background Art

[0002] Currently, continuous shooting functions are set on shooting devices such as mobile phones and cameras. During continuous shooting, each time the shooting device takes a photo, it encodes the captured image and saves the encoded image to the cache. After completing this round of continuous shooting operations, it displays the image with the highest clarity and saves the other images in the cache.

[0003] However, the current continuous shooting technology generates multiple frames of pictures based on the time dimension. If the user is not satisfied with the brightness of the multiple captured images, a new round of continuous shooting operations is required. During the new round of continuous shooting operations, the shooting object may shift, and the shooting environment may also change, resulting in poor shooting effects and low shooting intelligence. Summary of the Invention

[0004] Embodiments of this application provide an image processing method and an electronic device, which can improve shooting effects and shooting intelligence.

[0005] The technical solution of this application is implemented as follows:

[0006] In a first aspect, an embodiment of this application proposes an image processing method, which includes:

[0007] Obtain multiple frames of original image data with different exposure durations and the current system power consumption;

[0008] According to the current system power consumption, sequentially select at least one exposure type from a preset sorted list of exposure types; the preset sorted list of exposure types includes the sorting results of the exposure types corresponding to each exposure duration and the exposure merging types corresponding to multiple exposure durations based on historical selections;

[0009] Based on the at least one exposure type and the multiple frames of original image data, determine at least one frame of original image data to be processed; and perform image processing on the at least one frame of original image data to obtain at least one captured image.

[0010] In a second aspect, an embodiment of this application proposes an electronic device, which includes: a sensor, a power consumption detection unit, an image processing chip connected to the sensor and the power consumption detection unit, and an application processing chip connected to the image processing chip;

[0011] The sensor is configured to collect multiple frames of original image data based on multiple exposure durations;

[0012] The image processing chip is configured to sequentially select at least one exposure type from a preset sorted exposure type list according to the current system power consumption; the preset sorted exposure type list includes a sorting result of exposure types corresponding to each exposure duration and exposure merging types corresponding to multiple exposure durations based on historical selections; determine at least one frame of original image data to be processed based on the at least one exposure type and the multiple frames of original image data;

[0013] The application processing chip and the image processing chip are further configured to perform image processing on the at least one frame of original image data to be processed to obtain at least one captured image.

[0014] An embodiment of the present application provides an image processing method and an electronic device. The method includes: obtaining multiple frames of original image data with different exposure durations and the current system power consumption; sequentially selecting at least one exposure type from a preset sorted exposure type list according to the current system power consumption; the preset sorted exposure type list includes a sorting result of exposure types corresponding to each exposure duration and exposure merging types corresponding to multiple exposure durations based on historical selections; determining at least one frame of original image data to be processed based on the at least one exposure type and the multiple frames of original image data; and performing image processing on the at least one frame of original image data to be processed to obtain at least one captured image. By adopting the above implementation solution, the present application pre-sorts multiple exposure types based on historical selections to generate a preset sorted exposure type list. After collecting multiple frames of original image data corresponding to multiple exposure durations, at least one frame of original image data is determined based on the current system power consumption, the preset sorted exposure type list, and the multiple frames of original image data. The at least one frame of original image data is the original image data with high satisfaction in terms of brightness, and can immediately capture a captured image with high brightness satisfaction, thereby improving the shooting effect and shooting intelligence. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a flowchart of an image processing method provided by an embodiment of the present application;

[0016] Figure 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0017] Figure 3 is a structural flow of an exemplary image processing solution provided by an embodiment of the present application Figure 1 ;

[0018] Figure 4 is a structural flow of an exemplary image processing solution provided by an embodiment of the present application Figure 2 ;

[0019] Figure 5Schematic diagram of an exemplary image processing process based on a preset exposure type sorted list and current power consumption provided by an embodiment of the present application;

[0020] Figure 6 Schematic diagram of an exemplary image processing process based on a preset exposure type sorted list and current power consumption provided by an embodiment of the present application. Detailed implementation manners

[0021] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0022] An embodiment of the present application provides an image processing method. As Figure 1 shown, the method may include:

[0023] S101. Obtain original image data of multiple frames with different exposure durations and the current system power consumption.

[0024] An image processing method proposed by an embodiment of the present application is applicable to a scenario of continuous photographing.

[0025] In an embodiment of the present application, the electronic device for image processing may be any device with photographing and data processing functions, such as: tablet computers, mobile phones, personal computers (Personal Computer, PC), laptop computers, cameras, wearable devices and other photographing devices. Among them, the electronic device includes at least a sensor, an image processing chip and an application processing chip.

[0026] In an example of the present application, when the sensor of the electronic device is in the (High Dynamic Range, HDR) mode, a shooting instruction is received, and multiple frames of original image data are collected based on multiple exposure durations.

[0027] In an embodiment of the present application, the multiple exposure durations may be divided into three exposure durations: long exposure, medium exposure and short exposure according to the exposure time. Specifically, it may be divided according to the actual situation, and the embodiment of the present application does not make specific limitations.

[0028] In an embodiment of the present application, the sensor of the electronic device collects different original image data, that is, RAW data, based on different exposure durations; for example, RAW L data is collected based on long exposure, RAW M data is collected based on medium exposure, and RAW S data is collected based on short exposure.

[0029] In an embodiment of the present application, the electronic device may further include a power consumption detection unit. After the sensor of the electronic device has collected multiple frames of original image data at all multiple exposure durations, the current system power consumption is obtained from the power consumption detection unit.

[0030] In the embodiments of the present application, after multiple frames of original image data are collected, the image processing chip further determines multiple preprocessing parameters according to multiple exposure durations; and uses the multiple preprocessing parameters to preprocess the multiple frames of original image data respectively, so as to obtain the preprocessed multiple frames of original image data.

[0031] It should be noted that when the multiple exposure durations include long exposure, the multiple preprocessing parameters include the sharpening parameters corresponding to the long exposure; when the multiple exposure durations include short exposure, the multiple preprocessing parameters include the noise reduction parameters corresponding to the short exposure.

[0032] Specifically, based on the sharpening parameters, the original image data collected according to the long exposure is preprocessed; based on the noise reduction parameters, the original image data collected according to the short exposure is preprocessed; and the preprocessed multiple frames of original image data are obtained.

[0033] It should be noted that multiple preprocessing parameters can be preconfigured in the image processing chip according to the actual situation. The above-mentioned noise reduction parameters and sharpening parameters are only an optional set of preprocessing parameters provided by the embodiments of the present application, and can be specifically selected according to the characteristics of different exposure types, which are not specifically limited in the embodiments of the present application.

[0034] S102. Select at least one exposure type in sequence from a preset sorted list of exposure types according to the current system power consumption; the preset sorted list of exposure types includes the sorting results of the exposure types corresponding to each exposure duration and the exposure merging types corresponding to multiple exposure durations based on historical selections.

[0035] In the embodiments of the present application, according to the current system power consumption, the first quantity of the original image data to be processed is determined; wherein, the current system power consumption is inversely proportional to the first quantity, that is, the greater the current system power consumption, the smaller the first quantity.

[0036] In the embodiments of the present application, multiple system power consumption intervals are preset, and each system power consumption interval corresponds to a quantity of the original image data to be processed, where the number of system power consumption intervals can be selected according to the actual situation and is not specifically limited in the embodiments of the present application. The current system power consumption is compared with the multiple system power consumption intervals respectively. When the current system power consumption is within one of the system power consumption intervals, the quantity corresponding to the one system power consumption interval is determined as the first quantity.

[0037] Exemplarily, a first power consumption threshold and a second power consumption threshold are preset, where the first power consumption threshold is less than the second power consumption threshold. When the current system power consumption is less than the first power consumption threshold, that is, in the interval [0, first power consumption threshold), the first quantity of the original images to be processed is 4; when the current system power consumption is greater than or equal to the first power consumption threshold and less than the second power consumption threshold, that is, in the interval [first power consumption threshold, second power consumption threshold), the first quantity of the original images to be processed is 2; when the current system power consumption is greater than or equal to the second power consumption threshold, that is, in the interval [second power consumption threshold, +∞), the first quantity of the original images to be processed is 1.

[0038] In the embodiments of the present application, according to the user's historical image preference selection, a preset exposure type sorting list is pre-generated. After determining the first quantity of the original image data to be processed, at least one exposure type is sequentially selected from the preset exposure type sorting list according to the first quantity. Specifically, the process of generating the preset exposure type sorting list includes: in each round of historical shooting process, multiple historical exposure images corresponding to multiple exposure durations and a historical fusion image composed of the multiple historical exposure images are respectively output; according to the historical selection and sorting operation on the multiple historical exposure images and the historical fusion image, the sorting order of the exposure type corresponding to each exposure duration and the exposure merging type corresponding to the multiple exposure durations is determined; wherein, each historical exposure image corresponds to the exposure type corresponding to each exposure duration, and the historical fusion image corresponds to the exposure merging type; according to the sorting order of the exposure type corresponding to each exposure duration and the exposure merging type corresponding to the multiple exposure durations, a preset exposure type sorting list is generated.

[0039] Exemplarily, in the process of generating the preset exposure type sorting list, the electronic device respectively outputs a long exposure image, a medium exposure image, a short exposure image, and a fused exposure image, and the user sorts the above four output images. The electronic device determines the sorting method of the exposure types corresponding to the above four output images according to the user's sorting; after multiple shootings, the user's exposure type preference can be determined according to the user's sorting of each output image. At this time, a preset exposure type sorting list can be generated based on the user's exposure type preference.

[0040] Exemplarily, if the storage form of the preset exposure type sorting list is: exposure merging type, long exposure type, medium exposure type, and short exposure type, when the first quantity is determined to be 2 according to the current system power consumption, select the exposure merging type and the long exposure type from the preset exposure type sorting list in sequence; when the first quantity is determined to be 1 according to the current system power consumption, select the exposure merging type from the preset exposure type sorting list; when the first quantity is determined to be 4 according to the current system power consumption, select the exposure merging type, the long exposure type, the medium exposure type, and the short exposure type from the preset exposure type sorting list in sequence.

[0041] It should be noted that during the process of generating the preset exposure type sorting list, the contrast information and brightness information of historical exposure images and historical fusion images can also be saved. Specifically, it can be selected according to the actual situation, and the embodiments of the present application do not make specific limitations.

[0042] S103. Based on at least one exposure type and multi-frame original image data, determine at least one frame of original image data to be processed; and perform image processing on at least one frame of original image data to be processed to obtain at least one captured image.

[0043] In the embodiments of the present application, since S101 also includes preprocessing the multi-frame original image data by using preprocessing parameters to obtain the preprocessed multi-frame original image data, therefore, at this time, at least one frame of original image data to be processed can be determined based on at least one exposure type and the preprocessed multi-frame original image data.

[0044] It should be noted that if the exposure merging type is included in at least one exposure type, the original image data to be processed includes the fused original image data. At this time, it is necessary to fuse the multi-frame original image data into the fused original image data. Among them, the process of fusing the multi-frame original image data into the fused original image data can be implemented on an image processing chip or an application processing chip.

[0045] In the embodiments of the present application, an image processing chip and / or an application processing chip can be used to perform image processing on at least one frame of original image data to be processed to obtain at least one captured image. When the process of fusing the multi-frame original image data into the fused original image data is implemented on the application processing chip, the application processing chip is used to perform image processing on the fused original image data.

[0046] Further, after performing image processing on at least one frame of raw image data to be processed to obtain at least one captured image, receive a selection and sorting operation on the at least one captured image, and sort the at least one captured image according to the selection and sorting operation to obtain the at least one sorted captured image; update a preset exposure type sorting list by using at least one exposure type corresponding to the at least one sorted captured image.

[0047] It can be understood that in this application, multiple exposure types are sorted in advance based on historical selections to generate a preset exposure type sorting list. After collecting multiple frames of raw image data corresponding to multiple exposure durations, at least one frame of raw image data is determined based on the current system power consumption, the preset exposure type sorting list, and the multiple frames of raw image data. The at least one frame of raw image data is raw image data with high satisfaction in terms of brightness, and can instantly capture captured images with high brightness satisfaction, thereby improving the shooting effect and shooting intelligence.

[0048] Based on the above embodiments, an embodiment of this application provides an electronic device 1, as Figure 2 shown. The device 1 includes: a sensor 10, a power consumption detection unit 11, an image processing chip 12 connected to the sensor 10 and the power consumption detection unit 11, and an application processing chip 13 connected to the image processing chip 12;

[0049] The sensor 10 is configured to obtain multiple frames of raw image data with different exposure durations;

[0050] The power consumption detection unit 11 is configured to obtain the current system power consumption;

[0051] The image processing chip 12 is configured to sequentially select at least one exposure type from the preset exposure type sorting list according to the current system power consumption; the preset exposure type sorting list includes the sorting results of the exposure types corresponding to each exposure duration and the exposure merging types corresponding to multiple exposure durations based on historical selections; based on the at least one exposure type and the multiple frames of raw image data, determine at least one frame of raw image data to be processed;

[0052] The application processing chip 13 and the image processing chip 12 are further configured to perform image processing on the at least one frame of raw image data to be processed to obtain at least one captured image.

[0053] Optionally, the image processing chip 12 is further configured to determine a first quantity of the raw image data to be processed according to the current system power consumption; and sequentially select the at least one exposure type from the preset exposure type sorting list according to the first quantity.

[0054] Optionally, the application processing chip 13 is further configured to receive a selection and sorting operation on the at least one captured image; sort the at least one captured image according to the selection and sorting operation to obtain at least one sorted captured image;

[0055] The image processing chip 12 is further configured to update the preset exposure type sorting list by using at least one exposure type corresponding to the at least one sorted captured image.

[0056] Optionally, the image processing chip 12 is further configured to determine a plurality of preprocessing parameters according to the plurality of exposure durations; use the plurality of preprocessing parameters to respectively preprocess the plurality of frames of original image data to obtain the preprocessed plurality of frames of original image data; based on the at least one exposure type and the preprocessed plurality of frames of original image data, determine the at least one frame of original image data to be processed.

[0057] Optionally, the exposure durations include long exposure, medium exposure, and short exposure. When the plurality of exposure durations include the long exposure, the plurality of preprocessing parameters include the sharpening parameters corresponding to the long exposure; when the plurality of exposure durations include the short exposure type, the plurality of preprocessing parameters include the noise reduction parameters corresponding to the short exposure.

[0058] Optionally, the application processing chip 13 is further configured to respectively output a plurality of historical exposure images corresponding to the plurality of exposure durations and a historical fusion image composed of the plurality of historical exposure images during each round of historical shooting;

[0059] The image processing chip 12 is further configured to determine the arrangement order of the exposure type corresponding to each exposure duration and the exposure merging type corresponding to the plurality of exposure durations according to the historical selection and sorting operation on the plurality of historical exposure images and the historical fusion image; each historical exposure image corresponds to the exposure type corresponding to each exposure duration, and the historical fusion image corresponds to the exposure merging type; generate the preset exposure type sorting list according to the arrangement order of the exposure type corresponding to each exposure duration and the exposure merging type corresponding to the plurality of exposure durations.

[0060] Optionally, the application processing chip 13 and / or the image processing chip 12 is further configured to perform image processing on the at least one frame of original image data to be processed to obtain at least one frame of image data;

[0061] The application processor chip 12 is further configured to perform post-processing on the at least one frame of image data to obtain at least one captured image.

[0062] In an embodiment of the present application, an image processing chip is disposed between application processing chips of sensors of an electronic device. Different preprocessing parameters can be set in the image processing chip for different exposure durations. After the sensor collects multiple frames of raw image data based on multiple exposure durations, the image processing chip can preprocess the multiple frames of raw image data respectively based on the multiple preprocessing parameters to obtain the preprocessed multiple frames of raw image data.

[0063] Optionally, the exposure durations may include long exposure, medium exposure, and short exposure; the preprocessing parameters include a sharpening parameter corresponding to the long exposure and a noise reduction parameter corresponding to the short exposure;

[0064] The image processing chip is further configured to preprocess the raw image data collected according to the long exposure based on the sharpening parameter; preprocess the raw image data collected according to the short exposure based on the noise reduction parameter; and obtain the preprocessed multiple frames of raw image data.

[0065] Optionally, the sensor is further configured to collect multiple frames of raw image data based on multiple exposure durations in a high dynamic range mode.

[0066] It should be noted that if at least one frame of raw image data to be processed includes a fused raw image, the multiple frames of raw image data need to be fused in the application processing chip and / or the image processing chip to obtain the fused raw image. At this time, the application processing chip and / or the image processing chip includes an HDR module for fusion.

[0067] It should be noted that the process of determining at least one frame of raw image data to be processed using the multiple frames of raw image data refers to S103 and will not be elaborated here.

[0068] In an embodiment of the present application, the image processing process of at least one frame of raw image data can be executed in the image processing chip, or can be executed in the application processing chip, or at least one frame of raw image data can be divided into two parts, and the image processing process of one part is executed in the image processing chip and the image processing process of the other part is executed in the application processing chip. Specifically, the corresponding image processing process can be executed by setting an ISP module in the image processing chip and / or the application processing chip.

[0069] Optionally, the image processing chip is further configured to perform image processing on the first raw image data in at least one frame of raw image data to obtain first image data in YUV format; and transmit the second raw image data and the first image data to the application processing chip, where the second raw image data is the raw image data in the at least one frame of raw image data other than the first raw image data;

[0070] The application processing chip is further configured to perform image processing on the second original image data to obtain second image data in the YUV format; and perform post-processing on the first image data in the YUV format and the second image data in the YUV format to obtain the at least one captured image; the first image data in the YUV format and the second image data in the YUV format are at least one frame of image data in the YUV format.

[0071] It can be understood that the image processing chip only transmits the second original image data and the first image data that need to be processed by the application processing chip to the application processing chip, and does not transmit the original image data that does not need to be processed, thereby reducing the amount of data transmission and further reducing the system power consumption.

[0072] The embodiment of the present application is a scenario where an ISP module is provided in both the image processing chip and the application processing chip.

[0073] Exemplarily, if the number of at least one frame of original image data to be processed is 4, the corresponding image processing solution is as Figure 3 shown. When the sensor is in the HDR mode and the user triggers a photo, the sensor acquires RAW L based on long exposure, RAW M based on medium exposure, and RAW S based on short exposure, and then transmits RAW L, RAW M, and RAW S to the image processing chip. After the preprocessing unit of the image processing chip preprocesses RAW L, RAW M, and RAW S, the ISP unit inside the image processing chip performs image processing on RAW S and RAW L to obtain YUV S and YUV L; the HDR unit inside the image processing chip fuses RAW S, RAW M, and RAW L to obtain RAW F. Then, the image processing chip transmits YUV S, YUV L, RAW M, and RAW F to the application processing chip side. The application processing chip uses the internal ISP unit to perform image processing on RAW M and RAW F to obtain YUV M and YUV F; the application processing chip uses the internal post-processing unit to perform post-processing on YUV L, YUV M, YUV S, and YUV F to obtain 4 captured images of different exposure types.

[0074] Exemplarily, if the number of at least one frame of original image data to be processed is 2, the corresponding image processing solution is as Figure 4As shown in the figure, when using an HDR sensor, when the user triggers a photo, the sensor acquires RAW L based on long exposure, RAW M based on medium exposure, and RAW S based on short exposure. Then, RAW L, RAW M, and RAW S are transmitted to the image processing chip. After the image processing chip preprocesses RAW L, RAW M, and RAW S, the ISP unit inside the image processing chip performs image processing on RAW L to obtain YUV L; the HDR unit inside the image processing chip fuses RAW S, RAW M, and RAW L to obtain RAW F. Then, the image processing chip transmits YUV L and RAW F to the application processing chip side. The application processing chip uses the internal ISP unit to perform image processing on RAW F to obtain YUV F; the application processing chip uses the internal post-processing unit to perform post-processing on YUV L and YUV F to obtain two captured images of different exposure types.

[0075] Based on the above embodiments, an embodiment of the present application proposes a schematic diagram for generating a sorted list of preset exposure types, as Figure 5 shown

[0076] S501. The image processing chip receives the three frames of RAW data, namely RAW L, RAW M, and RAW S, output by the sensor, and preprocesses the three frames of RAW data of RAW L, RAW M, and RAW S.

[0077] S502. The fusion module in the image processing chip fuses RAW L, RAW M, and RAW S into one frame of RAW F.

[0078] S503. The image processing chip performs ISP processing on RAW L and RAW S to obtain YUV S and YUV L; and performs fusion processing on RAW L, RAW M, and RAW S to obtain RAW F.

[0079] S504. The image processing chip transmits RAW M, RAW F, YUV S, and YUV L to the application processing chip.

[0080] S505. The application processing chip performs post-processing on YUV S and YUV L, and performs ISP processing and post-processing on RAW M and RAW F to obtain four captured images.

[0081] S506. Display the four generated captured images on the display interface, and determine the arrangement order of the long exposure type, medium exposure type, short exposure type, and exposure merge type according to the user's selection operation on the four captured images.

[0082] S507. Generate a sorted list of preset exposure types based on the arrangement order.

[0083] Based on the above embodiments, an embodiment of the present application proposes a schematic diagram of an image processing process executed based on a preset exposure type sorting list and the current power consumption, as Figure 6 shown

[0084] S601. The image processing chip receives three frames of RAW data, namely RAW L, RAW M, and RAW S, output by the sensor, and preprocesses the three frames of RAW data of RAW L, RAW M, and RAW S.

[0085] S602. The image processing chip obtains the current system power consumption from the power consumption module;

[0086] S603. If it is determined that the current system power consumption is lower than the first power consumption threshold, the image processing chip performs ISP processing on RAW L and RAW S to obtain YUV S and YUV L; and fuses RAW L, RAW M, and RAW S to obtain RAW F.

[0087] S604. The image processing chip transmits RAW M, RAW F, YUV S, and YUV L to the application processing chip.

[0088] S605. The application processing chip performs post-processing on YUV S and YUV L, and performs ISP processing and post-processing on RAW M and RAW F to obtain 4 captured images.

[0089] S606. If it is determined that the current system power consumption is not lower than the first power consumption threshold, it is determined whether the current system power consumption is higher than the second power consumption threshold;

[0090] S607. If the current system power consumption is higher than the second power consumption threshold, the image processing chip fuses RAW L, RAW M, and RAW S to obtain RAW F.

[0091] S608. The image processing chip transmits RAW F to the application processing chip.

[0092] S609. The application processing chip performs ISP processing and post-processing on RAW F to obtain 1 captured image.

[0093] S6010. If the current system power consumption is not higher than the second power consumption threshold, the image processing chip performs ISP processing on RAW L to obtain YUV L; and fuses RAW L, RAW M, and RAW S to obtain RAW F.

[0094] S6011. The image processing chip transmits RAW F and YUV L to the application processing chip.

[0095] S6012. The application processing chip performs post - processing on YUV L, and performs ISP processing and post - processing on RAW F to obtain 2 captured images.

[0096] It should be noted that S603 - S605 and S606 - S6012 are two parallel steps after S602, and S607 - S609 and S6010 - S6012 are two parallel steps after S606. Specifically, they are selected according to the actual situation, and the embodiments of the present application do not make specific limitations.

[0097] It can be understood that by processing the original image data corresponding to long exposure, medium exposure, short exposure, and the fused original image data after fusing the three exposures in a single shot, captured images with different brightness styles are provided, offering more brightness options. By collecting the selection information of the captured images with the above four brightness styles, the preference for the image style is inferred. So as to output different numbers of pictures in combination with different power consumption situations during subsequent shooting. For example, when the power consumption is low, all brightness - style images are output; when the power consumption is high, only the most favorite brightness - style image is output. This can ensure that the power consumption is within a reasonable range, output the captured images in the brightness style preferred by the user, and improve the intelligence of shooting.

[0098] The embodiments of the present application provide a storage medium, on which a computer program is stored. The above - mentioned computer - readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors and are applied to an electronic device. This computer program implements the image - processing method as described above.

[0099] It should be noted that in this article, the term "including", "comprising" or any other variant thereof is intended to cover non - exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without further limitations, an element defined by the statement "including a..." does not exclude the existence of another identical element in the process, method, article or device including that element.

[0100] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation. Based on such an understanding, the technical solution of the present disclosure, in essence, or the part that contributes to the related technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc), and includes several instructions to enable an image display device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of the present disclosure.

[0101] The above is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. An image processing method, characterized in that, The method includes: Obtaining original image data with multiple exposure durations and the current system power consumption; Sequentially selecting at least one exposure type from a preset exposure type sorting list according to the current system power consumption; the preset exposure type sorting list includes a sorting result based on historical selections, the exposure type corresponding to each exposure duration, and the exposure merging type corresponding to multiple exposure durations; wherein, multiple historical exposure images form a historical fusion image, each of the historical exposure images corresponds to the exposure type corresponding to each exposure duration, and the historical fusion image corresponds to the exposure merging type; Based on the at least one exposure type and the multiple frames of original image data, determining at least one frame of original image data to be processed; and performing image processing on the at least one frame of original image data to be processed to obtain at least one captured image.

2. The method according to claim 1, wherein The sequentially selecting at least one exposure type from a preset exposure type sorting list according to the current system power consumption includes: Determining a first quantity of original image data to be processed according to the current system power consumption; Sequentially selecting the at least one exposure type from the preset exposure type sorting list according to the first quantity.

3. The method according to claim 1, characterized in that, After performing image processing on the at least one frame of original image data to be processed to obtain at least one captured image, the method further includes: Receiving a selection and sorting operation on the at least one captured image, and sorting the at least one captured image according to the selection and sorting operation to obtain at least one sorted captured image; Updating the preset exposure type sorting list by using the at least one exposure type corresponding to the at least one sorted captured image.

4. The method according to claim 1, wherein Before determining at least one frame of original image data to be processed based on the at least one exposure type and the multiple frames of original image data after obtaining the original image data with multiple exposure durations and the current system power consumption, the method further includes: Determining multiple preprocessing parameters according to the multiple exposure durations; Using the multiple preprocessing parameters to respectively preprocess the multiple frames of original image data to obtain multiple frames of preprocessed original image data; Correspondingly, the determining at least one frame of original image data to be processed based on the at least one exposure type and the multiple frames of original image data includes: Determining the at least one frame of original image data to be processed based on the at least one exposure type and the multiple frames of preprocessed original image data.

5. The method according to claim 4, characterized in that, The exposure durations include long exposure, medium exposure, and short exposure. The determining multiple preprocessing parameters according to the multiple exposure durations includes: When the multiple exposure durations include the long exposure, the multiple preprocessing parameters include the sharpening parameter corresponding to the long exposure; When the multiple exposure durations include the short exposure, the multiple preprocessing parameters include the noise reduction parameter corresponding to the short exposure.

6. The method according to claim 1, characterized in that, Before sequentially selecting at least one exposure type from a preset exposure type sorting list according to the current system power consumption, the method further includes: In each round of historical shooting process, the multiple historical exposure images corresponding to multiple exposure durations and the historical fusion image composed of the multiple historical exposure images are respectively output; According to the historical selection and sorting operations on the multiple historical exposure images and the historical fusion image, determine the arrangement order of the exposure type corresponding to each exposure duration and the exposure combination type corresponding to the multiple exposure durations; Generate the preset exposure type sorting list according to the arrangement order of the exposure type corresponding to each exposure duration and the exposure combination type corresponding to the multiple exposure durations; 7. An electronic device, characterized in that, The electronic device includes: a sensor, a power consumption detection unit, an image processing chip connected to the sensor and the power consumption detection unit, and an application processing chip connected to the image processing chip; The sensor is used to obtain raw image data of multiple frames with different exposure durations; The power consumption detection unit is used to obtain the current system power consumption; The image processing chip is used to sequentially select at least one exposure type from the preset exposure type sorting list according to the current system power consumption; the preset exposure type sorting list includes the sorting results of the exposure type corresponding to each exposure duration and the exposure combination type corresponding to the multiple exposure durations based on historical selection; based on the at least one exposure type and the multiple frames of raw image data, determine at least one frame of raw image data to be processed; wherein, multiple historical exposure images form a historical fusion image, each historical exposure image corresponds to the exposure type corresponding to each exposure duration, and the historical fusion image corresponds to the exposure combination type; The application processing chip and the image processing chip are further used to perform image processing on the at least one frame of raw image data to be processed to obtain at least one captured image.

8. The device according to claim 7, wherein The image processing chip is further used to determine the first quantity of the raw image data to be processed according to the current system power consumption; and sequentially select the at least one exposure type from the preset exposure type sorting list according to the first quantity.

9. The device according to claim 7, wherein The application processing chip is further used to respectively output the multiple historical exposure images corresponding to multiple exposure durations and the historical fusion image composed of the multiple historical exposure images in each round of historical shooting process; The image processing chip is further used to determine the arrangement order of the exposure type corresponding to each exposure duration and the exposure combination type corresponding to the multiple exposure durations according to the historical selection and sorting operations on the multiple historical exposure images and the historical fusion image; Generate the preset exposure type sorting list according to the arrangement order of the exposure type corresponding to each exposure duration and the exposure combination type corresponding to the multiple exposure durations.

10. The device according to claim 7, wherein The application processing chip and / or the image processing chip are further used to perform image processing on the at least one frame of raw image data to be processed to obtain at least one frame of image data; The application processing chip is further configured to perform post-processing on the at least one frame of image data to obtain at least one captured image.

Citation Information

Patent Citations

  • Image processing method and device, storage medium and electronic device

    CN110198417A

  • Image processing method and device, electronic equipment and computer readable storage medium

    CN111462021A