Image acquisition device and image processing method, electronic device and storage medium

Abstract

The present disclosure relates to an image acquisition device and an image processing method, an electronic device and a storage medium. The device comprises: a camera configured to acquire an image to be processed; a quantum dot filter array comprising a plurality of quantum dot filters configured to sense ambient light of a plurality of preset wavelengths and obtain quantum dot pixel point information of the plurality of preset wavelengths; and a processing component configured to determine spectral information of a plurality of pixel points in the image to be processed based on the quantum dot pixel point information, and perform color correction processing on the plurality of pixel points in the image to be processed based on the spectral information of the plurality of pixel points to obtain a corrected image to be processed. The image acquisition device according to the embodiment of the present disclosure can obtain quantum dot pixel point information through quantum dot filters and obtain spectral information of a plurality of wave bands, the spectral information obtained is more abundant and accurate, the color information determined based on the spectral information is more accurate, and the color restoration degree of the captured image is higher.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to an image acquisition device and image processing method, electronic device and storage medium. Background Technology

[0002] In related technologies, mobile phones and other terminal devices are often equipped with cameras. However, due to cost and other reasons, the images captured by these cameras are of poor quality and exhibit color differences. Although terminal devices can correct for color differences in images captured by cameras, it is difficult to achieve good correction results when the image quality is low and the color information is inaccurate, and this process also consumes a lot of processing resources. Summary of the Invention

[0003] This disclosure presents an image acquisition device, an image processing method, an electronic device, and a storage medium.

[0004] According to one aspect of this disclosure, an image acquisition device is provided, comprising: at least one camera, a quantum dot filter array, and a processing component. The camera is used to acquire an image to be processed. The quantum dot filter array includes multiple quantum dot filters, each of which is used to sense ambient light of a preset wavelength to obtain quantum dot pixel information of multiple preset wavelengths. The processing component is used to: determine the spectral information of multiple pixels in the image to be processed based on the quantum dot pixel information; and perform color correction processing on the multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed.

[0005] In one possible implementation, the camera includes a monochrome camera, and the image to be processed includes a first monochrome image acquired by the monochrome camera. The process of performing color correction on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: obtaining a first color image corresponding to the first monochrome image based on the spectral information of the multiple pixels; and overlaying the first monochrome image and the first color image to obtain the corrected image to be processed.

[0006] In one possible implementation, the first black-and-white image and the first color image are superimposed to obtain the corrected image to be processed, including: determining the color information of multiple pixels in the first color image; determining the brightness information of multiple pixels in the first black-and-white image; and obtaining the corrected image to be processed based on the color information and brightness information of the multiple pixels.

[0007] In one possible implementation, the camera includes a color camera, and the image to be processed includes a second color image acquired by the color camera. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: determining the color information of the multiple pixels based on their spectral information; and performing color correction processing on the second color image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0008] In one possible implementation, the camera includes a color camera and a monochrome camera, and the image to be processed includes a third color image acquired by the color camera and a second monochrome image acquired by the monochrome camera. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: superimposing the third color image and the second monochrome image to obtain a superimposed image; determining the color information of the multiple pixels based on the spectral information of the pixels; and performing color correction processing on the superimposed image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0009] In one possible implementation, the color information includes at least one of lightness information, hue information, and saturation information.

[0010] According to one aspect of this disclosure, an image processing method is provided, comprising: determining spectral information of multiple pixels in an image to be processed acquired by a camera based on quantum dot pixel information obtained from a quantum dot filter array; and performing color correction processing on the multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed.

[0011] In one possible implementation, the image to be processed includes a first black and white image. The process of performing color correction on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: obtaining a first color image corresponding to the first black and white image based on the spectral information of the multiple pixels; and superimposing the first black and white image and the first color image to obtain the corrected image to be processed.

[0012] In one possible implementation, the first black-and-white image and the first color image are superimposed to obtain the corrected image to be processed, including: determining the color information of multiple pixels in the first color image; determining the brightness information of multiple pixels in the first black-and-white image; and obtaining the corrected image to be processed based on the color information and brightness information of the multiple pixels.

[0013] In one possible implementation, the image to be processed includes a second color image, wherein color correction processing is performed on the multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed, including: determining the color information of the multiple pixels based on the spectral information of the multiple pixels; and performing color correction processing on the second color image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0014] In one possible implementation, the image to be processed includes a third color image and a second black-and-white image. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image includes: overlaying the third color image and the second black-and-white image to obtain an overlay image; determining the color information of the multiple pixels based on the spectral information of the pixels; and performing color correction processing on the overlay image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0015] In one possible implementation, the color information includes at least one of lightness information, hue information, and saturation information.

[0016] According to one aspect of this disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the above-described image processing method.

[0017] According to one aspect of this disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the above-described image processing method.

[0018] The image acquisition apparatus according to embodiments of this disclosure can obtain quantum dot pixel information and spectral information across multiple wavelength bands through a quantum dot filter. Compared to a conventional color camera, the quantum dot filter array provides a more detailed division of light wave bands, resulting in richer and more accurate spectral information. The color information determined based on this spectral information is therefore more accurate. The highly accurate color information can be used to perform color correction on images captured by a monochrome camera and / or a color camera, resulting in a corrected image with high color fidelity. Furthermore, due to the high accuracy of the color information, the processing resource requirements for color correction can be significantly reduced, improving processing efficiency.

[0019] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0020] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.

[0022] Figure 1 A block diagram of an image acquisition apparatus according to an embodiment of the present disclosure is shown;

[0023] Figure 2 A schematic diagram of a quantum dot filter array according to an embodiment of the present disclosure is shown;

[0024] Figure 3A , Figure 3B and Figure 3C This diagram illustrates an application of an image acquisition apparatus according to an embodiment of the present disclosure.

[0025] Figure 4 A flowchart illustrating an image processing method according to an embodiment of the present disclosure is shown;

[0026] Figure 5 A block diagram of an electronic device according to an embodiment of the present disclosure is shown;

[0027] Figure 6 Another block diagram of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0028] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0029] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0030] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0031] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0032] Figure 1 A block diagram of an image acquisition apparatus according to an embodiment of the present disclosure is shown, such as Figure 1 As shown, the device includes: at least one camera 11, a quantum dot filter array 12, and a processing component 13.

[0033] The camera 11 is used to acquire the image to be processed;

[0034] The quantum dot filter array 12 includes multiple quantum dot filters, which are used to sense ambient light of a preset wavelength to obtain quantum dot pixel information of multiple preset wavelengths.

[0035] The processing component 13 is used for:

[0036] Based on the quantum dot pixel information, determine the spectral information of multiple pixels in the image to be processed;

[0037] Based on the spectral information of the multiple pixels, color correction processing is performed on the multiple pixels in the image to be processed to obtain the corrected image.

[0038] The image acquisition apparatus according to embodiments of this disclosure can obtain quantum dot pixel information and spectral information across multiple wavelength bands through a quantum dot filter. Compared to a conventional color camera, the quantum dot filter array provides a more detailed division of light wave bands, resulting in richer and more accurate spectral information. The color information determined based on this spectral information is more accurate, leading to higher color fidelity in the captured image. Furthermore, due to the high accuracy of the color information, the processing resource requirements for color correction can be significantly reduced, improving processing efficiency.

[0039] In one possible implementation, the quantum dot filter array may include multiple quantum dot filters, each of which can be used to sense ambient light in different wavelengths. The ambient light in a predetermined wavelength sensed by each quantum dot filter can form spectral information for that wavelength. Multiple quantum dot filters can obtain spectral information of multiple wavelengths at any location in the environment, that is, the spectral information of the incident light at that location. The spectral information at each location can be represented as quantum dot pixel information in the image, that is, the spectral information of each pixel in the image to be processed. Multiple quantum dot filters increase the number of incident light channels. Multiple quantum dot filters correspond to spectral information of multiple wavelengths. This spectral information can constitute spectral information with more detailed band division, that is, the spectral information of ambient light. This spectral information can accurately distinguish similar colors, thereby improving the accuracy of color information. Furthermore, quantum dot filters can sense ambient light of a preset wavelength through fluorescence. In related technologies, ordinary filters can filter out ambient light of other wavelengths, retaining only the preset wavelength. Quantum dot filters, however, not only retain the preset wavelength but also emit fluorescence of the preset wavelength when illuminated by ambient light, thereby enhancing the ambient light of that wavelength and increasing its luminous flux. In other words, without reducing the luminous flux of other wavelengths, the luminous flux of the preset wavelength is increased, resulting in richer color information. The spectral information obtained through a quantum dot filter array has detailed band divisions and rich information content, providing richer and more accurate color information.

[0040] Figure 2 A schematic diagram of a quantum dot filter array according to an embodiment of the present disclosure is shown, such as Figure 2 As shown, the quantum dot filter array may include multiple quantum dot filters, each used to acquire spectral information at a preset wavelength, i.e., to acquire quantum dot pixel information. After processing by a CMOS (Complementary Metal Oxide Semiconductor) chip module, the quantum dot pixel information across multiple bands can constitute the spectral information of ambient light. In the example, the number of spectral bands can be between 3 and 255, providing richer spectral information compared to a typical color camera. This disclosure does not limit the number of bands.

[0041] In the example, spectral information can also be processed through circuit boards and other components. For example, spectral information can be converted into a transmittable electrical signal and transmitted to a processing component via a signal transmission line for further processing.

[0042] In the example, a lens can also be placed in front of the quantum dot filter array to form a spectral camera by combining the above-mentioned devices (lens, quantum dot filter array, CMOS chip module, circuit board and other components, signal transmission lines, etc.) for installation on mobile terminal devices. Ambient light can be irradiated onto the quantum dot filter array through the lens and processed as described above to obtain spectral information. Alternatively, a lens can be omitted, and the quantum dot filter array, CMOS chip module, circuit board and other components, signal transmission lines, etc., can be combined to form a spectral sensor. This disclosure does not limit whether a lens is used.

[0043] In one possible implementation, the camera may include at least one of a monochrome camera and a color camera. A color camera can acquire a color image of the surrounding environment; however, due to cost and size limitations, cameras on terminal devices cannot obtain sufficiently accurate ambient light information. The color information of pixels in this color image may be inaccurate, resulting in low color fidelity and potential distortion. Therefore, correction using more accurate color information is needed to obtain a color image with higher color fidelity. A monochrome camera cannot acquire color information, but it has a high black-and-white latitude and can acquire relatively accurate brightness information. The accurate brightness information obtained by the monochrome camera can be complemented by the spectral information obtained by the quantum dot filter array to obtain a color image with higher color fidelity.

[0044] In one possible implementation, the processing component can perform color correction on the image to be processed obtained by the camera based on the quantum dot pixel information obtained by the quantum dot filter array, so as to obtain an image to be processed with high color fidelity.

[0045] In one possible implementation, a quantum dot filter array can obtain the spectral information of ambient light, which is light reflected from multiple locations in the environment. The spectral information of the ambient light is the spectral information of the light reflected from these multiple locations, i.e., the spectral information of multiple pixels in the image to be processed. For example, a red filter in the quantum dot filter array can determine the red color information of location A in the environment, a green filter can determine the green color information of location A, and so on. Multiple filters can respectively determine the information of multiple colors at location A in the environment, i.e., the spectral information of location A. In this way, the spectral information of each location in the environment can be determined. The processing component can determine the spectral information of each pixel in the image to be processed based on the spectral information of each location. For example, based on the relationship between the quantum dot filter array and the camera, the relationship between each location in the environment from the perspective of the quantum dot filter and each location in the image to be processed can be determined, and the spectral information of each pixel in the image to be processed can be determined based on this relationship.

[0046] In one possible implementation, the image to be processed may include multiple pixels, each pixel possessing its own color information, which may include at least one of brightness, hue, and saturation information. The processing component can determine accurate color information based on spectral information and correct inaccurate color information of each pixel in the original image to be processed, obtaining a corrected image. For example, this can be achieved by shifting the hue information or compensating for the saturation information. The corrected image has more accurate color information and higher color fidelity. This disclosure does not limit the method of color correction.

[0047] In the example, when the camera is a color camera, the pixels in the image to be processed may have color information composed of three primary colors (i.e., red (R), green (G), and blue (B). However, this color information may not be accurate enough; for example, the saturation or hue information may not be accurate. The spectral information obtained by a quantum dot filter array, on the other hand, provides more detailed band division and richer color information. For example, colors similar to red, green, and blue can be further divided. For instance, the three similar colors of red (R) can be distinguished to obtain three shades of red (R3), the three similar colors of green (G) can be distinguished to obtain three shades of green (G3), and the three similar colors of blue (B) can be distinguished to obtain three shades of blue (B3). These more detailed primary colors can form more detailed spectral information, based on which more accurate color information can be obtained to correct inaccurate color information in the original image to be processed. This disclosure does not limit the color division.

[0048] In the example, when the camera is a monochrome camera, the pixels in the image to be processed only have brightness information. Due to its high monochrome latitude, the brightness information of the image to be processed is relatively accurate, but it does not have color information composed of the three primary colors. The processing component can determine the accurate color information of each pixel based on the spectral information of each pixel determined by the quantum dot filter array and the brightness information of the image to be processed.

[0049] In one possible implementation, the camera includes a monochrome camera, and the image to be processed includes a first monochrome image acquired by the monochrome camera. The process of performing color correction on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: obtaining a first color image corresponding to the first monochrome image based on the spectral information of the multiple pixels; and overlaying the first monochrome image and the first color image to obtain the corrected image to be processed.

[0050] In the example, when the camera is a monochrome camera, the image to be processed is a first monochrome image, that is, an image that does not have color information but has relatively accurate brightness information. The processing component can use the relatively accurate color information determined based on spectral information (which does not have brightness information or has low accuracy in brightness information) to complement the brightness information of the first monochrome image, thereby obtaining complete color information for each pixel, that is, color information with accurate saturation information, accurate hue information, and accurate brightness information, and thus obtaining the corrected image to be processed.

[0051] In the example, the processing component can determine the color information of multiple pixels in the image to be processed based on their spectral information, thereby obtaining a first color image. For example, the processing component can fuse the spectral information of a certain pixel to obtain its color information. Through this method, the color information of each pixel in the image to be processed can be obtained, i.e., the first color image can be obtained.

[0052] In one possible implementation, the color information of each pixel in the first color image and the brightness information of each pixel in the first black and white image can be mutually complementary. The first color image is the image corresponding to the first black and white image (i.e., the image to be processed), and there is a one-to-one correspondence between the pixels in the first color image and the first black and white image. Therefore, the first color image and the first black and white image can be superimposed to obtain the corrected image to be processed. Superimposing the first black and white image and the first color image to obtain the corrected image to be processed includes: determining the color information of multiple pixels in the first color image; determining the brightness information of multiple pixels in the first black and white image; and obtaining the corrected image to be processed based on the color information and brightness information of the multiple pixels.

[0053] In the example, for a specific pixel, its color information (excluding brightness information), i.e., saturation and hue information, can be obtained from the first color image. Then, the brightness information of that pixel can be obtained from the first black and white image. Furthermore, the saturation, hue, and brightness information can be combined to obtain the complete color information of that pixel. Through the above methods, the complete color information of each pixel in the image to be processed can be obtained, thus yielding the corrected image.

[0054] In this way, accurate color information can be obtained by utilizing the highly accurate brightness information and spectral information in the first black and white image, thereby obtaining an image to be processed with high color fidelity.

[0055] In one possible implementation, the camera includes a color camera, and the image to be processed includes a second color image acquired by the color camera. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: determining the color information of the multiple pixels based on their spectral information; and performing color correction processing on the second color image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0056] In the example, when the camera is a color camera, the obtained image to be processed is a second color image. The color information of each pixel in the second color image may not be accurate enough. Therefore, the second color image can be color corrected by using the color information determined by the spectral information to obtain an image to be processed with higher color fidelity.

[0057] In the example, the processing component can determine the color information of multiple pixels in the image to be processed based on their spectral information. For example, the processing component can fuse the spectral information of a certain pixel to obtain its color information. In this way, the color information of each pixel in the image to be processed can be obtained, and this color information, determined by spectral information, has high accuracy.

[0058] In the example, the color information of each pixel in the second color image may not be accurate enough. For example, a pixel may have insufficient saturation or a hue shift. This can be corrected using color information determined by spectral information. For instance, the hue and saturation information of each pixel in the second color image can be replaced with hue and saturation information determined by spectral information. That is, the inaccurate hue and saturation information of the pixels in the second color image is corrected to obtain more accurate color information. This results in a processed image with higher color fidelity, i.e., the corrected processed image.

[0059] In this way, accurate color information can be obtained based on spectral information, and then the color information of the second color image can be corrected, so that the color information of the corrected image to be processed has high accuracy and high color reproduction.

[0060] In one possible implementation, the camera includes a color camera and a monochrome camera, and the image to be processed includes a third color image acquired by the color camera and a second monochrome image acquired by the monochrome camera. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: superimposing the third color image and the second monochrome image to obtain a superimposed image; determining the color information of the multiple pixels based on the spectral information of the pixels; and performing color correction processing on the superimposed image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0061] In the example, when the camera is a combination of a monochrome camera and a color camera, the image to be processed is a second monochrome image and a third color image. The second monochrome image has relatively accurate brightness information but no color information. The third color image has color information, but the accuracy of that color information is insufficient.

[0062] In one possible implementation, a third color image can be superimposed on a second black-and-white image. That is, for each pixel, the color information of that pixel in the third color image is combined with the brightness information of that pixel in the second black-and-white image (if the color information of that pixel in the third color image includes brightness information, the brightness information obtained from the third color image can be replaced with more accurate brightness information obtained from the second black-and-white image) to obtain the complete color information of that pixel, i.e., color information including saturation, hue, and brightness. Based on this method, the complete color information of each pixel can be obtained, i.e., a superimposed image can be obtained. However, the color information of each pixel in the superimposed image may not be accurate enough; for example, the saturation and / or hue information may have errors.

[0063] In one possible implementation, the processing component can determine the color information of multiple pixels in the image to be processed based on their spectral information. For example, the processing component can fuse the spectral information of a pixel to obtain its color information. In this way, the color information of each pixel in the image to be processed can be obtained, and this color information, determined by spectral information, has high accuracy.

[0064] In one possible implementation, color information determined based on spectral information can be used to perform color correction processing on the color information of the overlay image. For example, the saturation and hue information of each pixel in the overlay image can be replaced with color information determined based on spectral information. That is, the inaccurate hue information of each pixel in the overlay image can be offset and corrected, and / or the inaccurate saturation information can be compensated to obtain accurate color information of each pixel, thereby obtaining a processing image with higher color fidelity, that is, the corrected processing image.

[0065] In this way, accurate color information can be determined using spectral information, and inaccurate color information in the superimposed image obtained by superimposing the third color image and the second black and white image can be corrected, so that the color information of the image to be processed after correction has high accuracy and high color reproduction.

[0066] Figure 3A , Figure 3B and Figure 3C A schematic diagram illustrating the application of an image acquisition apparatus according to an embodiment of the present disclosure is shown. Figure 3A , Figure 3B and Figure 3C The quantum dot filter array in the image can be placed in a spectral camera, for example, such as... Figure 2The illustrated spectral camera may include a quantum dot filter array, a lens, a CMOS chip module, a circuit board, and other components. This spectral camera, along with other cameras on the terminal device (e.g., monochrome and / or color cameras), is positioned on the back of the terminal device to capture images of the surrounding environment for processing. Furthermore, the cameras are positioned close together, capturing images of similar areas, facilitating image registration and other processing.

[0067] In one possible implementation, such as Figure 3A As shown, the terminal device may include a black and white camera and a spectral camera. The black and white image captured by the black and white camera can have more accurate brightness information, while the spectral camera can acquire spectral information and determine more accurate color information based on the spectral information. The more accurate color information and the more accurate brightness information can complement each other to obtain accurate and complete color information, thereby obtaining an image with high color fidelity.

[0068] In one possible implementation, such as Figure 3B As shown, the terminal device may include a color camera and a spectral camera. The color image captured by the color camera may contain color information, but the accuracy of this color information is not high. Spectral information can be obtained based on the spectral camera, and more accurate color information can be determined based on this spectral information. Furthermore, the accurate color information can be used to perform color correction on the color image captured by the color camera to obtain an image with higher color fidelity.

[0069] In one possible implementation, such as Figure 3C As shown, the terminal device may include a color camera, a monochrome camera, and a spectral camera. The color image captured by the color camera may contain color information, but the accuracy of this color information is not high. The monochrome image captured by the monochrome camera does not contain color information, but it has relatively accurate brightness information. A color image can be superimposed on a monochrome image. The brightness information of each pixel in the superimposed image is relatively accurate, but the saturation and hue information may not be very accurate. Spectral camera can obtain spectral information, and based on this spectral information, more accurate color information can be determined. Then, based on this more accurate color information, color correction can be performed on the saturation and hue information in the superimposed image to obtain accurate and complete color information, thereby obtaining an image with high color fidelity.

[0070] In one possible implementation, the camera may also include a wide-angle camera, a telephoto camera, etc., and this disclosure does not limit the type of camera.

[0071] The image acquisition apparatus according to embodiments of this disclosure can obtain quantum dot pixel information and spectral information across multiple wavelength bands through a quantum dot filter. Compared to a conventional color camera, the quantum dot filter array provides a more detailed division of light wave bands, resulting in richer and more accurate spectral information. The color information determined based on this spectral information is therefore more accurate. The highly accurate color information can be used to perform color correction on images captured by a monochrome camera and / or a color camera, resulting in a corrected image with high color fidelity. Furthermore, due to the high accuracy of the color information, the processing resource requirements for color correction can be significantly reduced, improving processing efficiency.

[0072] Figure 4 A flowchart illustrating an image processing method according to an embodiment of the present disclosure is shown, such as... Figure 4 As shown, the method includes: in step S11, determining the spectral information of multiple pixels in the image to be processed acquired by the camera based on the quantum dot pixel information obtained by the quantum dot filter array; in step S12, performing color correction processing on the multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain the corrected image to be processed.

[0073] In one possible implementation, the image to be processed includes a first black and white image. The process of performing color correction on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed includes: obtaining a first color image corresponding to the first black and white image based on the spectral information of the multiple pixels; and superimposing the first black and white image and the first color image to obtain the corrected image to be processed.

[0074] In one possible implementation, the first black-and-white image and the first color image are superimposed to obtain the corrected image to be processed, including: determining the color information of multiple pixels in the first color image; determining the brightness information of multiple pixels in the first black-and-white image; and obtaining the corrected image to be processed based on the color information and brightness information of the multiple pixels.

[0075] In one possible implementation, the image to be processed includes a second color image, wherein color correction processing is performed on the multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image to be processed, including: determining the color information of the multiple pixels based on the spectral information of the multiple pixels; and performing color correction processing on the second color image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0076] In one possible implementation, the image to be processed includes a third color image and a second black-and-white image. The process of performing color correction processing on multiple pixels in the image to be processed based on the spectral information of the multiple pixels to obtain a corrected image includes: overlaying the third color image and the second black-and-white image to obtain an overlay image; determining the color information of the multiple pixels based on the spectral information of the pixels; and performing color correction processing on the overlay image based on the color information of the multiple pixels to obtain the corrected image to be processed.

[0077] In one possible implementation, the color information includes at least one of lightness information, hue information, and saturation information.

[0078] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further.

[0079] In addition, this disclosure also provides electronic devices, computer-readable storage media, and programs, all of which can be used to implement any of the image processing methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the corresponding descriptions in the method section and will not be repeated here.

[0080] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0081] In some embodiments, the apparatus provided in this disclosure may have functions or include modules that can be used to perform the methods described in the above method embodiments. Specific implementations can be referred to the descriptions in the above method embodiments, and for brevity, will not be repeated here.

[0082] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the above-described method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0083] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured as described above.

[0084] Electronic devices can be provided as terminals, servers, or other forms of devices.

[0085] Figure 5This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other terminal.

[0086] Reference Figure 5 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0087] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0088] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0089] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0090] Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0091] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0092] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0093] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0094] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0095] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0096] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of an electronic device 800 to perform the above-described method.

[0097] Figure 6 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 may be provided as a server. (Refer to...) Figure 6 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0098] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system, such as Windows Server, stored in memory 1932. TM Mac OS XTM Unix TM LinuxTM FreeBSD TM Or similar.

[0099] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0100] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0101] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0102] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0103] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0104] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0105] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0106] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0107] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0108] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. An image acquisition device, characterized in that, include: At least one camera, quantum dot filter array, and processing components. The camera is used to acquire images to be processed. The quantum dot filter array includes multiple quantum dot filters, each of which is used to sense ambient light of a preset wavelength to obtain quantum dot pixel information of multiple preset wavelengths. The number of wavelength bands corresponding to the multiple quantum dot filters is greater than 3 and less than or equal to 255. The multiple quantum dot filters can obtain spectral information of multiple wavelength bands at any location in the environment, and the spectral information at each location can be represented as quantum dot pixel information in the image. The processing component is used for: Based on the quantum dot pixel information, determine the spectral information of multiple pixels in the image to be processed; Based on the spectral information of the multiple pixels, color correction processing is performed on the multiple pixels in the image to be processed to obtain the corrected image to be processed; The processing component is further configured to determine the relationship between each position in the environment under the view of the quantum dot filter and each position in the image to be processed, based on the relationship between the quantum dot filter array and the camera, and to determine the spectral information of each pixel in the image to be processed based on the relationship.

2. The apparatus according to claim 1, characterized in that, The camera includes a monochrome camera, and the image to be processed includes a first monochrome image acquired by the monochrome camera. Specifically, based on the spectral information of the plurality of pixels, color correction processing is performed on the plurality of pixels in the image to be processed to obtain the corrected image to be processed, including: Based on the spectral information of the plurality of pixels, a first color image corresponding to the first black and white image is obtained; The first black-and-white image and the first color image are superimposed to obtain the corrected image to be processed.

3. The apparatus according to claim 2, characterized in that, The first black-and-white image and the first color image are overlaid to obtain the corrected image to be processed, including: Determine the color information of multiple pixels in the first color image; Determine the brightness information of multiple pixels in the first black and white image; The corrected image to be processed is obtained based on the color information and brightness information of the multiple pixels.

4. The apparatus according to claim 1, characterized in that, The camera includes a color camera, and the image to be processed includes a second color image acquired by the color camera. Specifically, based on the spectral information of the plurality of pixels, color correction processing is performed on the plurality of pixels in the image to be processed to obtain the corrected image to be processed, including: The color information of the plurality of pixels is determined based on the spectral information of the plurality of pixels; Based on the color information of the multiple pixels, the second color image is subjected to color correction processing to obtain the corrected image to be processed.

5. The apparatus according to claim 1, characterized in that, The camera includes a color camera and a monochrome camera, and the image to be processed includes a third color image acquired by the color camera and a second monochrome image acquired by the monochrome camera. Specifically, based on the spectral information of the plurality of pixels, color correction processing is performed on the plurality of pixels in the image to be processed to obtain the corrected image to be processed, including: The third color image and the second black-and-white image are overlaid to obtain an overlaid image; The color information of the plurality of pixels is determined based on the spectral information of the pixels; Based on the color information of the multiple pixels, the superimposed image is subjected to color correction processing to obtain the corrected image to be processed.

6. The apparatus according to any one of claims 3-5, characterized in that, The color information includes at least one of brightness information, hue information, and saturation information.

7. An image processing method, characterized in that, include: Based on the quantum dot pixel information obtained from the quantum dot filter array, the spectral information of multiple pixels in the image to be processed acquired by the camera is determined. Based on the spectral information of the multiple pixels, color correction processing is performed on the multiple pixels in the image to be processed to obtain the corrected image to be processed; The method further includes: determining the relationship between each position in the environment under the view of the quantum dot filter and each position in the image to be processed based on the relationship between the quantum dot filter array and the camera, and determining the spectral information of each pixel in the image to be processed based on the relationship; The quantum dot filter array includes multiple quantum dot filters. The number of wavelength bands corresponding to the multiple quantum dot filters is greater than 3 and less than or equal to 255. The multiple quantum dot filters can obtain spectral information of multiple wavelength bands at any location in the environment. The spectral information at each location can be represented as quantum dot pixel information in the image.

8. The method according to claim 7, characterized in that, The image to be processed includes a first black and white image. Specifically, based on the spectral information of the plurality of pixels, color correction processing is performed on the plurality of pixels in the image to be processed to obtain the corrected image to be processed, including: Based on the spectral information of the plurality of pixels, a first color image corresponding to the first black and white image is obtained; The first black-and-white image and the first color image are superimposed to obtain the corrected image to be processed.

9. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to perform the method described in any one of claims 7 to 8.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method described in any one of claims 7 to 8.

Images