Color sensor correction method and device

Abstract

The invention is applicable to the technical field of image processing, and provides a correction method and device for a color sensor, and the method comprises the steps: emitting visible light to irradiate a corrected surface of a corrected object, obtaining a first image of the corrected surface of the corrected object irradiated by the visible light, and carrying out the color correction of the first image, performing color correction on the first image and then outputting a second image; wherein the consideration factors for performing color correction on the first image comprise that the first image is corrected according to influence factors such as illumination intensity, environment temperature, spectral distribution, RGB brightness and the like, so that the shot image is highly corrected, the imaging effect of the image is improved, and the user experience is further improved.

Description

Technical Field

[0001] This invention belongs to the field of image processing technology, and particularly relates to a method and apparatus for calibrating a color sensor. Background Technology

[0002] The camera function is an essential feature of electronic devices. Therefore, electronic devices with camera functions, such as mobile phones, smartwatches, and professional cameras, are all equipped with camera components. As people's living standards continue to improve, their performance requirements for camera functions are also increasing. They demand that the captured images more realistically reproduce real scenes, especially in terms of color, where people pursue true-color imaging effects.

[0003] In traditional methods, true-color imaging is usually achieved through color correction. Specifically, first, multiple different color calibration relationships are established for standard light sources with different color temperatures; then, by estimating the color temperature of the light source in the actual scene, the color calibration relationship corresponding to the standard light source with a color temperature close to that of the actual light source is selected to calibrate the image.

[0004] In the above methods, the standard light source is selected based on color temperature. However, color temperature cannot fully describe a light source. For example, different light sources may have the same color temperature. Therefore, the above methods cannot achieve a good color correction effect. Summary of the Invention

[0005] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a color sensor calibration method and apparatus, which aims to solve the problem of image distortion and poor user experience caused by the inability of the prior art to provide an effective color sensor calibration method.

[0006] On one hand, the present invention provides a calibration method for a color sensor, the method comprising the following steps: Illuminate the surface of the object to be calibrated with visible light; Acquire a first image of the calibrated surface of the object after it has been illuminated by the visible light; Perform color correction on the first image; After color correction of the first image, the second image is output.

[0007] Furthermore, the method also includes: acquiring the illumination intensity of the emitted visible light.

[0008] Furthermore, the method also includes: Color correction of the first image includes: color balance correction of the first image based on the light intensity, and color balance correction of the first image based on the ambient temperature.

[0009] Furthermore, the method further includes: acquiring the ambient temperature of the region between the calibrated surface of the object being calibrated and the irradiation unit; And the surface of the object being calibrated is illuminated by emitting visible light from all four sides.

[0010] Preferably, the method further includes: emitting multiple wavelengths of visible light to illuminate the surface of the object to be calibrated, and acquiring the RGB brightness of the multiple wavelengths of visible light.

[0011] More preferably, the method further includes: Based on the calibrated surface of the object being calibrated, a first spectral distribution of the light source in the current environment and a second spectral distribution of the emitted visible light are obtained. Based on the first spectral distribution and the second spectral distribution, the spectral correction factor of the emitted visible light is obtained.

[0012] More preferably, the method further includes: The first color correction value of the first image is obtained based on the RGB brightness of the visible light; Based on the spectral correction factor of the emitted visible light and the first color correction value, obtain the second color correction value of the light source in the current environment and the emitted visible light; The first image is corrected based on the second color correction value.

[0013] On the other hand, the present invention provides a calibration device for a color sensor, the device comprising: The illumination unit emits visible light to illuminate the surface of the object being calibrated. The image acquisition unit acquires a first image of the surface of the object to be corrected after being illuminated by the illumination unit; An image correction unit performs color correction on the first image; The light intensity acquisition unit acquires the light intensity of visible light emitted by the illumination unit; A temperature acquisition unit acquires the ambient temperature of the region between the calibrated surface of the object being calibrated and the irradiation unit. A color sensor acquires the RGB brightness of multiple different wavelengths of visible light; The first visible light multispectral sensor acquires the first spectral distribution of light sources in the current environment; A second visible light multispectral sensor acquires the second spectral distribution of the visible light emitted by the illumination unit; The device further includes at least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the calibration method of the color sensor according to any one of claims 1-7.

[0014] On the other hand, the present invention also provides a non-volatile computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the above-described color sensor calibration method.

[0015] On the other hand, the present invention also provides a computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the above-described color sensor calibration method.

[0016] The beneficial effects of this invention are as follows: emitting visible light to illuminate the surface of the object to be calibrated, acquiring a first image of the surface of the object to be calibrated after being illuminated by the illumination unit, performing color correction on the first image, and outputting a second image after color correction of the first image; wherein, the factors considered in performing color correction on the first image include: correcting the first image according to influencing factors such as light intensity, ambient temperature, spectral distribution, and RGB brightness, thereby highly correcting the captured image, improving the image imaging effect, and thus improving the user experience. Attached Figure Description

[0017] Figure 1 This is a flowchart illustrating the implementation of the color sensor calibration method provided in Embodiment 1 of the present invention; Figure 2 This is a flowchart illustrating the implementation of the color sensor calibration method provided in Embodiment 2 of the present invention; Figure 3 This is a schematic diagram of the structure of the color sensor calibration device provided in Embodiment 3 of the present invention. Implementation

[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0019] The specific implementation of the present invention will be described in detail below with reference to specific embodiments: Example 1

[0020] Figure 1The implementation flow of the color sensor calibration method provided in Embodiment 1 of the present invention is shown. For ease of explanation, only the parts related to the embodiments of the present invention are shown, and are described in detail below: Step 1 S101: Illuminate the surface of the object to be calibrated with visible light; In embodiments of the present invention, the method further includes: obtaining the illumination intensity of the emitted visible light, and illuminating the calibrated surface of the calibrated object with visible light emitted from all four sides.

[0021] Step 2 S102: Obtain the first image of the surface to be corrected of the object after it has been illuminated by visible light; In embodiments of the present invention, for example, a camera is used for taking pictures.

[0022] Step 3 S103: Perform color correction on the first image; In an embodiment of the present invention, color correction of the first image includes: color balance correction of the first image based on light intensity, and color balance correction of the first image based on ambient temperature. This also includes: obtaining the ambient temperature of the area between the calibrated surface of the object being calibrated and the irradiation unit.

[0023] Step 4 S104: After color correction of the first image, output the second image.

[0024] In an embodiment of the present invention, the second image is a color-corrected image.

[0025] In an embodiment of the present invention: visible light is emitted to illuminate the surface of the object to be calibrated, a first image of the surface of the object to be calibrated after being illuminated by visible light is obtained, color correction is performed on the first image, and a second image is output after color correction of the first image; wherein, the factors considered in color correction of the first image include: correcting the first image according to influencing factors such as light intensity and ambient temperature, thereby highly correcting the captured image, improving the image imaging effect, and thus improving the user experience. Example 2

[0026] Figure 2 The implementation flow of the color sensor calibration method provided in Embodiment 2 of the present invention is shown, which differs from Embodiment 1 in that it further includes: Step 1 S201: Illuminate the surface of the object to be calibrated with multiple visible lights of different wavelengths; Step 2 S202: Obtain the RGB brightness of multiple visible light wavelengths; Step 3 S203: Based on the calibrated surface of the object being calibrated, obtain the first spectral distribution of the light source in the current environment and the second spectral distribution of the emitted visible light; Step 4 S204: Obtain the spectral correction factor of the emitted visible light based on the first spectral distribution and the second spectral distribution; Step 5 S205: Obtain the first color correction value of the first image based on the RGB brightness of visible light; Step 6 S206: Based on the spectral correction factor of the emitted visible light and the first color correction value, obtain the second color correction value of the light source in the current environment and the emitted visible light; Step 7 S207: Correct the first image according to the second color correction value; In an embodiment of the present invention, the first image is a first image of the surface of the object to be corrected after being illuminated by visible light.

[0027] In embodiments of the present invention, the factors considered for color correction also include: spectral distribution, RGB brightness and other influencing factors are used to correct the first image, which greatly improves the calibration accuracy and further improves the true color imaging effect of the image. Example 3

[0028] Figure 3 The structure of the color sensor calibration device provided in Embodiment 3 of the present invention is shown. For ease of explanation, only the parts related to the embodiments of the present invention are shown, including: Illumination unit 301 emits visible light to illuminate the surface of the object being calibrated; Image acquisition unit 302 acquires a first image of the surface of the object to be corrected after being illuminated by illumination unit 301; Image correction unit 303 performs color correction on the first image; The light intensity acquisition unit 304 acquires the light intensity of visible light emitted by the illumination unit 301; Temperature acquisition unit 305 acquires the ambient temperature of the area between the calibrated surface of the object being calibrated and the irradiation unit. Color sensor 306 acquires the RGB brightness of multiple different wavelengths of visible light; The first visible light multispectral sensor 307 acquires the first spectral distribution of the light source in the current environment; The second visible light multispectral sensor 308 acquires the second spectral distribution of the visible light emitted by the illumination unit 301; The device also includes at least one processor 309; and, Memory 310 is communicatively connected to at least one processor 309; wherein, The memory 310 stores instructions that can be executed by at least one processor 309 to enable at least one processor 309 to perform the calibration method of the color sensor 306 according to any one of claims 1-7.

[0029] Processor 309 performs various control logic functions of the device and can be a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), microcontroller, ARM (Acorn RISC Machine) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. Furthermore, processor 309 can also be any conventional processor, microprocessor, or state machine. Processor 309 can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors combined with a DSP core, or any other such configuration.

[0030] The memory 310, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions corresponding to the color sensor calibration method in the embodiments of the present invention. The processor 309 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions, and units stored in the memory 310, thereby implementing the color sensor calibration method in the above method embodiments.

[0031] The memory 310 may include a program storage area and a data storage area, wherein the program storage area may store application programs required for operating the device and at least one function; and the data storage area may store data created according to device usage. Furthermore, the memory 310 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 310 may optionally include memory remotely located relative to the processor 309, and these remote memories may be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0032] One or more units are stored in memory 310, and when executed by one or more processors 309, they perform the color sensor calibration method in any of the above method embodiments, for example, the method described above. Figure 2 The method steps S201 to S207.

[0033] In this embodiment of the invention, each unit of the color sensor calibration device can be implemented by a corresponding hardware or software unit. Each unit can be an independent hardware or software unit, or it can be integrated into a hardware or software unit. This is not intended to limit the invention. Example 4

[0034] Embodiment 4 of the present invention provides a non-volatile computer-readable storage medium storing computer-executable instructions that are executed by one or more processors, for example, executing the instructions described above. Figure 2 The method steps S201 to S207.

[0035] As an example, non-volatile storage media can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) as an external cache memory. By way of explanation, RAM can be obtained in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The memory components or memories disclosed in the operating environment described herein are intended to include one or more of these and / or any other suitable types of memory. Example 5

[0036] Embodiment 5 of the present invention provides a computer program product, which includes a computer program stored on a non-volatile computer-readable storage medium. The computer program includes program instructions, which, when executed by a processor, cause the processor to perform the color sensor calibration method of the above-described method embodiments. For example, performing the above-described... Figure 2 The method steps S201 to S207.

[0037] The embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0038] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general-purpose hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can exist in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions to cause a computer electronic device (which may be a personal computer, server, or network electronic device, etc.) to execute the methods of various embodiments or some parts of embodiments.

[0039] The contents already described herein in this specification and accompanying drawings include examples of methods and apparatuses capable of providing color sensor calibration. It is certainly not possible to describe every conceivable combination of elements and / or methods for the purpose of describing the various features of this disclosure, but it will be appreciated that many other combinations and substitutions of the disclosed features are possible. Therefore, it will be apparent that various modifications can be made to this disclosure without departing from the scope or spirit of this disclosure. Furthermore, or in alternatives, other embodiments of this disclosure may become apparent from consideration of this specification and accompanying drawings and from practice of this disclosure as presented herein. It is intended that the examples presented in this specification and accompanying drawings be considered illustrative rather than restrictive in all respects. Although specific terminology is used herein, it is used in a general and descriptive sense and is not intended for limiting purposes.

Claims

1. A calibration method for a color sensor, characterized in that, The method includes the following steps: Illuminate the surface of the object to be calibrated with visible light; Acquire a first image of the calibrated surface of the object after it has been illuminated by the visible light; Perform color correction on the first image; After color correction of the first image, the second image is output.

2. The method as described in claim 1, characterized in that, The method further includes: acquiring the illumination intensity of the emitted visible light.

3. The method as described in claim 2, characterized in that, The method further includes: Color correction of the first image includes: color balance correction of the first image based on the light intensity, and color balance correction of the first image based on the ambient temperature.

4. The method as described in claim 3, characterized in that, The method further includes: acquiring the ambient temperature of the region between the calibrated surface of the calibrated object and the irradiation unit; And the surface of the object being calibrated is illuminated by emitting visible light from all four sides.

5. The method as described in claim 4, characterized in that, The method further includes: emitting multiple wavelengths of visible light to illuminate the surface of the object to be calibrated, and acquiring the RGB brightness of the multiple wavelengths of visible light.

6. The method as described in claim 1, characterized in that, The method further includes: Based on the calibrated surface of the object being calibrated, a first spectral distribution of the light source in the current environment and a second spectral distribution of the emitted visible light are obtained. Based on the first spectral distribution and the second spectral distribution, the spectral correction factor of the emitted visible light is obtained.

7. The method as described in claim 1, characterized in that, The method further includes: The first color correction value of the first image is obtained based on the RGB brightness of the visible light; Based on the spectral correction factor of the emitted visible light and the first color correction value, obtain the second color correction value of the light source in the current environment and the emitted visible light; The first image is corrected based on the second color correction value.

8. A calibration device for a color sensor, characterized in that, The device includes: The illumination unit emits visible light to illuminate the surface of the object being calibrated. The image acquisition unit acquires a first image of the surface of the object to be corrected after being illuminated by the illumination unit; An image correction unit performs color correction on the first image; The light intensity acquisition unit acquires the light intensity of visible light emitted by the illumination unit; A temperature acquisition unit acquires the ambient temperature of the region between the calibrated surface of the object being calibrated and the irradiation unit. A color sensor acquires the RGB brightness of multiple different wavelengths of visible light; The first visible light multispectral sensor acquires the first spectral distribution of light sources in the current environment; A second visible light multispectral sensor acquires the second spectral distribution of the visible light emitted by the illumination unit; The device further includes at least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the calibration method of the color sensor according to any one of claims 1-7.

9. A non-volatile computer-readable storage medium, characterized in that, The non-volatile computer-readable storage medium stores computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the calibration method of the color sensor according to any one of claims 1-7.

10. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program including program instructions that, when executed by a processor, cause the processor to perform the calibration method of the color sensor according to any one of claims 1-7.

Images