Image processing method and device, electronic equipment and storage medium

Abstract

The invention relates to an image processing method and device, electronic equipment and a storage medium, and belongs to the technical field of measurement. The method comprises the steps that a plurality of spectral images are obtained through a quantum dot spectrum device to be calibrated, the quantum dot spectrum device comprises a plurality of channels, each channel is correspondingly provided with different quantum dot areas, the quantum dot areas have different optical characteristics, and the spectral images are obtained when the quantum dot areas are located at preset positions; the quantum dot spectrum device obtains images based on different incident light; acquiring spectral data of different incident light through a standard spectrometer; determining a response signal corresponding to each quantum dot area under each incident light according to each spectral image; and calibrating the quantum dot spectrum device according to the spectrum data and the response signal to obtain a mapping relation between the response signal and the spectrum data. By using the method, the calibration efficiency and accuracy can be improved, and the quantum dot spectrum device can be equivalent to a standard spectrometer, or the inter-stage difference can be eliminated.

Description

Technical Field

[0001] The present disclosure relates to the field of measurement technology, and in particular to an image processing method and device, an electronic device, and a storage medium. Background Art

[0002] Quantum dots (QDs), also known as nanocrystals, have a radius close to or smaller than the exciton Bohr radius. They are a type of semiconductor nanomaterial developed in recent years and have broad application prospects in the fields of optics, electronics, and biomedicine. The wavelength distinction in the spectral device can be achieved through the different light absorption and emission characteristics of different types of quantum dots. Therefore, by using different types of quantum dots, the spectral device can work without the need for gratings, prisms, or similar optical components.

[0003] Calibration of a spectroscopic device is an important step to ensure the accuracy of its measurement data. Generally, a spectroscopic device needs to be calibrated before use. For quantum dot spectroscopic devices, due to the particularity of their structure and working principle, in order to ensure the accuracy of their measurement data, a method that matches them needs to be designed. Summary of the invention

[0004] In view of this, the present disclosure proposes an image processing solution.

[0005] According to one aspect of the present disclosure, there is provided an image processing method for a quantum dot spectral device, comprising: acquiring a plurality of spectral images through a quantum dot spectral device to be calibrated, the quantum dot spectral device comprising a plurality of channels, each of the channels corresponding to a different quantum dot region, each of the quantum dot regions having different optical properties, the plurality of spectral images being images obtained by the quantum dot spectral device based on different incident light when each of the quantum dot regions is located at a preset position; acquiring spectral data of the different incident light through a standard spectrometer; determining, based on each of the spectral images, a response signal corresponding to each of the quantum dot regions under each incident light; and calibrating the quantum dot spectral device based on the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectral device and the spectral data.

[0006] In a possible implementation, the method further includes: spectrally reconstructing a signal detected by the quantum dot spectral device according to a mapping relationship between a response signal of the quantum dot spectral device and the spectral data; and / or, the quantum dot spectral device is mounted on a rotating structure; acquiring multiple spectral images through the quantum dot spectral device to be calibrated, comprising: irradiating a standard whiteboard having a calibration area with one type of incident light, controlling the rotation of the rotating structure according to a preset angle so that each of the quantum dot areas is located at the preset position, acquiring multiple spectral images according to an automatically determined exposure time, each of the spectral images including the calibration area, wherein the preset position is a position where the imaging range of the quantum dot area falls within the calibration area; switching to the next type of incident light to continue acquiring spectral images.

[0007] In a possible implementation, the incident light includes: monochromatic light and polychromatic light, and the obtaining of multiple spectral images through the quantum dot spectral device to be calibrated also includes: using the spectral images obtained under the irradiation of the monochromatic light as a training set, the training set is used to determine the mapping relationship, and the true value of the training set is the spectral data obtained using the standard spectrometer; using the spectral images obtained under the irradiation of the polychromatic light as a test set, the test set is used to verify the mapping relationship, and the true value of the test set is the spectral data obtained using the standard spectrometer; and / or, determining the response signal corresponding to each of the quantum dot regions under each incident light based on each of the spectral images, includes: determining a selected area on each of the spectral images; and determining the response signal of each quantum dot region within each of the selected areas.

[0008] In a possible implementation, the calibration area on the standard whiteboard is defined by at least two markers, and determining the selected area on each of the spectral images includes: determining a first position of the marker on each spectral image; based on the first position, determining the selected area according to a preset correspondence between the marker and the calibration area.

[0009] In a possible implementation, the calibration area on the standard whiteboard is defined by two markers, and determining the first position of the markers on each spectral image includes: performing template matching on a single spectral image to determine multiple candidate spots and the number of the candidate spots; when the number is not greater than 2, taking the center coordinates of the candidate spots as the first position; when the number is greater than 2, interpolating the candidate spots corresponding to adjacent images to determine the first position of the single spectral image.

[0010] In a possible implementation, when the number is not greater than 2, the center coordinates of the candidate spot are used as the first position, including: when the number is 1 or 2, determining the degree of match between the candidate spot and the template; when the degree of match is less than a matching threshold, fine-tuning the position of the candidate spot in the direction of decreasing grayscale value according to the second grayscale value of the candidate spot and the surrounding grayscale values, and determining the fine-tuned candidate spot; using the center coordinates of the fine-tuned candidate spot as the first position; when the degree of match is not less than the matching threshold, directly using the center coordinates of the candidate spot as the first position.

[0011] In a possible implementation, the incident light includes: monochromatic light and / or polychromatic light, and the method further includes: for the response signals obtained for the same quantum dot area under the irradiation of different monochromatic lights, when the difference between the response signals in the first band and the adjacent band is greater than the first response threshold, determining the first image to be processed, reacquiring a new spectral image using the same acquisition conditions as the first image to be processed, and replacing the first image to be processed with the new spectral image; and / or, when each of the quantum dot areas is located at a preset position, for the multiple second spectral images obtained by the quantum dot spectral device under the irradiation of the same monochromatic light, in the second spectral image and the adjacent second spectral images, the same quantum dot When the difference in the response signals of the regions is greater than a second response threshold, a second image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as those for the second image to be processed, and the second image to be processed is replaced by the new spectral image; and / or, based on a third spectral image acquired by the quantum dot spectral device under different irradiations of the complex light, the theoretical output light intensity corresponding to each quantum dot channel is determined; for the third spectral image, when the difference between the theoretical output light intensity and the corresponding measured output light intensity is greater than the light intensity threshold, a third image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as those for the third image to be processed, and the third image to be processed is replaced by the new spectral image.

[0012] According to another aspect of the present disclosure, there is provided an image processing apparatus, comprising:

[0013] A quantum dot spectral device, used to obtain a plurality of spectral images through a quantum dot spectral device to be calibrated, wherein the quantum dot spectral device comprises a plurality of channels, each of the channels corresponds to a different quantum dot region, each of the quantum dot regions has a different optical property, and the plurality of spectral images are images obtained by the quantum dot spectral device based on different incident light when each of the quantum dot regions is located at a preset position;

[0014] A standard spectrometer, used for acquiring spectral data of the different incident lights through the standard spectrometer;

[0015] A response signal determination unit, used to determine the response signal corresponding to each of the quantum dot regions under each incident light according to each of the spectral images;

[0016] A mapping relationship acquisition unit is used to calibrate the quantum dot spectroscopy device according to the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectroscopy device and the spectral data.

[0017] In a possible implementation manner, the device further includes:

[0018] a spectrum reconstruction unit, configured to perform spectrum reconstruction on the signal detected by the quantum dot spectrum device according to the obtained mapping relationship between the response signal of the quantum dot spectrum device and the spectrum data; and / or, the quantum dot spectrum device is mounted on a rotating structure;

[0019] The quantum dot spectroscopy device is further used for:

[0020] A standard white plate with a calibration area is irradiated with one type of incident light, and the rotating structure is controlled to rotate according to a preset angle so that each quantum dot area is located at the preset position, and a plurality of spectral images are acquired according to an automatically determined exposure time, each spectral image including the calibration area, wherein the preset position is a position where the imaging range of the quantum dot area falls within the calibration area; the next type of incident light is switched to continue acquiring spectral images.

[0021] In a possible implementation, the incident light includes: monochromatic light and polychromatic light, and the quantum dot spectrum device further includes:

[0022] A training set determination unit, used to use the spectral image acquired under the irradiation of the monochromatic light as a training set, wherein the training set is used to determine the mapping relationship, and the true value of the training set is the spectral data obtained using the standard spectrometer;

[0023] a test set determination unit, configured to use a spectral image obtained under the illumination of the polychromatic light as a test set, wherein the test set is used to verify the mapping relationship, and the true value of the test set is spectral data obtained using the standard spectrometer; and / or,

[0024] The response signal determining unit comprises:

[0025] A selected area determination unit, used to determine the selected area on each of the spectral images;

[0026] The response signal determination subunit is used to determine the response signal of each quantum dot area in each selected area.

[0027] In a possible implementation, the marked area on the standard whiteboard is defined by at least two markers, and the selected area determination unit is further configured to:

[0028] determining a first position of the marker on each spectral image;

[0029] Based on the first position, the selected area is determined according to a preset correspondence between the marker and the calibration area.

[0030] In a possible implementation, the marked area on the standard whiteboard is defined by two markers, and the selected area determination unit is further configured to:

[0031] Performing template matching on a single spectral image to determine a plurality of candidate spots and the number of the candidate spots;

[0032] When the number is not greater than 2, the center coordinates of the candidate spots are used as the first positions;

[0033] When the number is greater than 2, candidate image spots corresponding to adjacent images are interpolated to determine the first position of the single spectral image.

[0034] In a possible implementation manner, the selected area determination unit is further configured to:

[0035] When the number is 1 or 2, determining the matching degree between the candidate pattern spot and the template;

[0036] When the matching degree is less than the matching degree threshold, the position of the candidate spot is fine-tuned in the direction of decreasing the grayscale value according to the second grayscale value of the candidate spot and the surrounding grayscale values, to determine a fine-tuned candidate spot;

[0037] The center coordinates of the finely adjusted candidate image patch are used as the first position;

[0038] When the matching degree is not less than the matching degree threshold, the center coordinates of the candidate image spot are directly used as the first position.

[0039] In a possible implementation, the incident light includes: monochromatic light and / or polychromatic light, and the device further includes:

[0040] A first image to be processed replacement unit is used for determining a first image to be processed for response signals obtained from the same quantum dot region under different monochromatic light irradiations, when the difference between the response signals in a first band and an adjacent band is greater than a first response threshold, reacquiring a new spectral image using the same acquisition conditions as the first image to be processed, and replacing the first image to be processed with the new spectral image; and / or,

[0041] A second image to be processed replacement unit is used for, when each of the quantum dot regions is located at a preset position, for a plurality of second spectral images acquired by the quantum dot spectral device under the same monochromatic light irradiation, when the difference in response signals of the same quantum dot region in a second spectral image and an adjacent second spectral image is greater than a second response threshold, determining a second image to be processed, reacquiring a new spectral image using the same acquisition conditions as the second image to be processed, and replacing the second image to be processed with the new spectral image; and / or,

[0042] A theoretical emergent light intensity determination unit, used to determine the theoretical emergent light intensity corresponding to each quantum dot channel based on the third spectrum image obtained by the quantum dot spectrum device under the irradiation of different polychromatic lights;

[0043] A third image to be processed replacement unit is used to determine a third image to be processed for a third spectral image, when the difference between the theoretical emergent light intensity and the corresponding measured emergent light intensity is greater than a light intensity threshold, reacquire a new spectral image using the same acquisition conditions as those of the third image to be processed, and replace the third image to be processed with the new spectral image.

[0044] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0045] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0046] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0047] The method disclosed in the present invention is directly applied to the quantum dot spectral device to be calibrated, and can be used to calibrate the quantum dot spectral device, so the relative position relationship of each component and various parameters in the quantum dot spectral device used in the two scenes of calibration and use are consistent. Since the spectral image is obtained using the quantum dot spectral device to be calibrated, the mapping relationship obtained by calibration can be directly used for the quantum dot spectral device. Compared with the calibration of chips or individual components, the calibration is more accurate, and there is no need to adjust the calibration results, and it can be used directly, thereby improving efficiency and calibration accuracy. The purpose of calibrating a quantum dot spectral device is to make all types of spectrometers compatible in their descriptions of the same observed object, and their measurement results are all close to the same absolute physical concept. By calibrating the quantum dot spectral device, the quantum dot spectral device can be made equivalent to a standard spectrometer, or the inter-unit difference can be eliminated.

[0048] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0050] Figure 1 A flowchart of an image processing method provided by the present invention is provided.

[0051] Figure 2 Schematic diagram of the optical path for calibrating the quantum dot spectroscopy device provided in the present invention.

[0052] Figure 3 The data collected by the quantum dot spectroscopy device after calibrating the image processing method provided by the present invention and the data collected by the standard spectrometer.

[0053] Figure 4 A schematic diagram of a quantum dot region segmentation diagram is provided for use with the present disclosure.

[0054] Figure 5 A schematic diagram of the structure of an image processing device for a quantum dot spectroscopy device provided in the present invention.

[0055] Figure 6 A schematic diagram of the structure of an electronic device of a quantum dot spectroscopy device provided in the present invention. DETAILED DESCRIPTION

[0056] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0057] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0058] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0059] Figure 1 The figure is a flow chart of an image processing method provided by the present disclosure. The method is applied to a quantum dot spectroscopy device. The quantum dot spectroscopy device is a quantum dot spectroscopy device to be calibrated. Figure 1 As shown, the method includes:

[0060] S11, acquiring a plurality of spectral images through a quantum dot spectral device to be calibrated, wherein the quantum dot spectral device comprises a plurality of channels, each of the channels corresponds to a different quantum dot region, each of the quantum dot regions has different optical properties, and the plurality of spectral images are images obtained by the quantum dot spectral device based on different incident light when each of the quantum dot regions is located at a preset position.

[0061] Each quantum dot region can be a quantum dot strip or a quantum dot array.

[0062] The spectral image may be an image obtained by a quantum dot spectral device to be calibrated. The quantum dot spectral device may include a sensor and multiple quantum dot regions. The quantum dot spectral device may include multiple channels, a single channel may correspond to a quantum dot region, and each channel corresponds to a different quantum dot region. Each quantum dot region mentioned here may have its own optical properties, for example: each quantum dot region may have different transmittances for the same monochromatic light or complex light, etc. The incident light may reach the sensor through the quantum dot region. In the disclosed embodiment, a preset position may be set so that a single or multiple quantum dot regions obtain a spectral image at the preset position. The preset position may be a position where light enters the quantum dot region uniformly and concentratedly. For example: it may be a position where the quantum dot region corresponds to the region where light is uniformly and concentratedly distributed on the object being photographed.

[0063] The same or the same group of quantum dot regions can obtain one or more spectral images based on the same incident light at a preset position. Thus, all quantum dot regions can obtain multiple spectral images based on different incident light at a preset position. The incident light can be monochromatic light or polychromatic light. When the incident light is monochromatic light, the wavelengths of each incident light can be different. A single type of incident light can be light of multiple wavelengths. When the incident light is polychromatic light, the wavelengths contained in each polychromatic light can be different or not completely the same. The different incident lights mentioned above can be lights of different wavelengths or lights of different wavelength bands.

[0064] Exemplarily, position A is preset, and there are at least 200 quantum dot regions on the quantum dot spectrum device to be calibrated, and at least 300 types of light are preset. When a single quantum dot region is located at position A, the quantum dot region can be opposite to the calibration region on the photographed object, that is, the image formed on the single quantum dot region can be a subset of the calibration region, or the image formed on the single quantum dot region completely overlaps with the calibration region. The calibration region is an area determined based on actual experience, and can be an area formed by a preset radius with the center of the light spot as the center of the circle, or an area with maximum light intensity (concentrated area). Based on a single type of light, a single quantum dot region of the quantum dot spectrum device can be located at position A, and one or more images can be acquired. In this way, at least 60,000 spectral images can be obtained.

[0065] The quantum dot spectrum device may also include some identical quantum dot regions, which may be continuous or spaced apart, and the identical quantum dot regions are in the same channel.

[0066] S12, acquiring spectral data of the different incident lights by using a standard spectrometer.

[0067] In the disclosed embodiment, the standard spectrometer may be a fiber spectrometer or a calibrated quantum dot spectrometer. The standard spectrometer may obtain spectral data of various incident lights used in acquiring the spectral image in S11, and use the spectral data as the true value.

[0068] S13, determining, according to each of the spectral images, a response signal corresponding to each of the quantum dot regions under each of the incident lights.

[0069] A single spectral image can be an image obtained under the irradiation of incident light. In the embodiment of the present disclosure, the grayscale reflected by each quantum dot region on the spectral image can be extracted. In this way, the grayscale of each quantum dot region under the irradiation of each incident light can be obtained. For example: if n kinds of light are set, a single quantum dot region can correspond to n grayscales, where n is a positive integer. The grayscale can be a grayscale value on the spectral image. If it is a remote sensing quantum dot spectral device, this grayscale can be a DN (Digital Number) value. According to the grayscale of each quantum dot region, the response signal corresponding to each quantum dot region under each incident light can be determined. The response signal can characterize the sensitivity of the quantum dot region to the incident light.

[0070] S14, calibrating the quantum dot spectroscopy device according to the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectroscopy device and the spectral data.

[0071] In the embodiment of the present disclosure, the spectral data may be standard spectral data obtained by a standard spectrometer, and the standard spectral data is used as the real spectral data. The standard spectral data may characterize the incident intensity of each incident light. Optionally, the standard spectrometer may be a fiber optic spectrometer.

[0072] In the disclosed embodiment, the correspondence between the quantum dot region, the incident light, and the response signal can be obtained. Furthermore, the mapping relationship between the response signal and the incident intensity of the same quantum dot region under the same incident light can be obtained. The mapping relationship between the response signal and the incident intensity of each quantum dot region under each incident light can be used as the mapping relationship between the response signal and the spectral data of the quantum dot spectral device. Using this mapping relationship, the parameters of the quantum dot spectral device can be calculated to complete the calibration of the quantum dot spectral device. In this way, this quantum dot spectral device can be equivalent to a standard spectrometer.

[0073] The method disclosed in the present invention is directly applied to the quantum dot spectral device to be calibrated, and can be used to calibrate the quantum dot spectral device, so the relative position relationship of each component and various parameters in the quantum dot spectral device used in the two scenes of calibration and use are consistent. Since the spectral image is obtained using the quantum dot spectral device to be calibrated, the mapping relationship obtained by calibration can be directly used for the quantum dot spectral device. Compared with the calibration of chips or individual components, the calibration is more accurate, and there is no need to adjust the calibration results, and it can be used directly, thereby improving efficiency and calibration accuracy. The purpose of calibrating a quantum dot spectral device is to make all types of spectrometers compatible in their descriptions of the same observed object, and their measurement results are all close to the same absolute physical concept. By calibrating the quantum dot spectral device, the quantum dot spectral device can be made equivalent to a standard spectrometer, or the inter-unit difference can be eliminated.

[0074] In a possible implementation, the method further includes: spectrally reconstructing a signal detected by the quantum dot spectral device according to a mapping relationship between a response signal of the quantum dot spectral device and the spectral data; and / or, the quantum dot spectral device is mounted on a rotating structure; acquiring multiple spectral images through the quantum dot spectral device to be calibrated, comprising: irradiating a standard whiteboard having a calibration area with one type of incident light, controlling the rotation of the rotating structure according to a preset angle so that each of the quantum dot areas is located at the preset position, acquiring multiple spectral images according to an automatically determined exposure time, each of the spectral images including the calibration area, wherein the preset position is a position where the imaging range of the quantum dot area falls within the calibration area; switching to the next type of incident light to continue acquiring spectral images.

[0075] In an optional implementation, the quantum dot spectroscopy device may also acquire multiple spectral images by sweeping or pushing.

[0076] After calibrating the quantum dot spectroscopy device, spectrum reconstruction can be performed, so the mapping relationship between the response signal of the quantum dot spectroscopy device and the spectrum data mentioned above can also be used for spectrum reconstruction.

[0077] In the disclosed embodiment, the quantum dot spectroscopy device in the quantum dot spectroscopy device is mounted on a rotating structure. At least one angle is preset, and the rotating structure is controlled to rotate according to the angle to drive the quantum dot region to move so that each quantum dot region can be located at a preset position. The angle can be determined based on the spacing between the quantum dot regions and the distance from the object to be photographed. In order to both take clear photos and move the quantum dot regions to the preset positions in sequence, preferably, the angle is set to no more than 10 degrees.

[0078] In the disclosed embodiment, the object to be photographed may be a standard whiteboard, or other object, and at least one marker may be set on the standard whiteboard. The position of the marker may characterize the area of ​​maximum light intensity on the standard whiteboard (i.e., the calibration area) or the area formed by a preset radius with the center of the light spot as the center of the circle (i.e., the calibration area). After the rotating structure rotates according to the preset angle, the imaging range of the quantum dot area falls into the calibration area in turn. In order to allow the light to be more fully reflected from the standard whiteboard into the quantum dot area, a standard whiteboard with a high reflectivity may be selected. Taking into account the actual effect, after testing, a standard whiteboard with a reflectivity of 95% is preferably selected.

[0079] According to the lighting conditions during shooting, the exposure time can be automatically set for different light conditions. For example, the target image grayscale value can be preset, and the target image grayscale value can be the most conducive to processing the spectral image. The grayscale value corresponding to the quantum dot area is extracted, and based on the image grayscale value, the spectral image sensor can automatically calculate the exposure time under different light conditions, and obtain the spectral image according to the exposure time.

[0080] Figure 2 The schematic diagram of the optical path for calibrating the quantum dot spectroscopy device provided in the present disclosure is as follows. Figure 2 As shown, the monochromator 201 can separate monochromatic light from the wide-band light, and the monochromatic light passes through the lens 202 to amplify the light spot on the standard white board 203. A marker (not shown in the figure) is set in the area with uniform light on the standard white board. The quantum dot spectrum device (not shown in the figure) is installed on the rotating structure 204, and a plurality of vertical quantum dot areas (not shown in the figure) are set on the quantum dot spectrum device. The rotating structure rotates according to a preset angle so that the quantum dot areas are aligned with the markers in turn and the spectrum image is obtained.

[0081] In the disclosed embodiment, the rotating structure can be rotated to drive the quantum dot region to automatically move to the preset position in sequence, so that the imaging range of a single quantum dot region falls into the calibration area, so that the acquired spectral image contains more sufficient image information, which improves the accuracy of the subsequent determination of the mapping relationship. It also improves the usability of the spectral image.

[0082] When a single incident light irradiates the object, each quantum dot region can be switched so that each quantum dot region is at a preset position to obtain a spectral image. When each quantum dot region obtains a spectral image at a preset position under the irradiation of light of the same wavelength, the next light is switched and the above spectral image acquisition process is repeated.

[0083] For example, the quantum dot regions on the quantum dot spectroscopy device can be numbered, including: quantum dot region No. 1, quantum dot region No. 2, ..., quantum dot region No. n, where n is a positive integer. In addition, m kinds of light (with different wavelengths) are preset, including: first light, second light, ..., mth light, where m is a positive integer. When the first light irradiates the photographed object, strip No. 1 is located at a preset position to obtain a spectral image. Then, strip No. 2 is located at a preset position to obtain a spectral image, ..., each quantum dot region is located at a preset position and a spectral image is obtained in sequence. After the nth quantum dot is located at a preset position and a spectral image is obtained, the second light is switched to irradiate the photographed object, and then the photographing is performed according to the above process of each quantum dot region being located at a preset position and obtaining a spectral image. Then, other lights are switched in sequence to complete the spectral image shooting until the mth light irradiates the photographed object and the nth quantum dot region is located at a preset position and a spectral image is obtained, and the image acquisition stops.

[0084] In this way, the entire spectral image acquisition process can be completed automatically, improving the efficiency of image acquisition and saving manpower.

[0085] In a possible implementation, the incident light includes: monochromatic light and polychromatic light, and the obtaining of multiple spectral images through the quantum dot spectral device to be calibrated also includes: using the spectral images obtained under the irradiation of the monochromatic light as a training set, the training set is used to determine the mapping relationship, and the true value of the training set is the spectral data obtained using the standard spectrometer; using the spectral images obtained under the irradiation of the polychromatic light as a test set, the test set is used to verify the mapping relationship, and the true value of the test set is the spectral data obtained using the standard spectrometer; and / or, determining the response signal corresponding to each of the quantum dot regions under each incident light based on each of the spectral images, includes: determining a selected area on each of the spectral images; and determining the response signal of each quantum dot region within each of the selected areas.

[0086] In an embodiment of the present disclosure, multiple monochromatic lights and multiple polychromatic lights can be preset. Using the method for obtaining spectral images in the present disclosure, the spectral images obtained under monochromatic light illumination are used as a training set. At the same time, spectral data can be obtained using a standard spectrometer under each monochromatic light, and the spectral data obtained under the monochromatic light is used as the true value of the training set. In addition, the spectral images obtained under polychromatic light illumination can be used as a test set. At the same time, spectral data can be obtained using a standard spectrometer under each polychromatic light, and the spectral data obtained under each polychromatic light is used as the true value of the test set.

[0087] In the disclosed embodiment, a training set can be used to determine the initial mapping relationship between the response signal and the spectral data corresponding to each quantum dot region of the quantum dot spectroscopy device under each incident light. Then, a test set is used to verify whether the accuracy of the initial mapping relationship meets the preset verification conditions. If the verification conditions are not met, the training set can be continued to be used, or a new training set can be constructed to determine a new initial mapping relationship until the verification conditions are met. The final determined initial mapping relationship is used as the mapping relationship between the response signal and the spectral data of the quantum dot spectroscopy device.

[0088] Figure 3 The data collected by the quantum dot spectroscopy device and the data collected by the standard spectrometer after calibrating the image processing method provided by the present disclosure are as follows. Figure 3 As shown, the curve represents the data collected using a standard spectrometer, and the dot marks represent the data collected based on the quantum dot spectroscopy device after calibration (using the method disclosed in the present invention). The solid curve and the dotted curve respectively represent the data collected using a standard spectrometer under two polychromatic lights. The triangular dot marks and the circular dot marks respectively represent the data collected using a calibrated quantum dot spectroscopy device under two polychromatic lights. Among them, under one polychromatic light, the data represented by the triangular dot marks and the data represented by the solid curve are collected; under another polychromatic light, the data represented by the circular dot marks and the data represented by the dotted curve are collected. It can be seen that under these two polychromatic lights, the spectra of the data collected by the calibrated quantum dot spectroscopy device and the standard spectrometer are basically consistent.

[0089] In the disclosed embodiment, the spectral image acquired under monochromatic light is used as a training set, and a single training sample is only affected by monochromatic light and is not affected by light of other wavelengths, so that the calibration process is simplified and the accuracy of calibration is improved. The spectral image acquired under polychromatic light is used as a test set, and the calibration and / or spectral reconstruction effect can be more comprehensively verified to determine whether it is necessary to continue spectral reconstruction and / or calibration, thereby improving the accuracy of spectral reconstruction and / or calibration of the quantum dot spectral device, so that the quantum dot spectral device can be equivalent to the measurement effect of a standard spectrometer.

[0090] As mentioned above, the standard white board contains a calibration area. Then there is also a selected area on each spectral image, which represents the area where the light is uniform and concentrated on the object. The image information in the selected area is more accurate and reliable than that in other areas.

[0091] In the disclosed embodiment, the selected area on the spectrum image can be determined first, and then the response signal of the quantum dot area corresponding to the selected area can be determined. Since the selected area corresponds to the area with uniform light on the photographed object, the image information in the selected area is more accurate and reliable, so the accuracy of the response signal corresponding to each determined quantum dot area is improved.

[0092] In a possible implementation, the calibration area on the standard whiteboard is defined by at least two markers, and determining the selected area on each of the spectral images includes: determining a first position of the marker on each spectral image; based on the first position, determining the selected area according to a preset correspondence between the marker and the calibration area.

[0093] The first position may be the center coordinates or the upper left corner coordinates of the marker on the image. In order to facilitate identification of the marker on the spectral image, the shape of the marker may be a cross. The number of markers may be one, two, or more. The marker may be drawn on a standard whiteboard or may be formed on the whiteboard by marking other objects.

[0094] The first position may be determined by using a template matching method; the first position may be determined by using an edge detection method. In one example, edge detection may be used to determine a target area and narrow the scope of template matching. Template matching is performed within the target area to determine the first position, thereby improving the accuracy and efficiency of determining the first position.

[0095] In the embodiment of the present disclosure, a correspondence relationship between a marker and a calibration area may be set, and based on the correspondence relationship, a selected area may be determined according to the first position.

[0096] For example, the correspondence between the marker and the calibration area may include the area range, such as the length and width of the area, or the radius. The correspondence between the marker and the calibration area may include: stipulating that the first position is located at the upper left corner of the area. In other words, after obtaining the first position, the first position may be used as the upper left corner of the selected area, and the selected area is determined according to the area range.

[0097] Of course, the correspondence between the marker and the calibration area may include: specifying that the marker is located at a certain point on the edge of the calibration area. Alternatively, in the case of two markers, the spectral image may include two markers, and the correspondence between the marker and the calibration area may include: specifying that the two markers are respectively used as the upper left corner and the lower right corner of the calibration area. The embodiment of the present disclosure does not limit the specific form of the correspondence between the marker and the calibration area.

[0098] By using the method of the embodiment of the present disclosure, the selected area on the image can be determined quickly and accurately.

[0099] In a possible implementation, the calibration area on the standard whiteboard is defined by two markers, and determining the first position of the markers on each spectral image includes: performing template matching on a single spectral image to determine multiple candidate spots and the number of the candidate spots; when the number is not greater than 2, taking the center coordinates of the candidate spots as the first position; when the number is greater than 2, interpolating the candidate spots corresponding to adjacent images to determine the first position of the single spectral image.

[0100] In the disclosed embodiment, two markers may be set on the photographed object. The two markers may be arranged based on the setting direction of the quantum dot region. In the case where the quantum dot region is set vertically, the two markers may be set upside down and not on the same vertical line. Such an arrangement of the markers may increase the probability of determining the selected area on the spectral image and improve the usability of the spectral image.

[0101] Template matching can be used to search on the spectral image to determine the candidate spots suspected to be markers and the number of candidate spots. Theoretically, there should be no more than 2 markers on the spectral image, but the template matching method may misjudge and identify more than 2 markers. If the number of candidate spots is not greater than 2, it means that it meets theoretical expectations, and the candidate spots can be directly used as markers on the image, and the center coordinates of the candidate spots are used as the first position.

[0102] When the quantum dot region A is at a preset position, a spectral image A is obtained. The spectral image B obtained at the preset position of the quantum dot region adjacent to the quantum dot region A can be used as the adjacent image of the quantum dot region A. In other words, the adjacent image can be a spectral image obtained at the preset position of the quantum dot region adjacent to the quantum dot region corresponding to the single spectral image.

[0103] The first positions on adjacent spectral images may be different, but the difference is not large. If the number of candidate spots is greater than 2, it means that it does not meet theoretical expectations (i.e., a misjudgment occurs), and the first positions on adjacent images can be interpolated to determine the first position on the spectral image.

[0104] Although the template matching method has its own limitations, the method of the embodiment of the present disclosure can accurately determine the first position through the template matching method, thereby improving the applicability of the template matching method in the scenario of the present disclosure.

[0105] In a possible implementation, when the number is not greater than 2, the center coordinates of the candidate spot are used as the first position, including: when the number is 1 or 2, determining the degree of match between the candidate spot and the template; when the degree of match is less than a matching threshold, fine-tuning the position of the candidate spot in the direction of decreasing grayscale value according to the second grayscale value of the candidate spot and the surrounding grayscale values, and determining the fine-tuned candidate spot; using the center coordinates of the fine-tuned candidate spot as the first position; when the degree of match is not less than the matching threshold, directly using the center coordinates of the candidate spot as the first position.

[0106] When the number of candidate spots is 1 or 2, it is in line with theoretical expectations. In order to further improve the accuracy of the first position, the matching degree between the candidate spots and the template can be determined. A matching degree threshold can be set in advance, and the matching degree threshold is the minimum matching degree that can use the candidate spots as markers. If the matching degree between the candidate spots and the template is not less than the matching degree threshold, the center coordinates of the candidate spots are directly used as the first position.

[0107] If the match between the candidate spot and the template is less than the match threshold, the position of the candidate spot is fine-tuned. The grayscale of the marker on the spectral image is lower than the grayscale of the surrounding area. Therefore, the position of the candidate spot can be fine-tuned to the area with low grayscale value. The second grayscale value of the candidate spot can be obtained and compared with the surrounding grayscale value to determine the direction in which the surrounding grayscale value is lower than the second grayscale value, and the candidate spot can be fine-tuned in this direction to obtain the fine-tuned candidate spot. In addition, the center of the fine-tuned spot is used as the first position.

[0108] In the disclosed embodiment, based on the matching degree between the candidate image spot and the template, it is determined whether to fine-tune the position of the candidate image spot to further improve the accuracy of the determined first position.

[0109] In one possible implementation, determining the response signal corresponding to each of the quantum dot regions under each incident light includes: segmenting the spectral image to obtain a quantum dot region segmentation map; determining the boundary coordinates of each quantum dot region based on the quantum dot region segmentation map; determining the number of the first quantum dot region in each of the selected regions based on each of the boundary coordinates; determining the grayscale of each of the first quantum dot regions; and determining the response signal based on the number and the grayscale.

[0110] The disclosed embodiment does not limit the method for segmenting the spectral image.

[0111] Exemplarily, a spectral image can be obtained and the image size can be adjusted to be suitable for image segmentation. Then, based on the greedy clustering segmentation algorithm, the segmentation result is obtained; in the segmentation result, the maximum connected domain with a pixel value of 0 is counted, that is, the initial position of the quantum dot region is obtained. Then, the quantum dot region missing in the segmentation result is estimated by using the spacing distance and width of the quantum dot region. The pixel average value of a single quantum dot region is calculated, and the corresponding quantum dot region is filled with the pixel average value, and each quantum dot region is filled with this method. According to the width of the quantum dot region, an image region of a fixed width containing a quantum dot region located in the center area is cut out from each spectral image. These image regions are clustered using the kmeans clustering algorithm, and then the clustered image regions are subjected to straight line detection. The results of the straight line detection are used to constrain the left and right boundaries of the quantum dot region to prevent the quantum dot region from crossing the boundary. After that, irrelevant pixels above the upper edge of the quantum dot region are removed. The FLOODFILL algorithm is used to expand each quantum dot region to obtain a quantum dot region segmentation map and the boundary coordinates of each quantum dot region.

[0112] Figure 4 A schematic diagram of a quantum dot region segmentation diagram is provided for use of the present disclosure. When the quantum dot regions are arranged vertically, the boundary coordinates may be the horizontal coordinates of the left boundary and the horizontal coordinates of the right boundary of each quantum dot region. The quantum dot regions may be numbered in sequence on the quantum dot region segmentation diagram. The boundary coordinates of the first quantum dot region in the selected region may be determined, and compared with the boundary coordinates of each quantum dot region in the quantum dot region segmentation diagram to determine the number of the first quantum dot region in each selected region. The grayscale of the first quantum dot region with the same number may be determined, and then the average grayscale of each quantum dot region under each incident light may be determined, and the response signal of each quantum dot region under each incident light may be determined based on the average grayscale.

[0113] In the embodiment of the present disclosure, the number of each quantum dot region on the spectral image is obtained by segmenting the spectral image. Due to the characteristics of the relationship between the spectral image and the quantum dot region in the present disclosure (all spectral images can cover all quantum dot regions, and each quantum dot region can appear on multiple spectral images), based on the number and grayscale of the first quantum dot region, the response signal of each quantum dot region under each incident light is determined, thereby improving the accuracy of the response signal.

[0114] In a possible implementation, the incident light includes: monochromatic light and / or polychromatic light, and the method further includes: for the response signals obtained for the same quantum dot area under the irradiation of different monochromatic lights, when the difference between the response signals in the first band and the adjacent band is greater than the first response threshold, determining the first image to be processed, reacquiring a new spectral image using the same acquisition conditions as the first image to be processed, and replacing the first image to be processed with the new spectral image; and / or, when each of the quantum dot areas is located at a preset position, for the multiple second spectral images obtained by the quantum dot spectral device under the irradiation of the same monochromatic light, in the second spectral image and the adjacent second spectral images, the same quantum dot When the difference in the response signals of the regions is greater than a second response threshold, a second image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as those for the second image to be processed, and the second image to be processed is replaced by the new spectral image; and / or, based on a third spectral image acquired by the quantum dot spectral device under different irradiations of the complex light, the theoretical output light intensity corresponding to each quantum dot channel is determined; for the third spectral image, when the difference between the theoretical output light intensity and the corresponding measured output light intensity is greater than the light intensity threshold, a third image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as those for the third image to be processed, and the third image to be processed is replaced by the new spectral image.

[0115] In the example disclosed herein, when different monochromatic lights are irradiated and each quantum dot region is at a preset position, multiple first spectral images can be obtained. From the first spectral image, the grayscale of the quantum dot region at the preset position on the first spectral image can be determined. Thus, the corresponding response signal of a single quantum dot region at the preset position and under the irradiation of different monochromatic lights (bands) can be determined. Exemplarily, the standard whiteboard is irradiated with light of the first band and the spectral image is obtained, and then the light of the next band is switched to irradiate the standard whiteboard and obtain the spectral image. Then the first band and the next band are adjacent bands to each other. The response signals of each quantum dot region can be obtained under the irradiation of the first band and the irradiation of the next band, and the difference of the response signals of the adjacent bands of the same quantum dot region is compared with the first response threshold value. When the difference is greater than the first response threshold value, the spectral image corresponding to the first band is used as the first image to be processed. A new spectral image is reacquired using the same acquisition conditions as the first image to be processed, and the first image to be processed is replaced with the new spectral image.

[0116] For a single first waveband, there may be one adjacent waveband or two adjacent wavebands. If there are two adjacent wavebands, it means that there is one waveband irradiating the standard white board before and after switching the first waveband.

[0117] For the same quantum dot area, if the first band P has two adjacent bands, and the difference between the response signals of the first band P and the two adjacent bands is greater than the first response threshold, the spectral image collected at the preset position of the quantum dot area when the first band P illuminates a standard white board is determined as the first image to be processed.

[0118] For the same quantum dot area, if the first band P has two adjacent bands, and the difference in response signals between the first band P and the adjacent band A is greater than the first response threshold, and the difference in response signals with the adjacent band B is not greater than the first response threshold, then the spectral image collected at the preset position of the quantum dot area when the adjacent band A illuminates the standard white board is determined as the first image to be processed.

[0119] If there is only one adjacent wavelength band, it means that there is light of one wavelength band illuminating the standard white plate before or after switching the first wavelength band.

[0120] For the same quantum dot region, if there is an adjacent band C (adjacent band C is also adjacent to band Q) for the first band P, and the difference between the response signals of the first band P and the adjacent band C is greater than the first response threshold, then it is necessary to determine the difference between the response signals of the adjacent band C and band Q. If the difference between the response signals of the adjacent band C and band Q is greater than the first response threshold, the spectral image collected at the preset position of the quantum dot region when the adjacent band C irradiates the standard white board is determined as the first image to be processed. If this difference is not greater than the first response threshold, the spectral image collected at the preset position of the quantum dot region when the first band P irradiates the standard white board is determined as the first image to be processed.

[0121] The spectral image can be re-acquired using the same acquisition conditions as the first image to be processed (monochromatic light, quantum dot region at a preset position) to replace the first image to be processed.

[0122] In the disclosed example, the position of the quantum dot region can be switched according to the arrangement order of the quantum dot region to obtain a second spectral image. The second spectral image can be a spectral image obtained when a single quantum dot region is at a preset position and under monochromatic light. Adjacent second spectral images can be spectral images obtained when a quantum dot region adjacent to the single quantum dot region is switched to a preset position under the same monochromatic light. Adjacent second spectral images are obtained under the irradiation of light of the same wavelength. On adjacent second spectral images, there will not be a big difference in the response signal corresponding to the same quantum dot region. For the convenience of description, the maximum acceptable value for the difference can be named the second response threshold. For a single second spectral image, there can be one adjacent image or two adjacent images. If there are two adjacent images, it means that spectral images were also collected before and after the acquisition of the second spectral image.

[0123] If there are two adjacent images for the second spectral image P, and the difference between the response intensity corresponding to the same quantum dot area on the second spectral image P and the response intensity corresponding to the two adjacent images is greater than the second response threshold, the second spectral image P is determined as the second image to be processed.

[0124] If there are two adjacent images for the second spectral image P, and the difference between the response intensity corresponding to the same quantum dot area on the second spectral image P and the corresponding response intensity on the adjacent image D is greater than the second response threshold, and the difference with the corresponding response intensity on the adjacent image E is not greater than the second response threshold, then the adjacent image D is determined as the second image to be processed.

[0125] If there is only one adjacent image, it means that a spectral image is acquired before or after the second spectral image is acquired.

[0126] If there is an adjacent image F (adjacent image F is also adjacent to the second spectral image Q) for the second spectral image P, and the difference between the response intensity corresponding to the same quantum dot region on the second spectral image P and the response intensity corresponding to the adjacent image F is greater than the second response threshold, then it is necessary to determine the difference between the response intensity corresponding to the quantum dot region on the adjacent image F and the response intensity corresponding to the second spectral image Q. If the difference is greater than the second response threshold, the adjacent image F is determined as the second image to be processed. If the difference is not greater than the second response threshold, the second spectral image P is determined as the second image to be processed.

[0127] The spectral image can be re-acquired using the same acquisition conditions as the second image to be processed (monochromatic light, quantum dot region at a preset position) to replace the second image to be processed.

[0128] In the disclosed embodiment, the theoretical emission light intensity of each quantum dot region can be obtained; and the measured emission light intensity of each quantum dot region is determined based on each third spectral image. The difference between the theoretical emission light intensity that can be accepted and the corresponding measured emission light intensity is preset, and the difference is named as the light intensity threshold for the convenience of description. When the difference between the theoretical emission light intensity and the measured emission light intensity is greater than the light intensity threshold, the third quantum image is determined as the third image to be processed. The spectral image can be re-acquired using the same acquisition conditions as the second image to be processed (complex light, quantum dot region at a preset position) to replace the third image to be processed.

[0129] In the embodiment of the present disclosure, after obtaining the spectral images, these spectral images can be quality inspected, unqualified spectral images can be screened out, and the spectral images can be reacquired under the same conditions to improve the accuracy of subsequent calibration and / or spectral reconstruction of the quantum dot spectral device.

[0130] Figure 5 This is a schematic diagram of the structure of a quantum dot spectroscopy device image processing device provided by the present disclosure. The device 20 includes:

[0131] A quantum dot spectral device 21 is used to obtain a plurality of spectral images through a quantum dot spectral device to be calibrated, wherein the quantum dot spectral device comprises a plurality of channels, each of the channels corresponds to a different quantum dot region, each of the quantum dot regions has a different optical property, and the plurality of spectral images are images obtained by the quantum dot spectral device based on different incident light when each of the quantum dot regions is located at a preset position;

[0132] A standard spectrometer 22, used for acquiring spectral data of the different incident lights through a standard spectrometer;

[0133] A response signal determination unit 23, used to determine the response signal corresponding to each of the quantum dot regions under each incident light according to each of the spectral images;

[0134] The mapping relationship acquisition unit 24 is used to calibrate the quantum dot spectroscopy device according to the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectroscopy device and the spectral data.

[0135] In a possible implementation, the device 20 further includes:

[0136] a spectrum reconstruction unit, configured to perform spectrum reconstruction on the signal detected by the quantum dot spectrum device according to the obtained mapping relationship between the response signal of the quantum dot spectrum device and the spectrum data; and / or, the quantum dot spectrum device is mounted on a rotating structure;

[0137] The quantum dot spectroscopy device 21 is further used for:

[0138] A standard white plate with a calibration area is irradiated with one type of incident light, and the rotating structure is controlled to rotate according to a preset angle so that each quantum dot area is located at the preset position, and a plurality of spectral images are acquired according to an automatically determined exposure time, each spectral image including the calibration area, wherein the preset position is a position where the imaging range of the quantum dot area falls within the calibration area; the next type of incident light is switched to continue acquiring spectral images.

[0139] In a possible implementation, the incident light includes: monochromatic light and polychromatic light, and the quantum dot spectrum device 21 further includes:

[0140] A training set determination unit, used to use the spectral image acquired under the irradiation of the monochromatic light as a training set, wherein the training set is used to determine the mapping relationship, and the true value of the training set is the spectral data obtained using the standard spectrometer;

[0141] a test set determination unit, configured to use a spectral image obtained under the illumination of the polychromatic light as a test set, wherein the test set is used to verify the mapping relationship, and the true value of the test set is spectral data obtained using the standard spectrometer; and / or,

[0142] The response signal determination unit 23 includes:

[0143] A selected area determination unit, used to determine the selected area on each of the spectral images;

[0144] The response signal determination subunit is used to determine the response signal of each quantum dot area in each selected area.

[0145] In a possible implementation, the marked area on the standard whiteboard is defined by at least two markers, and the selected area determination unit is further configured to:

[0146] determining a first position of the marker on each spectral image;

[0147] Based on the first position, the selected area is determined according to a preset correspondence between the marker and the calibration area.

[0148] In a possible implementation, the marked area on the standard whiteboard is defined by two markers, and the selected area determination unit is further configured to:

[0149] Performing template matching on a single spectral image to determine a plurality of candidate spots and the number of the candidate spots;

[0150] When the number is not greater than 2, the center coordinates of the candidate spots are used as the first positions;

[0151] When the number is greater than 2, candidate image spots corresponding to adjacent images are interpolated to determine the first position of the single spectral image.

[0152] In a possible implementation manner, the selected area determination unit is further configured to:

[0153] When the number is 1 or 2, determining the matching degree between the candidate pattern spot and the template;

[0154] When the matching degree is less than the matching degree threshold, the position of the candidate spot is fine-tuned in the direction of decreasing the grayscale value according to the second grayscale value of the candidate spot and the surrounding grayscale values, to determine a fine-tuned candidate spot;

[0155] The center coordinates of the finely adjusted candidate image patch are used as the first position;

[0156] When the matching degree is not less than the matching degree threshold, the center coordinates of the candidate image spot are directly used as the first position.

[0157] In a possible implementation, the incident light includes: monochromatic light and / or polychromatic light, and the device 20 further includes:

[0158] A first image to be processed replacement unit is used for determining a first image to be processed for response signals obtained from the same quantum dot region under different monochromatic light irradiations, when the difference between the response signals in a first band and an adjacent band is greater than a first response threshold, reacquiring a new spectral image using the same acquisition conditions as the first image to be processed, and replacing the first image to be processed with the new spectral image; and / or,

[0159] A second image to be processed replacement unit is used for, when each of the quantum dot regions is located at a preset position, for a plurality of second spectral images acquired by the quantum dot spectral device under the same monochromatic light irradiation, when the difference in response signals of the same quantum dot region in a second spectral image and an adjacent second spectral image is greater than a second response threshold, determining a second image to be processed, reacquiring a new spectral image using the same acquisition conditions as the second image to be processed, and replacing the second image to be processed with the new spectral image; and / or,

[0160] A theoretical emergent light intensity determination unit, used to determine the theoretical emergent light intensity corresponding to each quantum dot channel based on the third spectrum image obtained by the quantum dot spectrum device under the irradiation of different polychromatic lights;

[0161] A third image to be processed replacement unit is used to determine a third image to be processed for a third spectral image, when the difference between the theoretical emergent light intensity and the corresponding measured emergent light intensity is greater than a light intensity threshold, reacquire a new spectral image using the same acquisition conditions as those of the third image to be processed, and replace the third image to be processed with the new spectral image.

[0162] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0163] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0164] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0165] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0166] Figure 6 The schematic diagram of the structure of an electronic device of a quantum dot spectroscopy device provided by the present disclosure. For example, the electronic device 1900 can be provided as a server or a terminal device. Figure 6 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0167] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output interface 1958 (I / O interface). The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server 2000.TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM or similar.

[0168] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.

[0169] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0170] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the above. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the above. The computer-readable storage medium used herein is not to be interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0171] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0172] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect through the Internet). In some embodiments, by using the state information of the computer-readable program instructions to personalize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit may execute the computer-readable program instructions, thereby implementing various aspects of the present disclosure.

[0173] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of boxes in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0174] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0175] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0176] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0177] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An image processing method for a quantum dot spectroscopy device, characterized in that: include: Acquire a plurality of spectral images by a quantum dot spectral device to be calibrated, the quantum dot spectral device comprising a plurality of channels, each channel corresponding to a different quantum dot region, each quantum dot region having a different optical property, the plurality of spectral images being images obtained by the quantum dot spectral device based on different incident light when each quantum dot region is located at a preset position; Acquiring spectral data of the different incident lights by a standard spectrometer; Determining, according to each of the spectral images, a response signal corresponding to each of the quantum dot regions under each of the incident lights; The quantum dot spectroscopy device is calibrated according to the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectroscopy device and the spectral data.

2. The method according to claim 1, characterized in that The method further comprises: reconstructing the spectrum of the signal detected by the quantum dot spectrum device according to the obtained mapping relationship between the response signal of the quantum dot spectrum device and the spectrum data; and / or, The quantum dot spectroscopy device is mounted on a rotating structure; The method of acquiring a plurality of spectral images through the quantum dot spectral device to be calibrated comprises: A standard white plate with a calibration area is irradiated with one type of incident light, and the rotating structure is controlled to rotate according to a preset angle so that each quantum dot area is located at the preset position, and a plurality of spectral images are acquired according to an automatically determined exposure time, each spectral image including the calibration area, wherein the preset position is a position where the imaging range of the quantum dot area falls within the calibration area; the next type of incident light is switched to continue acquiring spectral images.

3. The method according to claim 2, characterized in that The incident light includes: monochromatic light and polychromatic light, and the multiple spectral images are obtained by the quantum dot spectral device to be calibrated, and further includes: Using the spectral image acquired under the irradiation of the monochromatic light as a training set, wherein the training set is used to determine the mapping relationship, and the true value of the training set is the spectral data obtained using the standard spectrometer; The spectral image obtained under the illumination of the polychromatic light is used as a test set, the test set is used to verify the mapping relationship, and the true value of the test set is the spectral data obtained using the standard spectrometer; and / or, Determining the response signal corresponding to each quantum dot region under each incident light according to each spectral image includes: Determining a selected area on each of the spectral images; The response signal of each quantum dot region within each of the selected regions is determined.

4. The method according to claim 3, characterized in that The calibration area on the standard white board is defined by at least two markers, and the determining of the selected area on each of the spectral images comprises: determining a first position of the marker on each spectral image; Based on the first position, the selected area is determined according to a preset correspondence between the marker and the calibration area.

5. The method according to claim 4, characterized in that The calibration area on the standard whiteboard is defined by two markers, and determining the first position of the markers on each spectral image includes: Performing template matching on a single spectral image to determine a plurality of candidate spots and the number of the candidate spots; When the number is not greater than 2, the center coordinates of the candidate spots are used as the first positions; When the number is greater than 2, candidate image spots corresponding to adjacent images are interpolated to determine the first position of the single spectral image.

6. The method according to claim 5, characterized in that When the number is no more than 2, taking the center coordinates of the candidate spots as the first positions includes: When the number is 1 or 2, determining the matching degree between the candidate pattern spot and the template; When the matching degree is less than the matching degree threshold, the position of the candidate spot is fine-tuned in the direction of decreasing the grayscale value according to the second grayscale value of the candidate spot and the surrounding grayscale values, to determine a fine-tuned candidate spot; The center coordinates of the finely adjusted candidate image patch are used as the first position; When the matching degree is not less than the matching degree threshold, the center coordinates of the candidate image spot are directly used as the first position.

7. The method according to any one of claims 1 to 6, characterized in that: The incident light includes: monochromatic light and / or polychromatic light, and the method further includes: For the response signals obtained from the same quantum dot region under different monochromatic light irradiations, when the difference between the response signals in the first band and the adjacent band is greater than the first response threshold, a first image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as the first image to be processed, and the first image to be processed is replaced with the new spectral image; and / or, When each of the quantum dot regions is located at a preset position, for a plurality of second spectral images acquired by the quantum dot spectral device under the same monochromatic light irradiation, when the difference in response signals of the same quantum dot region in a second spectral image and an adjacent second spectral image is greater than a second response threshold, a second image to be processed is determined, a new spectral image is acquired again using the same acquisition conditions as the second image to be processed, and the second image to be processed is replaced with the new spectral image; and / or, Determine the theoretical output light intensity corresponding to each quantum dot channel based on the third spectrum image obtained by the quantum dot spectrum device under the irradiation of different polychromatic lights; For the third spectral image, when the difference between the theoretical output light intensity and the corresponding measured output light intensity is greater than the light intensity threshold, a third image to be processed is determined, a new spectral image is reacquired using the same acquisition conditions as the third image to be processed, and the new spectral image is used to replace the third image to be processed.

8. An image processing device, characterized in that: include: A quantum dot spectral device, used to obtain a plurality of spectral images through a quantum dot spectral device to be calibrated, wherein the quantum dot spectral device comprises a plurality of channels, each of the channels corresponds to a different quantum dot region, each of the quantum dot regions has a different optical property, and the plurality of spectral images are images obtained by the quantum dot spectral device based on different incident light when each of the quantum dot regions is located at a preset position; A standard spectrometer, used for acquiring spectral data of the different incident lights through the standard spectrometer; A response signal determination unit, used to determine the response signal corresponding to each of the quantum dot regions under each incident light according to each of the spectral images; A mapping relationship acquisition unit is used to calibrate the quantum dot spectroscopy device according to the spectral data and the response signal to obtain a mapping relationship between the response signal of the quantum dot spectroscopy device and the spectral data.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method described in any one of claims 1 to 7 when executing the instructions stored in the memory.

10. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images