Optical imaging-based image reconstruction method and apparatus, storage medium, and optical imaging device

Abstract

An optical imaging-based image reconstruction method and apparatus, a storage medium, and an optical imaging device. The method comprises: acquiring surface optical signals of an imaging target corresponding to a plurality of light sources; decomposing the surface optical signals corresponding to the plurality of light sources into surface optical signals corresponding to a plurality of single light sources; sequentially reconstructing surface optical signals corresponding to the plurality of single light sources, to obtain reconstruction results corresponding to all the single light sources; and adding the reconstruction results corresponding to all the single light sources, to obtain a three-dimensional distribution of the plurality of light sources in the imaging target.

Description

Optical imaging image reconstruction method, device and storage medium and optical imaging equipment TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of medical imaging equipment, and in particular to an optical imaging image reconstruction method, a computer readable storage medium, an optical imaging image reconstruction device and an optical imaging equipment. BACKGROUND

[0002] Bioluminescence, which is generally produced by cells transfected with a luminescent reporter gene (e.g., luciferase), can be used as a marker to distinguish specific tissue types (e.g., tumors), monitor physiological functions, and track the distribution of therapeutic compounds administered to tissues. In addition, molecular fluorescence is another optical imaging technique that can be used to track cells or molecules in the body, and this technology has been demonstrated using green fluorescent protein (GFP), near-infrared (NIR) dyes (such as Cy5), quantum dots, etc. In short, in the phenomenon of molecular fluorescence, a substance absorbs light of a specific wavelength and emits light of a different wavelength.

[0003] Currently, when positioning a lesion target in a small animal, bioluminescence tomography (BLT) technology or fluorescence molecular optical tomography (FMT) technology can be used to simulate the propagation process of photons in the small animal, and the three-dimensional distribution of the light source (i.e., the lesion) in the small animal can be inferred according to the optical signals on the surface of the small animal.

[0004] However, the related art has the problem that, on the one hand, the same small animal can carry multiple lesions (light sources) at the same time, and the bioluminescence signal intensity of different lesions can differ greatly, making it difficult to recover the lesion corresponding to the small signal through reconstruction, and on the other hand, the optical signals emitted by adjacent lesions can overlap on the surface of the organism, causing interference in the subsequent reconstruction process and making it difficult to separate different lesions, making it very difficult to reconstruct the BLT or FMT image of multiple light sources.

[0005] SUMMARY

[0006] The present disclosure aims to at least partially solve one of the technical problems in the related art. To this end, a first object of the present disclosure is to provide an optical imaging image reconstruction method capable of accurately realizing the simultaneous positioning of multiple light sources in the case of large differences in surface optical signal intensity of multiple light sources and / or overlapping of surface optical signals of multiple light sources.

[0007] A second object of the present disclosure is to provide a computer readable storage medium.

[0008] A third object of the present disclosure is to provide an optical imaging image reconstruction device.

[0009] A fourth object of the present disclosure is to provide an optical imaging device.

[0010] To achieve the above object, the optical imaging image reconstruction method according to a first aspect of the present disclosure comprises: acquiring surface optical signals of corresponding multiple light sources of an imaging target; decomposing the surface optical signals of the corresponding multiple light sources into surface optical signals of corresponding multiple single light sources; sequentially reconstructing the surface optical signals of the corresponding multiple single light sources to acquire a reconstruction result corresponding to each single light source; and adding the reconstruction results corresponding to each single light source to obtain a three-dimensional distribution of the multiple light sources on the imaging target.

[0011] According to the optical imaging image reconstruction method of the present disclosure, the surface optical signals of corresponding multiple light sources of an imaging target are acquired, and then the surface optical signals of the corresponding multiple light sources are decomposed into surface optical signals of corresponding multiple single light sources. Then, the surface optical signals of the corresponding multiple single light sources are sequentially reconstructed to acquire a reconstruction result corresponding to each single light source, and the reconstruction results corresponding to each single light source are added to obtain a three-dimensional distribution of the multiple light sources on the imaging target. In this way, by decomposing the surface optical signals of the multiple light sources into surface optical signals of several single light sources, sequentially reconstructing the decomposed surface optical signals of the single light sources, and adding the reconstruction results corresponding to each single light source, the three-dimensional distribution of the multiple light sources on the imaging target is obtained. Thus, in the case of large differences in surface optical signal intensity and / or surface optical signal overlap of the multiple light sources, the simultaneous positioning of the multiple light sources is accurately realized.

[0012] In addition, the optical imaging image reconstruction method according to the above-mentioned embodiments of the present disclosure can also have the following additional technical features:

[0013] In some embodiments of the present disclosure, the decomposing the surface optical signals of the corresponding multiple light sources into surface optical signals of corresponding multiple single light sources comprises: performing signal fitting on the surface optical signals of the corresponding multiple light sources to obtain a fitting signal corresponding to each single light source; generating a mask plate corresponding to each single light source according to the fitting signal corresponding to each single light source; and decoupling the surface optical signals of the corresponding multiple light sources by using the mask plate corresponding to each single light source to obtain the surface optical signals of the corresponding multiple single light sources.

[0014] In some embodiments of the present disclosure, the signal fitting on the surface optical signals of the corresponding multiple light sources comprises: acquiring local maximum values of the surface optical signals of the corresponding multiple light sources; and determining the number of single light sources and the center position of each single light source according to the number of local maximum values.

[0015] In some embodiments of the present disclosure, the method further comprises: obtaining initial signal parameters for generating the fitting signal corresponding to each single light source according to the center position of the corresponding single light source; optimizing the initial signal parameters to minimize the error between the fitting signal corresponding to each single light source and the surface optical signal of the corresponding multi-light source after the fitting signal corresponding to each single light source is added together, to obtain optimal signal parameters; and obtaining the fitting signal of the corresponding single light source according to the optimal signal parameters.

[0016] In some embodiments of the present disclosure, the fitting signal comprises a Gaussian signal, and the initial signal parameters comprise a center position coordinate, an amplitude and a covariance matrix of the fitting signal.

[0017] In some embodiments of the present disclosure, the generating of the mask plate corresponding to each single light source according to the fitting signal of the corresponding single light source comprises: obtaining a proportion of the fitting signal of the corresponding single light source in the surface optical signal of the corresponding multi-light source; and generating the mask plate corresponding to each single light source according to the proportion.

[0018] In some embodiments of the present disclosure, the method further comprises: setting to zero the pixel value of each mask plate of the corresponding single light source that is less than a preset threshold.

[0019] To achieve the above object, a computer readable storage medium according to the second aspect of the present disclosure has an optical imaging image reconstruction program stored thereon, and the optical imaging image reconstruction program is executed by a processor to implement the optical imaging image reconstruction method according to the foregoing embodiments of the present disclosure.

[0020] The computer readable storage medium according to the embodiments of the present disclosure can accurately realize the simultaneous positioning of the multi-light source in the case of large differences in the surface optical signal intensity of the multi-light source and / or the overlapping of the surface optical signals by executing the optical imaging image reconstruction program stored thereon.

[0021] To achieve the above object, an optical imaging image reconstruction device according to the third aspect of the present disclosure comprises: a first obtaining module configured to obtain the surface optical signal of the corresponding multi-light source of an imaging target; a decomposition module configured to decompose the surface optical signal of the corresponding multi-light source into the surface optical signal of the corresponding multiple single light sources; a reconstruction module configured to sequentially reconstruct the surface optical signal of the corresponding multiple single light sources to obtain the reconstruction result of the corresponding single light source; and a second obtaining module configured to add together the reconstruction result of the corresponding single light source to obtain the three-dimensional distribution of the multi-light source on the imaging target.

[0022] According to the optical imaging image reconstruction device provided in the embodiments of the present disclosure, the surface optical signals of the corresponding multiple light sources of the imaging target are acquired by the first acquisition module, then the surface optical signals of the corresponding multiple light sources are decomposed into the surface optical signals of the corresponding multiple single light sources by the decomposition module, then the surface optical signals of the corresponding multiple single light sources are sequentially reconstructed by the reconstruction module to acquire the reconstruction results corresponding to each single light source, and finally the reconstruction results corresponding to each single light source are added by the second acquisition module to acquire the three-dimensional distribution of the multiple light sources on the imaging target. In this way, the surface optical signals of the multiple light sources are decomposed into the surface optical signals of several single light sources, the surface optical signals of the decomposed single light sources are sequentially reconstructed, and the reconstruction results corresponding to each single light source are added to acquire the three-dimensional distribution of the multiple light sources on the imaging target, so that the simultaneous positioning of the multiple light sources can be accurately realized in the case that the surface optical signals of the multiple light sources have large intensity differences and / or are overlapped.

[0023] To achieve the above object, the optical imaging device provided in the fourth aspect of the present disclosure comprises the optical imaging image reconstruction device provided in the embodiments of the present disclosure.

[0024] According to the optical imaging device provided in the embodiments of the present disclosure, the simultaneous positioning of the multiple light sources can be accurately realized in the case that the surface optical signals of the multiple light sources have large intensity differences and / or are overlapped by using the optical imaging image reconstruction device.

[0025] The additional aspects and advantages of the present disclosure will be partially given in the following description, partially become obvious from the following description, or be known by the practice of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative effort on the basis of the drawings shown.

[0027] FIG. 1 is a flow diagram of an optical imaging image reconstruction method according to an embodiment of the present disclosure;

[0028] FIG. 2 is a flow diagram of an optical imaging image reconstruction method according to an embodiment of the present disclosure;

[0029] FIG. 3 is a flow diagram of an optical imaging image reconstruction method according to another embodiment of the present disclosure;

[0030] FIG. 4 is an image diagram of an optical imaging image reconstruction method according to a specific embodiment of the present disclosure;

[0031] FIG. 5 is an image schematic diagram of an optical imaging image reconstruction method according to another specific embodiment of the present disclosure;

[0032] FIG. 6 is a block schematic diagram of an optical imaging image reconstruction apparatus according to an embodiment of the present disclosure;

[0033] FIG. 7 is a block schematic diagram of an optical imaging device according to an embodiment of the present disclosure.

[0034] The implementation, functional features and advantages of the present disclosure will be further described with reference to the embodiments, with reference to the accompanying drawings. DETAILED DESCRIPTION

[0035] The embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar notations represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by reference to the accompanying drawings are exemplary and are intended to explain the present disclosure, and cannot be understood as a limitation of the present disclosure.

[0036] The optical imaging image reconstruction method, computer readable storage medium, optical imaging image reconstruction apparatus and optical imaging device of the embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0037] FIG. 1 is a flow schematic diagram of an optical imaging image reconstruction method according to an embodiment of the present disclosure.

[0038] Specifically, in some embodiments of the present disclosure, as shown in FIG. 1, the optical imaging image reconstruction method comprises:

[0039] S101, acquiring surface optical signals of corresponding multi-light sources of an imaging target.

[0040] It can be understood that in this embodiment of the present disclosure, the surface optical signals of corresponding multi-light sources of the imaging target can be acquired through the bio-luminescence image and the molecular fluorescence image of the imaging target.

[0041] Specifically, the acquisition method of the bio-luminescence image is: through the chemical reaction inside the imaging target, the bio-luminescence signal is released, the emitted bio-luminescence signal is collected and processed by the CCD camera after passing through the mirror and the filter to acquire the surface optical signals of corresponding multi-light sources; or, the generated bio-luminescence does not pass through the reflection, only passes through the filter, and then is collected and processed by the CCD camera to acquire the surface optical signals of corresponding multi-light sources; or, the generated bio-luminescence does not pass through the reflection and does not need to pass through the filter, and is directly collected and processed by the CCD camera to acquire the surface optical signals of corresponding multi-light sources.

[0042] The chemical reaction inside the imaging object is from the enzymatic reaction in the living organism, is the autofluorescence in the animal body, and the enzyme catalyzing the reaction is called luciferase. A commonly used method is to construct an expression vector of the luciferase gene, transfect target cells, and transplant into the target organ of the recipient. When observing, exogenous luciferin is injected, and the target cells can react to produce fluorescence. Then, a high-sensitivity in vivo biological optical imaging system can be used to realize real-time monitoring of the expression of target cells or target molecules.

[0043] The method for acquiring the molecular fluorescence image is: turning on the excitation light source, the excitation light source emits excitation light to irradiate the imaging target, the excitation imaging object carries the fluorescent molecules, and emits fluorescence is generated; the generated emitted fluorescence is reflected by the reflector and filtered by the filter, or the generated emitted fluorescence is not reflected but only filtered by the filter, and then the corresponding surface optical signals of multiple light sources are acquired by the CCD camera after being collected and processed.

[0044] S102, the surface optical signals corresponding to multiple light sources are decomposed into surface optical signals corresponding to multiple single light sources.

[0045] It can be understood that in this embodiment of the disclosure, before the three-dimensional BLT (Bioluminescence Tomography) or FMT (Fluorescence Molecular Tomography) image reconstruction of the multiple light source targets in the imaging target is performed, the surface optical signals corresponding to multiple light sources are first decomposed into surface optical signals corresponding to multiple single light sources, that is, the surface optical signals of the multiple light source targets are decomposed into surface optical signals of several independent light source targets.

[0046] S103, the surface optical signals corresponding to multiple single light sources are sequentially reconstructed to obtain the reconstruction result corresponding to each single light source.

[0047] It can be understood that in this embodiment of the disclosure, the existing BLT reconstruction algorithm or FMT reconstruction algorithm can be used to sequentially reconstruct the surface optical signals corresponding to multiple single light sources to obtain the reconstruction result corresponding to each single light source.

[0048] S104, the reconstruction results corresponding to each single light source are added to obtain the three-dimensional distribution of the multiple light sources in the imaging target.

[0049] It can be understood that, in this embodiment of the present disclosure, the three-dimensional distribution of the multiple light sources in the imaging target is obtained by decomposing the surface optical signal of the multiple light sources into a plurality of surface optical signals of single light sources, then sequentially reconstructing the decomposed surface optical signals of the single light sources, and adding the reconstruction results corresponding to each single light source, thereby converting the complex multiple light source BLT reconstruction problem or FMT reconstruction problem into a plurality of single light source BLT reconstruction problems or FMT reconstruction problems, so as to accurately realize the simultaneous positioning of the multiple light sources in the case of large difference in surface optical signal intensity of the multiple light sources and / or surface optical signal overlap.

[0050] Optionally, in some embodiments of the present disclosure, the three-dimensional distribution of the multiple light sources in the imaging target can include the position of each light source in the imaging target and the depth and volume information of each light source.

[0051] Further, in some embodiments of the present disclosure, as shown in FIG. 2, decomposing the surface optical signal corresponding to the multiple light sources into a plurality of surface optical signals corresponding to single light sources includes:

[0052] S201, signal fitting is performed on the surface optical signal corresponding to the multiple light sources to obtain a fitted signal corresponding to each single light source.

[0053] It can be understood that, in this embodiment of the present disclosure, the surface optical signal corresponding to the multiple light sources is decomposed into a plurality of fitted signals corresponding to each single light source by signal fitting (for example, least squares method, polynomial fitting, Fourier transform, exponential smoothing, Gaussian fitting, maximum likelihood fitting, Bayesian method, adaptive filtering, neural network, wavelet transform, spectral estimation, etc.).

[0054] S202, a mask corresponding to each single light source is generated according to the fitted signal corresponding to each single light source.

[0055] Specifically, in some embodiments of the present disclosure, the mask corresponding to each single light source is generated according to the fitted signal corresponding to each single light source, including: obtaining the proportion of the fitted signal corresponding to each single light source in the surface optical signal corresponding to the multiple light sources, and generating the mask corresponding to each single light source according to the proportion.

[0056] It can be understood that, in this embodiment of the present disclosure, the mask corresponding to each single light source can be generated for each light source target according to the proportion by obtaining the proportion of the fitted signal corresponding to each single light source in the surface optical signal corresponding to the multiple light sources.

[0057] Optionally, in some embodiments of the present disclosure, the method further includes: setting to zero the pixel value of each mask smaller than a preset threshold in the mask corresponding to each single light source.

[0058] It can be understood that in this embodiment of the present disclosure, the invalid noise influence can also be avoided by setting the pixel value of each mask plate corresponding to each single light source to zero when the pixel value is less than the preset threshold, thereby improving the reconstruction accuracy.

[0059] Optionally, in the above-mentioned embodiments of the present disclosure, the preset threshold can be 1%.

[0060] S203, decouples the surface optical signal corresponding to the multi-light source by using the mask plate corresponding to each single light source, to obtain the surface optical signal corresponding to the plurality of single light sources.

[0061] It can be understood that in this embodiment of the present disclosure, the mask plate corresponding to each single light source can be sequentially applied to the surface optical signal corresponding to the multi-light source (for example, the weight of the surface optical signal of each single light source is given according to the mask plate at each light source target), thereby realizing the decoupling of the surface optical signal corresponding to the multi-light source, and obtaining the surface optical signal corresponding to the plurality of single light sources.

[0062] Specifically, the above process can be summarized by the following formula:

[0063] Wherein, d is the surface optical signal corresponding to the multi-light source, g i represents a single fitting signal, Σ i g i represents the fitting result of the surface optical signal corresponding to the multi-light source using a plurality of fitting signals, m i is a fitting signal g i corresponding to the generated mask plate, d i is the surface optical signal corresponding to the plurality of single light sources.

[0064] Specifically, in some embodiments of the present disclosure, as shown in FIG. 3, the signal fitting of the surface optical signal corresponding to the multi-light source includes:

[0065] S301, obtaining the local maximum value of the surface optical signal corresponding to the multi-light source.

[0066] It can be understood that since the light emitted by a point light source inside a biological body will be severely blurred and distorted after reaching the surface of the biological body, forming a light spot that is bright in the middle and gradually darkens outward, in this embodiment of the present disclosure, the local maximum value of the surface optical signal corresponding to the multi-light source can be used to locate each single light source target.

[0067] S302, determining the number of single light sources and the center position corresponding to each single light source according to the number of local maximum values.

[0068] It can be understood that in this embodiment of the present disclosure, the number of single light sources that need to be fitted can be determined according to the local maximum, and the center position corresponding to each single light source can be determined.

[0069] Further, in some embodiments of the present disclosure, as shown in FIG. 3, the method further comprises:

[0070] S303, according to the center position corresponding to each single light source, obtaining initial signal parameters for generating a fitted signal corresponding to each single light source.

[0071] It can be understood that in this embodiment of the present disclosure, the initial signal parameters can be used to describe the signal position, signal intensity and signal shape of the fitted signal corresponding to each single light source.

[0072] S304, optimizing and solving the initial signal parameters, so that the error between the sum of the fitted signals corresponding to each single light source and the surface optical signal corresponding to the multi-light source is minimized, to obtain optimal signal parameters.

[0073] It can be understood that in this embodiment of the present disclosure, by optimizing and solving the center position coordinates, amplitude and covariance matrix of the fitted signal, the error between the sum of the fitted signals corresponding to each single light source and the surface optical signal corresponding to the multi-light source is minimized, to obtain optimal signal parameters.

[0074] S305, according to the optimal signal parameters, obtaining the fitted signal corresponding to each single light source.

[0075] It can be understood that in this embodiment of the present disclosure, the signal fitting of each single light source target can be realized through the optimal signal parameters, so as to obtain the fitted signal corresponding to each single light source.

[0076] Further, in some embodiments of the present disclosure, the fitted signal comprises a Gaussian signal, and the initial signal parameters comprise the center position coordinates, amplitude and covariance matrix of the fitted signal.

[0077] For example, in some specific embodiments of the present disclosure, taking the use of multiple two-dimensional Gaussian signals to fit the surface optical signal corresponding to the multi-light source as an example, the signal fitting process of the above-mentioned embodiments of the present disclosure is described accordingly:

[0078] Specifically, the mathematical expression of the two-dimensional Gaussian signal is:

[0079] Wherein, a0 is the amplitude, is the center position coordinates, and Σ is the covariance matrix.

[0080] Specifically, the Gaussian signal fitting process specifically comprises the following steps: (1) locating the surface optical signal corresponding to each single light source by finding the local maximum value of the surface optical signal corresponding to the multi-light source, and sorting the local maximum value according to the intensity, estimating the center position of each single light source (estimating the parameters ), and determining the number of Gaussian signals for fitting at the same time; (2) calculating the average value of the optical signal intensity near the center position of each single light source, estimating the amplitude of each Gaussian signal (estimating the parameter a0), and calculating the second moment near the center position of each single light source, estimating the covariance matrix of the Gaussian signal (estimating the parameter Σ); (3) taking the estimated parameters a0, and Σ as initial parameters, optimizing the parameter distribution of the Gaussian signal by solving the optimization problem so that the difference between the fitted Gaussian signal and the surface optical signal corresponding to the multi-light source is minimized, and completing the signal fitting.

[0081] Further, the residual between the fitted Gaussian signal and the surface optical signal corresponding to the multi-light source can be defined as:

[0082] res≡d-Σ i g i …………(3)

[0083] Where d is the surface optical signal corresponding to the multi-light source, g i is a single Gaussian signal, and Σ i g i is the fitting result of the multiple fitted Gaussian signals to the surface optical signal corresponding to the multi-light source.

[0084] At this time, the approximation of the fitted Gaussian signal to the surface optical signal corresponding to the multi-light source is realized by minimizing the L2 norm of the residual, that is, solving the following optimization problem:

[0085] Where g param is the parameter used to fit the Gaussian signal.

[0086] It can be understood that in the above embodiments of the present disclosure, the optimal signal parameter used to generate the Gaussian fitting signal corresponding to each single light source can be solved by least square optimization.

[0087] Next, taking an experimental mouse with a PC3 prostate cancer model as an example, the implementation process of the optical imaging image reconstruction method in the embodiments of the present disclosure for simultaneously locating multiple light sources in the imaging target will be described in combination with FIG. 4 and FIG. 5 and the specific embodiments of the present disclosure:

[0088] Specifically, FIG. 4 is a decomposition flowchart of the surface optical signals of the experimental mouse, wherein FIG. 4a is the surface optical signals of the experimental mouse corresponding to multiple light sources. As can be seen from FIG. 4a, the intensity of signal 1 is much greater than that of signal 2 and signal 3. At this time, if BLT reconstruction or FMT reconstruction is directly performed on each signal, the light source targets corresponding to signal 2 and signal 3 cannot be reconstructed due to the too large intensity difference between the signals, and there is an overlapping area between signal 1 and signal 2, which will cause interference when BLT reconstruction or FMT reconstruction is performed.

[0089] The optical imaging image reconstruction method of the embodiment of the present disclosure is applied to BLT reconstruction or FMT reconstruction:

[0090] Step 1: First, find the local maximum in the surface optical signals (i.e. FIG. 4a) corresponding to multiple light sources, determine the fitting signal center position for fitting, and estimate the amplitude and distribution of the fitting signal, then take the estimated value as the initial value, solve the optimization problem to minimize the difference between the fitting signal and the surface optical signals corresponding to multiple light sources, further adjust the parameters of the fitting signal, and obtain the fitting effect of the fitting signal as shown in FIG. 4b.

[0091] Step 2: According to the fitting result in step 1, calculate the proportion of each fitting signal in the surface optical signals corresponding to multiple light sources, and generate a mask template corresponding to each fitting signal.

[0092] Step 3: Apply the mask template generated in step 2 to the surface optical signals corresponding to multiple light sources to obtain the surface optical signals corresponding to each single light source after decomposition as shown in FIG. 4c.

[0093] Step 4: Perform BLT reconstruction or FMT reconstruction on the surface optical signals corresponding to each single light source after decomposition respectively, and then add the reconstruction results to obtain the three-dimensional distribution of multiple light sources in the imaging target as shown in FIG. 5.

[0094] It should be noted that in the above embodiment of the present disclosure, the above signal decomposition can be automatically completed, and the execution time is less than 3 seconds.

[0095] In summary, according to the optical imaging image reconstruction method of the embodiments of the present disclosure, the surface optical signals of the corresponding multiple light sources of the imaging target are acquired, and then the surface optical signals of the corresponding multiple light sources are decomposed into the surface optical signals of the corresponding multiple single light sources, and then the surface optical signals of the corresponding multiple single light sources are sequentially reconstructed, the reconstruction results corresponding to each single light source are acquired, and the reconstruction results corresponding to each single light source are added to acquire the three-dimensional distribution of the multiple light sources on the imaging target. Thus, by decomposing the surface optical signals of the multiple light sources into the surface optical signals of a plurality of single light sources, sequentially reconstructing the surface optical signals of the decomposed single light sources, and adding the reconstruction results corresponding to each single light source, the three-dimensional distribution of the multiple light sources on the imaging target is acquired, so that the simultaneous positioning of the multiple light sources is accurately realized in the case that the surface optical signals of the multiple light sources have large intensity differences and / or are overlapped.

[0096] Further, based on the optical imaging image reconstruction method of the foregoing embodiments of the present disclosure, the embodiments of the present disclosure further provide a computer readable storage medium having an optical imaging image reconstruction program stored thereon, and the optical imaging image reconstruction program is executed by a processor to implement the optical imaging image reconstruction method of the foregoing embodiments of the present disclosure.

[0097] It should be understood that the specific implementation of the computer readable storage medium of the embodiments of the present disclosure can refer to the specific implementation of the optical imaging image reconstruction method of the foregoing embodiments of the present disclosure, and to reduce redundancy, the specific implementation is not described here.

[0098] In summary, according to the computer readable storage medium of the embodiments of the present disclosure, by executing the optical imaging image reconstruction program stored thereon, the simultaneous positioning of the multiple light sources can be accurately realized in the case that the surface optical signals of the multiple light sources have large intensity differences and / or are overlapped.

[0099] FIG. 6 is a block schematic diagram of an optical imaging image reconstruction apparatus according to an embodiment of the present disclosure.

[0100] Specifically, in some embodiments of the present disclosure, as shown in FIG. 6, the optical imaging image reconstruction apparatus 100 includes a first acquisition module 10, a decomposition module 20, a reconstruction module 30, and a second acquisition module 40.

[0101] The first acquisition module 10 is configured to acquire the surface optical signals of the corresponding multiple light sources of the imaging target; the decomposition module 20 is configured to decompose the surface optical signals of the corresponding multiple light sources into the surface optical signals of the corresponding multiple single light sources; the reconstruction module 30 sequentially reconstructs the surface optical signals of the corresponding multiple single light sources to acquire the reconstruction results corresponding to each single light source; and the second acquisition module 40 is configured to add the reconstruction results corresponding to each single light source to acquire the three-dimensional distribution of the multiple light sources on the imaging target.

[0102] Further, in some embodiments of the present disclosure, the decomposition module 20 is specifically configured to perform signal fitting on the surface optical signal corresponding to the multi-light source to obtain a fitting signal corresponding to each single light source; generate a mask corresponding to each single light source according to the fitting signal corresponding to each single light source; and decouple the surface optical signal corresponding to the multi-light source by using the mask corresponding to each single light source to obtain surface optical signals corresponding to the plurality of single light sources.

[0103] Further, in some embodiments of the present disclosure, the decomposition module 20 is further configured to obtain local maxima of the surface optical signal corresponding to the multi-light source; and determine the number of single light sources and the center position of each single light source according to the number of local maxima.

[0104] Further, in some embodiments of the present disclosure, the decomposition module 20 is further configured to obtain initial signal parameters for generating the fitting signal corresponding to each single light source according to the center position of each single light source; and optimize and solve the initial signal parameters to minimize the error between the fitting signal corresponding to each single light source and the surface optical signal corresponding to the multi-light source after addition to obtain optimal signal parameters; and obtain the fitting signal corresponding to each single light source according to the optimal signal parameters.

[0105] Further, in some embodiments of the present disclosure, the fitting signal includes a Gaussian signal, and the initial signal parameters include the center position coordinates, amplitude and covariance matrix of the fitting signal.

[0106] Further, in some embodiments of the present disclosure, the decomposition module 20 is further configured to obtain the proportion of the fitting signal corresponding to each single light source in the surface optical signal corresponding to the multi-light source; and generate the mask corresponding to each single light source according to the proportion.

[0107] Further, in some embodiments of the present disclosure, the decomposition module 20 is further configured to set the pixel value of each mask in the mask corresponding to each single light source to zero if the pixel value is less than a preset threshold.

[0108] It should be understood that the specific implementation of the optical imaging image reconstruction device in the embodiments of the present disclosure can refer to the specific implementation of the optical imaging image reconstruction method in the foregoing embodiments of the present disclosure. To reduce redundancy, the specific implementation is not described here.

[0109] In summary, according to the optical imaging image reconstruction device in the embodiments of the present disclosure, the surface optical signals of the corresponding multi-light sources of the imaging target are acquired by the first acquisition module, then the surface optical signals of the corresponding multi-light sources are decomposed into the surface optical signals of the corresponding multiple single-light sources by the decomposition module, then the surface optical signals of the corresponding multiple single-light sources are sequentially reconstructed by the reconstruction module to acquire the reconstruction results corresponding to each single-light source, and the reconstruction results corresponding to each single-light source are added by the second acquisition module to acquire the three-dimensional distribution of the multi-light sources on the imaging target. Thus, by decomposing the surface optical signals of the multi-light sources into the surface optical signals of several single-light sources, sequentially reconstructing the surface optical signals of the decomposed single-light sources, and adding the reconstruction results corresponding to each single-light source, the three-dimensional distribution of the multi-light sources on the imaging target is acquired, so that the simultaneous positioning of the multi-light sources is accurately realized in the case that the surface optical signals of the multi-light sources have large intensity differences and / or are overlapped.

[0110] FIG. 7 is a block schematic diagram of an optical imaging image reconstruction device according to an embodiment of the present disclosure.

[0111] Specifically, in some embodiments of the present disclosure, as shown in FIG. 7, the optical imaging device 1000 comprises the optical imaging image reconstruction device 100 of the above-mentioned embodiments of the present disclosure.

[0112] It should be understood that the specific implementation of the optical imaging device in the embodiments of the present disclosure can refer to the specific implementation of the optical imaging image reconstruction method in the above-mentioned embodiments of the present disclosure, and to reduce redundancy, it will not be repeated here.

[0113] In summary, according to the optical imaging device in the embodiments of the present disclosure, by adopting the above-mentioned optical imaging image reconstruction device, the simultaneous positioning of the multi-light sources can be accurately realized in the case that the surface optical signals of the multi-light sources have large intensity differences and / or are overlapped.

[0114] It is to be appreciated that the above description and the examples that follow are intended to be illustrative only and that changes can be made to the description and examples without departing from the spirit and scope of the disclosure. Note also that the use of particular brand names in the description is solely for illustration and should not be construed as an endorsement of such brands.

[0115] It should be understood that aspects of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above embodiments, various steps or methods can be implemented in software or firmware that is stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any of the following technologies, known in the art, can be used: a hybrid of the technologies mentioned above, discrete logic circuitry having logic gates for implementing logic functions upon data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), and so forth.

[0116] In the description of the present specification, the description referring to the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the particular feature, structure, material or characteristic being described is included in at least one embodiment or example of the present disclosure. The illustrative appearances of the above-mentioned terms in various places in the present specification are not necessarily intended to refer to the same embodiment or example. Moreover, the particular features, structures, materials or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0117] In the description of the present disclosure, it needs to be understood that the orientation or positional relationship indicated by the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like is based on the orientation or positional relationship shown in the drawings, and is only for the purpose of facilitating the description of the present disclosure and simplifying the description, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present disclosure.

[0118] In addition, the terms "first", "second" are only for descriptive purpose, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "a plurality of" is at least two, such as two, three, etc., unless otherwise explicitly specified and limited.

[0119] In the present disclosure, unless otherwise explicitly specified and limited, the terms "mounting", "connecting", "connecting", "fixing" and the like should be understood in a broad sense, for example, it can be fixed connection, or detachable connection, or integral; it can be mechanical connection, or electrical connection; it can be direct connection, or indirect connection through intermediate medium; it can be the internal communication of two elements or the interaction relationship between two elements, unless otherwise explicitly limited. For those skilled in the art, the specific meaning of the above terms in the present disclosure can be understood according to the specific circumstances.

[0120] In the present disclosure, unless otherwise explicitly specified and limited, the first feature "on" or "under" the second feature can be that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, the first feature "above", "over" and "on" the second feature can be that the first feature is directly above or obliquely above the second feature, or only indicates that the horizontal height of the first feature is higher than that of the second feature. The first feature "below", "under" and "under" the second feature can be that the first feature is directly below or obliquely below the second feature, or only indicates that the horizontal height of the first feature is less than that of the second feature. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as a limitation on the present disclosure, and those skilled in the art can make changes, modifications, replacements and variations to the above embodiments within the scope of the present disclosure.

Claims

1. An optical imaging image reconstruction method, wherein, The method comprises: acquiring surface optical signals of corresponding multiple light sources of an imaging target; decomposing the surface optical signals of the corresponding multiple light sources into surface optical signals of corresponding multiple single light sources; reconstructing the surface optical signals of the corresponding multiple single light sources in sequence to acquire reconstruction results corresponding to each single light source; adding the reconstruction results corresponding to each single light source to acquire a three-dimensional distribution of the multiple light sources on the imaging target.

2. The optical imaging image reconstruction method of claim 1, wherein, The decomposition of the surface optical signals of the corresponding multiple light sources into the surface optical signals of the corresponding multiple single light sources comprises: signal fitting of the surface optical signals of the corresponding multiple light sources to acquire fitting signals corresponding to each single light source; generating mask plates corresponding to each single light source according to the fitting signals corresponding to each single light source; decoupling the surface optical signals of the corresponding multiple light sources by using the mask plates corresponding to each single light source to acquire the surface optical signals of the corresponding multiple single light sources.

3. The optical imaging image reconstruction method of claim 2, wherein, The signal fitting of the surface optical signals of the corresponding multiple light sources comprises: acquiring local maximum values of the surface optical signals of the corresponding multiple light sources; determining the number of single light sources and the center positions of the corresponding single light sources according to the number of the local maximum values.

4. The optical imaging image reconstruction method of claim 3, wherein, The method further comprises: acquiring initial signal parameters for generating the fitting signals corresponding to each single light source according to the center positions of the corresponding single light sources; optimizing and solving the initial signal parameters to minimize the error between the fitting signals corresponding to each single light source after addition and the surface optical signals of the corresponding multiple light sources to acquire optimal signal parameters; acquiring the fitting signals corresponding to each single light source according to the optimal signal parameters.

5. The optical imaging image reconstruction method of claim 4, wherein, The fitting signals comprise Gaussian signals, and the initial signal parameters comprise center position coordinates, amplitude values and covariance matrices of the fitting signals.

6. The optical imaging image reconstruction method of claim 2, wherein, The generation of the mask plates corresponding to each single light source according to the fitting signals corresponding to each single light source comprises: acquiring the proportion of the fitting signals corresponding to each single light source in the surface optical signals of the corresponding multiple light sources; generating the mask plates corresponding to each single light source according to the proportion.

7. The optical imaging image reconstruction method of claim 6, wherein, The method further comprises: setting the pixel values of each mask plate of the corresponding single light sources that are less than a preset threshold to zero.

8. A computer readable storage medium, wherein, An optical imaging image reconstruction program is stored thereon, and the optical imaging image reconstruction program is executed by a processor to implement the optical imaging image reconstruction method in any one of claims 1-7.

9. An optical imaging image reconstruction apparatus, wherein, The device comprises: a first acquisition module configured to acquire surface optical signals of corresponding multiple light sources of an imaging target; a decomposition module configured to decompose the surface optical signals of the corresponding multiple light sources into surface optical signals of corresponding multiple single light sources; a reconstruction module configured to reconstruct the surface optical signals of the corresponding multiple single light sources in sequence to acquire reconstruction results corresponding to each single light source; a second acquisition module configured to add the reconstruction results corresponding to each single light source to acquire a three-dimensional distribution of the multiple light sources on the imaging target.

10. An optical imaging device, wherein, The optical imaging equipment comprises the optical imaging image reconstruction device according to claim 9.

Images