Laser intensity adjusting method, device and equipment and storage medium

Abstract

The embodiment of the invention provides a laser intensity adjusting method and device, equipment and a storage medium, and belongs to the technical field of super-resolution imaging. The method comprises the following steps: periodically acquiring an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image, and the fluorescent sample is a sample dyed by a fluorescent dye. Feature extraction is carried out according to the super-resolution image, the number of feature points is obtained, and the number of the feature points represents the number of the fluorescent molecules activated by the laser. And comparing the number of the feature points with a preset activation number to obtain a number comparison result of each period. And adjusting the laser intensity of the laser according to the number comparison result, so that the number of the fluorescent molecules activated by the laser approaches the preset activation number. Namely, the laser intensity of the laser is adjusted according to the number comparison result of the number of the feature points and the preset activation number, so that the number of the fluorescent molecules activated by the laser approaches the preset activation number, the number of the activated fluorescent molecules is accurately controlled, and the imaging quality of the super-resolution image is improved.

Description

Technical Field

[0001] The present application relates to the field of super-resolution imaging technology, and in particular to a laser intensity adjustment method, device, equipment and storage medium. Background Art

[0002] Super-resolution imaging is a technology that improves the resolution of movies or images. For example, in the biomedical field, fluorescent dyes are used to dye the biological molecules in the sample to convert the biological molecules into fluorescent molecules. Lasers are used to activate fluorescent molecules, and then they are photographed using imaging equipment to obtain super-resolution images. Due to changes in the experimental environment and sample characteristics, it is necessary to accurately adjust the laser intensity in real time to ensure that only a small number of molecules are activated in each super-resolution image, thereby achieving high-quality imaging effects. In related technologies, it is difficult to ensure that the laser intensity can be adjusted accurately in real time by manually adjusting the laser intensity, resulting in poor imaging quality. Therefore, how to improve the imaging quality of super-resolution images has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The main purpose of the embodiments of the present application is to propose a laser intensity adjustment method, device, equipment and storage medium, aiming to improve the imaging quality of super-resolution images.

[0004] To achieve the above object, a first aspect of an embodiment of the present application provides a laser intensity adjustment method, the method comprising:

[0005] Periodically acquiring an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image; the fluorescent sample is a sample dyed with a fluorescent dye;

[0006] Performing feature extraction according to the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser;

[0007] Comparing the number of feature points with a preset activation number to obtain a number comparison result for each cycle;

[0008] The laser intensity of the laser is adjusted according to the quantity comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

[0009] In some embodiments, after comparing the number of feature points with a preset activation number to obtain a number comparison result for each cycle, the method further includes:

[0010] If the quantity comparison result indicates that the number of feature points is equal to the preset activation number, then acquiring the image saturation of the super-resolution image;

[0011] The preset activation quantity is adjusted according to the image saturation, so that the quantity comparison result of the next cycle is determined based on the adjusted preset activation quantity.

[0012] In some embodiments, adjusting the preset activation quantity according to the image saturation includes:

[0013] If the image saturation is less than a first saturation threshold, adjusting the preset activation quantity to a sum of the preset activation quantity and a quantity adjustment threshold;

[0014] If the image saturation is greater than a second saturation threshold, the preset activation quantity is adjusted to the difference between the preset activation quantity and the quantity adjustment threshold; wherein the first saturation threshold is less than the second saturation threshold.

[0015] In some embodiments, adjusting the laser intensity of the laser according to the quantity comparison result includes:

[0016] If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, obtaining the difference between the number of feature points and the preset activation number to obtain a target quantity difference;

[0017] Determining a target intensity adjustment value according to the target quantity difference;

[0018] The laser intensity of the laser is adjusted according to the target intensity adjustment value.

[0019] In some embodiments, the duty cycle corresponding to the laser intensity of the laser is the current duty cycle, and adjusting the laser intensity of the laser according to the quantity comparison result includes:

[0020] If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, obtaining a ratio of the number of feature points to the preset activation number to obtain a target ratio;

[0021] Substituting the target ratio, the preset initial incremental coefficient, the current duty cycle, and the preset laser increase / decrease factor into a preset adjustment formula for calculation to obtain a target incremental coefficient;

[0022] The laser intensity of the laser is adjusted according to the target increment factor.

[0023] In some embodiments, the super-resolution image includes at least two pixel points, and extracting features according to the super-resolution image to obtain the number of feature points includes:

[0024] Obtaining a pixel value of each of the pixels;

[0025] The pixel point corresponding to the pixel value greater than a preset fluorescent pixel threshold is taken as a target feature point;

[0026] Counting the target feature points to obtain the number of feature points.

[0027] In some embodiments, taking the pixel point corresponding to the pixel value greater than a preset fluorescent pixel threshold as the target feature point includes:

[0028] Dividing the super-resolution image into regions according to a preset number of region divisions to obtain a plurality of target regions;

[0029] Determining a maximum pixel value according to the pixel values ​​in each of the target areas;

[0030] The pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area is used as the target feature point.

[0031] To achieve the above-mentioned purpose, a second aspect of an embodiment of the present application provides a laser intensity adjustment device, the laser intensity adjustment device comprising a laser, an imaging device, and a controller;

[0032] The controller comprises:

[0033] An acquisition module is used to periodically acquire an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image; the fluorescent sample is a sample dyed with a fluorescent dye;

[0034] An extraction module, used for performing feature extraction based on the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser;

[0035] A comparison module, used for comparing the number of feature points with a preset activation number to obtain a number comparison result of each cycle;

[0036] The adjustment module is used to adjust the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

[0037] To achieve the above objectives, a third aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0038] To achieve the above-mentioned purpose, the fourth aspect of an embodiment of the present application proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect is implemented.

[0039] The laser intensity adjustment method, device, equipment and storage medium proposed in the present application obtain super-resolution images by periodically acquiring images of fluorescent samples irradiated by a laser, wherein the fluorescent samples are samples dyed with fluorescent dyes. Feature extraction is performed based on the super-resolution image to obtain the number of feature points, wherein the number of feature points represents the number of fluorescent molecules activated by the laser. The number of feature points is compared with the preset activation number to obtain the number comparison result of each cycle. The laser intensity of the laser is adjusted according to the number comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number. That is, the laser intensity of the laser is adjusted by the number comparison result of the number of feature points and the preset activation number so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby achieving accurate control of the number of activated fluorescent molecules and improving the imaging quality of the super-resolution image. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 is an optional flow chart of the laser intensity adjustment method provided in an embodiment of the present application;

[0041] Figure 2 is a flow chart of a laser intensity adjustment method provided by another embodiment of the present application;

[0042] Figure 3 yes Figure 2 Flow chart of step S202 in FIG.

[0043] Figure 4 yes Figure 1 A first flow chart of step S104 in FIG. 1 ;

[0044] Figure 5 yes Figure 1 A second flow chart of step S104 in FIG.

[0045] Figure 6 yes Figure 1 Flow chart of step S102 in FIG.

[0046] Figure 7 yes Figure 6 Flowchart of step S602 in FIG.

[0047] Figure 8 is a schematic structural diagram of a laser intensity adjustment device provided in an embodiment of the present application;

[0048] Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0050] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0052] First, some nouns involved in this application are analyzed:

[0053] Super-resolution imaging technology: Super-resolution imaging technology includes photo activated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM). PALM is a method of achieving super-resolution imaging by activating fluorescent molecules with lasers and accurately locating their positions, and STORM is a method of achieving high-resolution imaging by utilizing the random switching characteristics of fluorescent molecules. In PALM and STORM, 405nm lasers are widely used to activate and control the state of fluorescent molecules, and the adjustment of the laser intensity has a direct impact on the accuracy and quality of imaging. By precisely adjusting the laser intensity and controlling the number of fluorescent molecules activated at the same time, it is possible to prevent signal overlap and improve the accuracy of single-molecule positioning, that is, to improve the imaging quality of super-resolution images.

[0054] PALM: The principle of PALM is to use laser to activate specific photosensitive fluorescent proteins, so that they change from a non-fluorescent state to a detectable fluorescent state. After activation, only a small number of fluorescent molecules are activated each time. The luminescent signals of these fluorescent molecules are captured by a high-resolution camera, and the precise position of each molecule is determined by a computational positioning algorithm. By repeating the activation and detection process, a complete super-resolution image is gradually constructed to achieve nanometer-level resolution.

[0055] STORM: The principle of STORM is to label samples with specific dyes that have switching properties that can be activated by lasers. Using a specific laser, the random switching of fluorescent molecules is controlled in time to ensure that only a small number of molecules are in the luminescent state at a time. Multiple images of randomly luminescent fluorescent molecules are captured at different time points, and this information is integrated through computer algorithms to reconstruct high-resolution sample images.

[0056] Due to changes in the experimental environment and sample characteristics, the laser intensity needs to be adjusted accurately in real time to ensure that only a small number of molecules are activated in each super-resolution image, thereby achieving high-quality imaging effects. In related technologies, it is difficult to ensure that the laser intensity can be adjusted accurately in real time by manually adjusting the laser intensity, resulting in poor imaging quality.

[0057] Based on this, the embodiments of the present application provide a laser intensity adjustment method, device, equipment and storage medium, which are intended to compare the number of feature points in a super-resolution image with a preset activation number, and adjust the laser intensity of the laser according to the number comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number. Accurate control of the number of activated fluorescent molecules is achieved, and the imaging quality of the super-resolution image is improved.

[0058] The laser intensity adjustment method, device, equipment and storage medium provided in the embodiments of the present application are specifically described through the following embodiments. First, the laser intensity adjustment method in the embodiments of the present application is described.

[0059] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0060] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0061] The laser intensity adjustment method provided in the embodiment of the present application can be applied to the terminal, can also be applied to the server side, and can also be software running in the terminal or the server side. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.; the server side can be configured as an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements the laser intensity adjustment method, etc., but is not limited to the above forms.

[0062] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0063] Please refer to Figure 1 , Figure 1 is an optional flow chart of the laser intensity adjustment method provided in an embodiment of the present application. The laser intensity adjustment method is applied to a super-resolution imaging device, which includes a laser, an imaging device, and a sample stained with a fluorescent dye. Figure 1 The method may include but is not limited to steps S101 to S104.

[0064] Step S101, periodically acquiring an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image; the fluorescent sample is a sample dyed with a fluorescent dye;

[0065] Step S102, extracting features based on the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser;

[0066] Step S103, comparing the number of feature points with the preset activation number to obtain a number comparison result for each cycle;

[0067] Step S104, adjusting the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

[0068] In step S101 of some embodiments, at the beginning of the super-resolution experiment, the initial laser intensity is set first, so that the laser irradiates the fluorescent sample with the initial laser intensity, thereby activating a portion of the fluorescent molecules in the fluorescent sample, and then the image of the fluorescent sample is collected by a high-resolution imaging device to obtain a super-resolution image. After the fluorescent molecules are activated and change from a non-fluorescent state to a detectable fluorescent state, they will also change from a fluorescent state to a non-fluorescent state. Therefore, it is necessary to adjust the laser intensity in real time to activate a portion of the fluorescent molecules again. After adjusting the laser intensity, it is necessary to collect the image of the fluorescent sample again, so it is necessary to periodically obtain super-resolution images.

[0069] In step S102 of some embodiments, the number of feature points represents the number of fluorescent molecules activated by the laser. In order to control the number of activated fluorescent molecules, it is necessary to perform feature extraction on the super-resolution image to obtain the number of feature points, so as to adjust the laser intensity based on the number of feature points, thereby controlling the number of activated fluorescent molecules.

[0070] It should be noted that after the super-resolution image is acquired, in order to improve the accuracy of feature extraction, the super-resolution image needs to be preprocessed. Preprocessing includes denoising and contrast enhancement. Denoising can be done by using a Gaussian filter to remove image noise and improve image clarity. Contrast enhancement can be done by using histogram equalization technology to increase the contrast of the image and make the details more obvious.

[0071] In step S103 of some embodiments, the preset activation number is the number of fluorescent molecules expected to be activated that is preset by the user. When the number of feature points is not equal to the preset activation number, it means that the number of fluorescent molecules actually activated is too much or too little, which will lead to poor imaging quality of the super-resolution image. Therefore, it is necessary to obtain a number comparison result after comparing the number of feature points with the preset activation number, and the number comparison result includes that the number of feature points is equal to the preset activation number, the number of feature points is less than the preset activation number, or the number of feature points is greater than the preset activation number.

[0072] In step S104 of some embodiments, when the number of feature points is greater than the preset activation number, it means that the number of fluorescent molecules actually activated is too large and the current laser intensity is too large, so the laser intensity needs to be reduced. When the number of feature points is less than the preset activation number, it means that the number of fluorescent molecules actually activated is too small and the current laser intensity is too small, so the laser intensity needs to be increased. When the number of feature points is equal to the preset activation number, the laser intensity can be fine-tuned. Because the activated fluorescent molecules may change from a fluorescent state to a non-fluorescent state when shooting the current super-resolution image to shooting the next super-resolution image, fine-tuning the laser intensity can reactivate some of the fluorescent molecules. The laser intensity can be adjusted by setting a fine-tuning value and an adjustment value. When the laser intensity needs to be reduced or increased, the laser intensity is reduced or increased according to the adjustment value. When the laser intensity needs to be fine-tuned, the laser intensity is increased or decreased according to the fine-tuning value.

[0073] It should be noted that after adjusting the laser intensity, step S101 to step S104 are re-executed until the experiment is completed. After the experiment is completed, all super-resolution images are saved for subsequent processing and analysis of the super-resolution images. By continuously adjusting the laser intensity based on the number of feature points, it is ensured that the number of fluorescent molecules activated during the entire experiment is always maintained at the optimal state to achieve the expected imaging effect and quality.

[0074] Steps S101 to S104 shown in the embodiment of the present application are to obtain a super-resolution image by periodically acquiring an image of a fluorescent sample irradiated by a laser, wherein the fluorescent sample is a sample dyed with a fluorescent dye. Feature extraction is performed based on the super-resolution image to obtain the number of feature points, wherein the number of feature points represents the number of fluorescent molecules activated by the laser. The number of feature points is compared with the preset activation number to obtain a quantity comparison result for each cycle. The laser intensity of the laser is adjusted based on the quantity comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number. That is, the laser intensity of the laser is adjusted based on the quantity comparison result between the number of feature points and the preset activation number so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby achieving accurate control of the number of activated fluorescent molecules and improving the imaging quality of the super-resolution image.

[0075] See also Figure 2 In some embodiments, after step S103, the laser intensity adjustment method may further include but is not limited to steps S201 to S202:

[0076] Step S201, if the quantity comparison result indicates that the number of feature points is equal to the preset activation number, the image saturation of the super-resolution image is obtained;

[0077] Step S202, adjusting the preset activation quantity according to the image saturation, so that the quantity comparison result of the next cycle is determined based on the adjusted preset activation quantity.

[0078] In step S201 of some embodiments, the preset activation number is the number of fluorescent molecules expected to be activated set by the experimenter, and different experimenters may set different values ​​based on subjective experience. Therefore, it is also necessary to determine whether the preset activation number is the optimal number of fluorescent molecules to be activated. Therefore, it is necessary to make a judgment when the number comparison result characterizes that the number of feature points is equal to the preset activation number.

[0079] Specifically, when there are too many activated fluorescent molecules, the super-resolution image will be too bright or saturated, resulting in image distortion and blurred details. When there are too few activated fluorescent molecules, the image information will be insufficient. Therefore, the image saturation of the super-resolution image can be used to determine whether the preset activation number is the optimal number of activated fluorescent molecules. Therefore, when the number comparison result represents that the number of feature points is equal to the preset activation number, the image saturation of the super-resolution image is obtained.

[0080] In step S202 of some embodiments, if the image saturation is too high, the preset activation number needs to be reduced. If the image saturation is too low, the preset activation number needs to be increased. The specific adjustment method can be set by the experimenter as needed.

[0081] For details, please refer to Figure 3 Step S202 may include but is not limited to steps S301 to S302:

[0082] Step S301, if the image saturation is less than a first saturation threshold, adjusting the preset activation quantity to the sum of the preset activation quantity and the quantity adjustment threshold;

[0083] Step S302, if the image saturation is greater than the second saturation threshold, the preset activation quantity is adjusted to the difference between the preset activation quantity and the quantity adjustment threshold; wherein the first saturation threshold is less than the second saturation threshold.

[0084] In step S301 of some embodiments, a saturation range is set, a first saturation threshold is equal to the lower limit of the saturation range, and a second saturation threshold is equal to the upper limit of the saturation range. When the image saturation is within the saturation range, there is no need to adjust the preset activation number. When the image saturation is less than the lower limit of the saturation range, it means that the preset activation number is set too small and the preset activation number needs to be increased. Therefore, the preset activation number can be adjusted to the sum of the preset activation number and the quantity adjustment threshold. Among them, the quantity adjustment threshold can be set to 2, and the experimenter can also modify the quantity adjustment threshold as needed.

[0085] In step S302 of some embodiments, when the image saturation is greater than the upper limit of the saturation range, it means that the preset activation number is set too large and needs to be reduced. Therefore, the preset activation number can be adjusted to the difference between the preset activation number and the quantity adjustment threshold.

[0086] In step S301 to step S302 of this embodiment, it is determined whether the preset activation number is the optimal number of activated fluorescent molecules according to the image saturation. If not, the preset activation number is adjusted to improve the image quality of the super-resolution image.

[0087] It should be noted that after adjusting the preset activation number, in the next cycle, the number of feature points is compared with the adjusted preset activation number to obtain a quantity comparison result.

[0088] In steps S301 to S302 shown in this embodiment, the image saturation of the super-resolution image is obtained when the number of feature points is equal to the preset activation number, so as to adjust the preset activation number based on the image saturation, thereby ensuring that the preset activation number is the optimal number of activated fluorescent molecules, thereby improving the image quality of the super-resolution image.

[0089] See also Figure 4 In some embodiments, step S104 may include but is not limited to steps S401 to S403:

[0090] Step S401, if the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, then the difference between the number of feature points and the preset activation number is obtained to obtain a target quantity difference;

[0091] Step S402, determining a target intensity adjustment value according to the target quantity difference;

[0092] Step S403, adjusting the laser intensity of the laser according to the target intensity adjustment value.

[0093] In step S401 of some embodiments, if the number comparison result is that the number of feature points is greater than the preset activation number, it means that the number of fluorescent molecules actually activated is too large. If the number comparison result is that the number of feature points is less than the preset activation number, it means that the number of fluorescent molecules actually activated is too small. In both cases, the laser intensity needs to be adjusted, so the difference between the number of feature points and the preset activation number is obtained to obtain the target number difference, so as to adjust the laser intensity of the laser based on the target number difference.

[0094] In step S402 of some embodiments, a mapping relationship between target quantity difference and target intensity adjustment value may be pre-calibrated to obtain a target mapping table, and a corresponding target intensity adjustment value may be extracted from the target mapping table according to the target quantity difference.

[0095] In step S403 of some embodiments, when the number of feature points is greater than the preset activation number, it indicates that the laser intensity needs to be reduced, and the adjusted laser intensity is the difference between the laser intensity and the target intensity adjustment value. When the number of feature points is less than the preset activation number, it indicates that the laser intensity needs to be increased, and the adjusted laser intensity is the sum of the laser intensity and the target intensity adjustment value.

[0096] In steps S401 to S403 shown in this embodiment, the laser intensity is adjusted based on the difference between the number of feature points and the preset activation number, so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby improving the image quality of the super-resolution image.

[0097] See also Figure 5 In some embodiments, the duty cycle corresponding to the laser intensity of the laser is the current duty cycle, and step S104 may also include but is not limited to steps S501 to S503:

[0098] Step S501, if the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, then obtain the ratio of the number of feature points to the preset activation number to obtain a target ratio;

[0099] Step S502, substituting the target ratio, the preset initial increment coefficient, the current duty cycle, and the preset laser increase / decrease factor into a preset adjustment formula for calculation to obtain the target increment coefficient;

[0100] Step S503, adjusting the laser intensity of the laser according to the target incremental coefficient.

[0101] In step S501 of some embodiments, when the number of feature points is greater than or less than the preset activation number, it indicates that the laser intensity needs to be adjusted. Therefore, the ratio of the number of feature points to the preset activation number is obtained to obtain a target ratio, so as to adjust the laser intensity of the laser based on the target ratio.

[0102] In step S502 of some embodiments, the preset adjustment formula is as shown in the following formula (1):

[0103] K n =K n-1 +0.1+D n +FD*(1-b), (1)

[0104] Among them, K n Indicates the target increment coefficient, K m-1 represents the initial incremental coefficient, D n represents the current duty cycle, FD represents the laser increase / decrease factor, and b represents the target ratio. Substitute the target ratio, initial increase coefficient, current duty cycle, and preset laser increase / decrease factor into formula (1) to calculate and obtain the target increase coefficient.

[0105] In step S503 of some embodiments, the target duty cycle is the sum of the target incremental coefficient and the current duty cycle. After the target duty cycle is obtained, the laser intensity is adjusted to the laser intensity corresponding to the target duty cycle. By adjusting the laser intensity by the duty cycle, the laser intensity can be accurately adjusted.

[0106] In steps S501 to S503 shown in this embodiment, the laser intensity is adjusted based on the ratio of the number of feature points to the preset activation number so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby improving the image quality of the super-resolution image.

[0107] See also Figure 6 In some embodiments, the super-resolution image includes at least two pixels, and step S102 includes but is not limited to steps S601 to S603:

[0108] Step S601, obtaining the pixel value of each pixel;

[0109] Step S602, taking the pixel points corresponding to the pixel values ​​greater than the preset fluorescent pixel threshold as the target feature points;

[0110] Step S603: Count the target feature points to obtain the number of feature points.

[0111] In step S601 of some embodiments, whether a pixel point is a feature point can be determined based on whether the pixel value is greater than a preset fluorescent pixel threshold, so the pixel value of each pixel point needs to be obtained first.

[0112] In steps S602 to S603 of some embodiments, when the pixel value is greater than the preset fluorescent pixel threshold, the pixel point corresponding to the pixel value is used as the target feature point. The number of target feature points is counted to obtain the number of feature points.

[0113] In steps S601 to S603 of this embodiment, the target feature points are obtained by comparing the pixel value of each pixel with a preset fluorescent pixel threshold, thereby obtaining the number of feature points based on the target feature points.

[0114] See also Figure 7 In some embodiments, step S602 may include but is not limited to steps S701 to S703:

[0115] Step S701, dividing the super-resolution image into regions according to a preset number of region divisions to obtain a plurality of target regions;

[0116] Step S702, determining the maximum pixel value according to the pixel values ​​in each target area;

[0117] Step S703: taking the pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area as the target feature point.

[0118] In some embodiments, in steps S701 to S702, if the pixel value of each pixel is compared with a preset fluorescence pixel threshold, the comparison speed will be slow. In order to improve the comparison speed, the super-resolution image is first divided into regions according to a preset number of region divisions to obtain multiple target regions. To obtain the maximum pixel value in each target region, it is only necessary to compare the maximum pixel value with the preset fluorescence pixel threshold, thereby improving the comparison speed. In one example, 5x5 pixels can be divided into a target region, and only one comparison is required for every 25 pixels.

[0119] In step S703 of some embodiments, after obtaining the maximum pixel value in each target area, if the maximum pixel value is greater than a preset fluorescent pixel threshold, the pixel point corresponding to the maximum pixel value is the target feature point.

[0120] In steps S701 to S703 shown in this embodiment, multiple target areas are obtained by dividing the super-resolution image into regions, and only the maximum pixel value in the target area is compared with the preset fluorescence pixel threshold, which reduces the number of comparisons and improves the comparison speed.

[0121] See also Figure 8 The embodiment of the present application further provides a laser intensity adjustment device, which can implement the above laser intensity adjustment method. The laser intensity adjustment device includes a laser 81, an imaging device 82, and a controller 83. The controller 83 includes:

[0122] The acquisition module 830 is used to periodically acquire images of fluorescent samples irradiated by the laser to obtain super-resolution images; the fluorescent samples are samples dyed with fluorescent dyes;

[0123] An extraction module 831 is used to extract features based on the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser;

[0124] A comparison module 832, used to compare the number of feature points with a preset activation number to obtain a number comparison result for each cycle;

[0125] The adjustment module 833 is used to adjust the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

[0126] The specific implementation of the laser intensity adjustment device is substantially the same as the specific implementation of the above-mentioned laser intensity adjustment method, and will not be described in detail herein.

[0127] The embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the above laser intensity adjustment method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0128] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes:

[0129] The processor 901 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0130] The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 902, and the processor 901 calls and executes the laser intensity adjustment method of the embodiment of this application;

[0131] Input / output interface 903, used to implement information input and output;

[0132] Communication interface 904, used to realize communication interaction between the device and other devices, which can be realized by wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.);

[0133] A bus 905 that transmits information between various components of the device (e.g., the processor 901, the memory 902, the input / output interface 903, and the communication interface 904);

[0134] The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .

[0135] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned laser intensity adjustment method is implemented.

[0136] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0137] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0138] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0139] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0140] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0141] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0142] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0143] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0144] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0145] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0146] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0147] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A laser intensity adjustment method, characterized in that: The method comprises: Periodically acquiring an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image; the fluorescent sample is a sample dyed with a fluorescent dye; Performing feature extraction according to the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser; Comparing the number of feature points with a preset activation number to obtain a number comparison result for each cycle; The laser intensity of the laser is adjusted according to the quantity comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

2. The method according to claim 1, characterized in that After comparing the number of feature points with the preset activation number to obtain the number comparison result of each cycle, the method further includes: If the quantity comparison result indicates that the number of feature points is equal to the preset activation number, then acquiring the image saturation of the super-resolution image; The preset activation quantity is adjusted according to the image saturation, so that the quantity comparison result of the next cycle is determined based on the adjusted preset activation quantity.

3. The method according to claim 2, characterized in that The adjusting the preset activation quantity according to the image saturation includes: If the image saturation is less than a first saturation threshold, adjusting the preset activation quantity to a sum of the preset activation quantity and a quantity adjustment threshold; If the image saturation is greater than a second saturation threshold, the preset activation quantity is adjusted to the difference between the preset activation quantity and the quantity adjustment threshold; wherein the first saturation threshold is less than the second saturation threshold.

4. The method according to claim 1, characterized in that: The step of adjusting the laser intensity of the laser according to the quantity comparison result comprises: If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, obtaining the difference between the number of feature points and the preset activation number to obtain a target quantity difference; Determining a target intensity adjustment value according to the target quantity difference; The laser intensity of the laser is adjusted according to the target intensity adjustment value.

5. The method according to claim 1, characterized in that The duty cycle corresponding to the laser intensity of the laser is the current duty cycle, and the adjusting the laser intensity of the laser according to the quantity comparison result includes: If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, obtaining a ratio of the number of feature points to the preset activation number to obtain a target ratio; Substituting the target ratio, the preset initial incremental coefficient, the current duty cycle, and the preset laser increase / decrease factor into a preset adjustment formula for calculation to obtain a target incremental coefficient; The laser intensity of the laser is adjusted according to the target increment factor.

6. The method according to claim 1, characterized in that The super-resolution image includes at least two pixel points, and the step of extracting features according to the super-resolution image to obtain the number of feature points includes: Obtaining a pixel value of each of the pixels; The pixel point corresponding to the pixel value greater than a preset fluorescent pixel threshold is taken as a target feature point; Counting the target feature points to obtain the number of feature points.

7. The method according to claim 6, characterized in that The step of taking the pixel point corresponding to the pixel value greater than a preset fluorescent pixel threshold as the target feature point includes: Dividing the super-resolution image into regions according to a preset number of region divisions to obtain a plurality of target regions; Determining a maximum pixel value according to the pixel values ​​in each of the target areas; The pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area is used as the target feature point.

8. A laser intensity adjustment device, characterized in that: The laser intensity adjustment device includes a laser, an imaging device, and a controller; The controller comprises: An acquisition module is used to periodically acquire an image of a fluorescent sample irradiated by a laser to obtain a super-resolution image; the fluorescent sample is a sample dyed with a fluorescent dye; An extraction module, used for performing feature extraction based on the super-resolution image to obtain the number of feature points; wherein the number of feature points represents the number of fluorescent molecules activated by the laser; A comparison module, used for comparing the number of feature points with a preset activation number to obtain a number comparison result of each cycle; The adjustment module is used to adjust the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the laser intensity adjustment method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the laser intensity adjustment method according to any one of claims 1 to 7 is implemented.

Images