Laser intensity adjusting method, device, equipment and storage medium
By periodically acquiring images of fluorescent samples and adjusting the laser intensity, the problem of inaccurate laser intensity adjustment in existing technologies is solved, thereby improving the quality of super-resolution imaging and ensuring precise control of the number of fluorescent molecules.
Patent Information
- Application Number
- CN202411661797.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-11-11
- Estimated Expiration
- 2044-11-20
AI Technical Summary
In existing technologies, it is difficult to adjust the laser intensity accurately in real time by manually adjusting the laser intensity, resulting in poor super-resolution imaging quality.
By periodically acquiring images of fluorescent samples, extracting features, comparing the number of feature points with the preset activation number, and adjusting the laser intensity to make the number of laser-activated fluorescent molecules approach the preset activation number, precise control of the laser intensity is achieved.
It improves the imaging quality of super-resolution images, ensures that only a small number of fluorescent molecules are in an activated state in each image, prevents signal overlap, and improves the single-molecule localization accuracy.
Smart Images

Figure CN119757291B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of super-resolution imaging technology, and in particular to a laser intensity adjustment method, apparatus, device, and storage medium. Background Technology
[0002] Super-resolution imaging is a technique for improving the resolution of videos or images. For example, in the biomedical field, fluorescent dyes are used to stain biomolecules in samples, transforming them into fluorescent molecules. A laser is then used to activate these fluorescent molecules, and an imaging device captures the image to obtain a super-resolution image. Due to variations in the experimental environment and sample characteristics, the laser intensity needs to be adjusted accurately in real time to ensure that only a small number of molecules are activated in each super-resolution image, thus achieving high-quality imaging. In related technologies, manually adjusting the laser intensity is difficult to guarantee in real-time accuracy, resulting in poor image quality. Therefore, improving the imaging quality of super-resolution images has become a pressing technical problem. Summary of the Invention
[0003] The main objective of this application is to provide a laser intensity adjustment method, apparatus, device, and storage medium, which aims to improve the imaging quality of super-resolution images.
[0004] To achieve the above objectives, a first aspect of this application provides a laser intensity adjustment method, the method comprising:
[0005] Images of fluorescent samples irradiated by a laser are periodically acquired to obtain super-resolution images; the fluorescent samples are samples stained with fluorescent dyes.
[0006] Feature extraction is performed on the super-resolution image to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by laser.
[0007] The number of feature points is compared with the preset number of activations to obtain the number comparison result for each cycle.
[0008] The laser intensity of the laser is adjusted according to the quantity comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
[0009] In some embodiments, after comparing the number of feature points with a preset activation number to obtain the comparison result for each period, the method further includes:
[0010] If the quantity comparison result indicates that the number of feature points is equal to the preset activation number, then the image saturation of the super-resolution image is obtained;
[0011] The preset activation number is adjusted according to the image saturation so that the quantity comparison result in the next cycle is determined based on the adjusted preset activation number.
[0012] In some embodiments, adjusting the preset activation quantity based on the image saturation includes:
[0013] If the image saturation is less than the first saturation threshold, the preset activation number is adjusted to the sum of the preset activation number and the number adjustment threshold.
[0014] If the image saturation is greater than the second saturation threshold, the preset activation quantity is adjusted to the difference between the preset activation quantity and the quantity adjustment threshold; wherein the first saturation threshold is less than the second saturation threshold.
[0015] In some embodiments, adjusting the laser intensity of the laser based on the quantity comparison result includes:
[0016] If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, then the difference between the number of feature points and the preset activation number is obtained to obtain the target quantity difference.
[0017] The target intensity adjustment value is determined based on the difference in the target quantity.
[0018] The laser intensity of the laser is adjusted according to the target intensity adjustment value.
[0019] In some embodiments, the duty cycle corresponding to the laser intensity of the laser is the current duty cycle, and adjusting the laser intensity of the laser according to the quantity comparison result includes:
[0020] If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, then the ratio of the number of feature points to the preset activation number is obtained to get the target ratio.
[0021] The target increase coefficient is calculated by substituting the target ratio, the preset initial increment coefficient, the current duty cycle, and the preset laser increase / decrease factor into the preset adjustment formula.
[0022] The laser intensity of the laser is adjusted according to the target increment coefficient.
[0023] In some embodiments, the super-resolution image contains at least two pixels, and the feature extraction based on the super-resolution image to obtain the number of feature points includes:
[0024] Obtain the pixel value of each pixel;
[0025] The pixel points corresponding to the pixel values that are greater than the preset fluorescent pixel threshold are taken as target feature points;
[0026] The number of target feature points is obtained by counting the number of feature points.
[0027] In some embodiments, the step of using the pixel point corresponding to the pixel value greater than a preset fluorescence pixel threshold as the target feature point includes:
[0028] The super-resolution image is divided into regions according to a preset number of regions to obtain multiple target regions.
[0029] The maximum pixel value is determined based on the pixel values within each target region.
[0030] The pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area is taken as the target feature point.
[0031] To achieve the above objectives, a second aspect of the present application provides a laser intensity adjustment device, which includes a laser, an imaging device, and a controller;
[0032] The controller includes:
[0033] An acquisition module is used to periodically acquire images of fluorescent samples irradiated by a laser to obtain super-resolution images; the fluorescent sample is a sample stained with a fluorescent dye.
[0034] An extraction module is used to extract features from the super-resolution image to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by laser.
[0035] The comparison module is used to compare the number of feature points with the preset number of activations to obtain the comparison result of the number of each cycle;
[0036] An adjustment module is used to adjust the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
[0037] To achieve the above objectives, a third aspect of this application provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the method described in the first aspect.
[0038] To achieve the above objectives, a fourth aspect of the present application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method described in the first aspect.
[0039] The laser intensity adjustment method, apparatus, device, and storage medium proposed in this application acquire images of a fluorescent sample irradiated by a laser periodically to obtain a super-resolution image. The fluorescent sample is a sample stained with a fluorescent dye. Feature extraction is performed on the super-resolution image to obtain the number of feature points, where the number of feature points represents the number of fluorescent molecules activated by the laser. The number of feature points is compared with a preset activation number to obtain the comparison result for each period. The laser intensity is adjusted according to the comparison result to make the number of laser-activated fluorescent molecules approach the preset activation number. That is, by adjusting the laser intensity based on the comparison result of the number of feature points and the preset activation number, the number of laser-activated fluorescent molecules is brought closer to the preset activation number, achieving accurate control of the number of activated fluorescent molecules and improving the imaging quality of the super-resolution image. Attached Figure Description
[0040] Figure 1 This is an optional flowchart of the laser intensity adjustment method provided in the embodiments of this application;
[0041] Figure 2 This is a flowchart of a laser intensity adjustment method provided in another embodiment of this application;
[0042] Figure 3 yes Figure 2 The flowchart of step S202 in the document;
[0043] Figure 4 yes Figure 1 The first flowchart of step S104 in the process;
[0044] Figure 5 yes Figure 1 The second flowchart for step S104 in the process;
[0045] Figure 6 yes Figure 1 The flowchart of step S102 in the document;
[0046] Figure 7 yes Figure 6 The flowchart of step S602 in the document;
[0047] Figure 8 This is a schematic diagram of the structure of the laser intensity adjustment device provided in the embodiments of this application;
[0048] Figure 9 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0049] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0050] It should be noted that although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0052] First, let's analyze some of the terms used in this application:
[0053] Super-resolution imaging techniques include photoactivated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM). PALM is a method that uses laser to activate fluorescent molecules and precisely locate their positions to achieve super-resolution imaging. STORM is a method that utilizes the random switching properties of fluorescent molecules to achieve high-resolution imaging. In both PALM and STORM, a 405nm laser is widely used to activate and control the state of fluorescent molecules, and the adjustment of its laser intensity has a direct impact on the accuracy and quality of the imaging. By precisely adjusting the laser intensity and controlling the number of simultaneously activated fluorescent molecules, signal overlap can be prevented, improving the accuracy of single-molecule localization, and thus improving the imaging quality of the super-resolution image.
[0054] PALM works by using a laser to activate specific photosensitive fluorescent proteins, causing them to transition from a non-fluorescent state to a detectable fluorescent state. After activation, only a small subset of fluorescent molecules are activated at a time. The emission signals of these molecules are captured using a high-resolution camera, and the precise location of each molecule is determined through computational localization algorithms. By repeating the activation and detection process, a complete super-resolution image is gradually constructed, achieving nanometer-level resolution.
[0055] STORM: The principle of STORM is to label samples with specific dyes that have switching properties that can be activated by a laser. Using a specific laser, the random switching of fluorescent molecules is controlled over time, ensuring that only a small number of molecules are in an luminescent state at any given time. Multiple images of randomly emitting fluorescent molecules are captured at different time points, and this information is integrated using computer algorithms to reconstruct a high-resolution image of the sample.
[0056] Due to variations in the experimental environment and sample characteristics, real-time and accurate adjustment of the laser intensity is necessary to ensure that only a small number of molecules are activated in each super-resolution image, thereby achieving high-quality imaging. In related techniques, manually adjusting the laser intensity is difficult to guarantee in real-time accuracy, resulting in poor image quality.
[0057] Based on this, embodiments of this application provide a laser intensity adjustment method, apparatus, device, and storage medium, which aims to compare the number of feature points in a super-resolution image with a preset activation number, and adjust the laser intensity of the laser according to the comparison result, so that the number of laser-activated fluorescent molecules approaches the preset activation number. This achieves accurate control of the number of activated fluorescent molecules and improves the imaging quality of the super-resolution image.
[0058] The laser intensity adjustment method, apparatus, device, and storage medium provided in this application are specifically described through the following embodiments. First, the laser intensity adjustment method in this application is described.
[0059] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.
[0060] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.
[0061] The laser intensity adjustment method provided in this application can be applied to a terminal, a server, or software running on either a terminal or a server. In some embodiments, the terminal can be a smartphone, tablet, laptop, desktop computer, etc.; the server can be configured as an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements the laser intensity adjustment method, but is not limited to the above forms.
[0062] This application can be used in a wide variety of general-purpose or special-purpose computer system environments or configurations. Examples include: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices. This application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.
[0063] Please refer to Figure 1 , Figure 1 This is an optional flowchart of the laser intensity adjustment method provided in the embodiments of this application. The laser intensity adjustment method is applied to a super-resolution imaging device, which includes a laser, an imaging device, and a sample stained with a fluorescent dye. Figure 1 The method may include, but is not limited to, steps S101 to S104.
[0064] Step S101: Periodically acquire images of the fluorescent sample irradiated by the laser to obtain a super-resolution image; the fluorescent sample is a sample stained with a fluorescent dye.
[0065] Step S102: Feature extraction is performed based on the super-resolution image to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by the laser.
[0066] Step S103: Compare the number of feature points with the preset number of activations to obtain the comparison result for each cycle;
[0067] Step S104: Adjust the laser intensity of the laser according to the quantity comparison results so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
[0068] In step S101 of some embodiments, at the start of the super-resolution experiment, an initial laser intensity is set so that the laser irradiates the fluorescent sample at the initial intensity, thereby activating a portion of the fluorescent molecules in the sample. Then, an image of the fluorescent sample is acquired using a high-resolution imaging device to obtain a super-resolution image. After the fluorescent molecules are activated and transition from a non-fluorescent state to a detectable fluorescent state, they will transition back to a non-fluorescent state. Therefore, the laser intensity needs to be adjusted in real time to reactivate a portion of the fluorescent molecules. After adjusting the laser intensity, the image of the fluorescent sample needs to be acquired again; therefore, super-resolution images need to be acquired periodically.
[0069] In step S102 of some embodiments, the number of feature points characterizes the number of fluorescent molecules activated by the laser. In order to control the number of activated fluorescent molecules, it is necessary to extract features from the super-resolution image to obtain the number of feature points, so as to adjust the laser intensity based on the number of feature points, thereby controlling the number of activated fluorescent molecules.
[0070] It should be noted that after acquiring the super-resolution image, preprocessing is required to improve the accuracy of feature extraction. Preprocessing includes denoising and contrast enhancement. Denoising can be achieved by using a Gaussian filter to remove image noise and improve image clarity. Contrast enhancement can be achieved by using histogram equalization to improve image contrast and make details more apparent.
[0071] In step S103 of some embodiments, the preset activation number is the number of fluorescent molecules that the user pre-sets as expected to be activated. When the number of feature points and the preset activation number are not equal, it indicates that the actual number of activated fluorescent molecules is too large or too small, both of which will lead to poor imaging quality of the super-resolution image. Therefore, it is necessary to obtain the quantity comparison result after comparing the number of feature points with the preset activation number. The quantity comparison result includes the number of feature points being equal to the preset activation number, the number of feature points being less than the preset activation number, or the number of feature points being greater than the preset activation number.
[0072] In step S104 of some embodiments, when the number of feature points is greater than the preset activation number, it indicates that the actual number of activated fluorescent molecules is too large, and the current laser intensity is too high, so the laser intensity needs to be reduced. When the number of feature points is less than the preset activation number, it indicates that the actual number of activated fluorescent molecules is too small, and the current laser intensity is too low, so the laser intensity needs to be increased. When the number of feature points is equal to the preset activation number, the laser intensity can be fine-tuned. Because when capturing the current super-resolution image and then the next super-resolution image, the activated fluorescent molecules may change from a fluorescent state to a non-fluorescent state, fine-tuning the laser intensity can reactivate some of the fluorescent molecules. The laser intensity can be adjusted by setting a fine-tuning value and an adjustment value. When it is necessary to reduce or increase the laser intensity, the laser intensity is reduced or increased according to the adjustment value. When it is necessary to fine-tune the laser intensity, the laser intensity is increased or decreased according to the fine-tuning value.
[0073] It should be noted that after adjusting the laser intensity, steps S101 to S104 are repeated until the experiment ends. After the experiment, all super-resolution images are saved for subsequent processing and analysis. By continuously adjusting the laser intensity based on the number of feature points, the number of activated fluorescent molecules is kept at an optimal level throughout the experiment, achieving the desired imaging effect and quality.
[0074] Steps S101 to S104, as illustrated in this embodiment, involve periodically acquiring images of a fluorescent sample irradiated by a laser to obtain a super-resolution image. The fluorescent sample is a sample stained with a fluorescent dye. Feature extraction is performed on the super-resolution image to obtain the number of feature points, where the number of feature points represents the number of fluorescent molecules activated by the laser. The number of feature points is compared with a preset activation number to obtain the comparison result for each period. The laser intensity is adjusted based on the comparison result to bring the number of laser-activated fluorescent molecules closer to the preset activation number. In other words, by adjusting the laser intensity based on the comparison result between the number of feature points and the preset activation number, the number of laser-activated fluorescent molecules is brought closer to the preset activation number, achieving accurate control of the number of activated fluorescent molecules and improving the imaging quality of the super-resolution image.
[0075] Please see Figure 2 In some embodiments, after step S103, the laser intensity adjustment method may also include, but is not limited to, steps S201 to S202:
[0076] Step S201: If the number of feature points represented by the quantity comparison result is equal to the preset number of activations, then obtain the image saturation of the super-resolution image.
[0077] Step S202: Adjust the preset activation quantity according to the image saturation so that the quantity comparison result of the next cycle is determined based on the adjusted preset activation quantity.
[0078] In step S201 of some embodiments, the preset activation number is the number of fluorescent molecules expected to be activated, set by the experimenter. Different experimenters may set different values based on subjective experience. Therefore, it is also necessary to determine whether the preset activation number is the optimal number of fluorescent molecules to be activated. This determination is made only when the number of characteristic points in the quantity comparison result is equal to the preset activation number.
[0079] Specifically, when too many fluorescent molecules are activated, the super-resolution image will be too bright or saturated, leading to image distortion and blurred details. Conversely, when too few fluorescent molecules are activated, the image information will be insufficient. Therefore, the image saturation of the super-resolution image can be used to determine whether the preset activation number is the optimal number of activated fluorescent molecules. Thus, the image saturation of the super-resolution image is obtained when the number of feature points equals the preset activation number.
[0080] In step S202 of some embodiments, if the image saturation is too high, the preset activation number needs to be reduced. If the image saturation is too low, the preset activation number needs to be increased. The specific adjustment method can be set by the experimenter as needed.
[0081] For details, please refer to Figure 3 Step S202 may include, but is not limited to, steps S301 to S302:
[0082] Step S301: If the image saturation is less than the first saturation threshold, the preset activation number is adjusted to the sum of the preset activation number and the number adjustment threshold.
[0083] Step S302: If the image saturation is greater than the second saturation threshold, the preset activation number is adjusted to the difference between the preset activation number and the number adjustment threshold; wherein, the first saturation threshold is less than the second saturation threshold.
[0084] In step S301 of some embodiments, a saturation range is set. A first saturation threshold is equal to the lower limit of the saturation range, and a second saturation threshold is equal to the upper limit of the saturation range. When the image saturation is within the saturation range, there is no need to adjust the preset activation quantity. When the image saturation is less than the lower limit of the saturation range, it indicates that the preset activation quantity is set too small and needs to be increased. Therefore, the preset activation quantity can be adjusted to the sum of the preset activation quantity and the quantity adjustment threshold. The quantity adjustment threshold can be set to 2, and experimenters can modify the quantity adjustment threshold as needed.
[0085] In step S302 of some embodiments, when the image saturation is greater than the upper limit of the saturation range, it indicates that the preset activation number is set too high and needs to be reduced. Therefore, the preset activation number can be adjusted to the difference between the preset activation number and the number adjustment threshold.
[0086] In steps S301 to S302 of this embodiment, it is determined whether the preset activation number is the optimal number of fluorescent molecules to be activated based on the image saturation. If not, the preset activation number is adjusted to improve the image quality of the super-resolution image.
[0087] It should be noted that after adjusting the preset activation quantity, in the next cycle, the number of feature points is compared with the adjusted preset activation quantity to obtain the quantity comparison result.
[0088] In this embodiment, steps S301 to S302 involve obtaining the image saturation of the super-resolution image when the number of feature points is equal to the preset activation number, and then adjusting the preset activation number based on the image saturation to ensure that the preset activation number is the optimal number of activated fluorescent molecules, thereby improving the image quality of the super-resolution image.
[0089] Please see Figure 4 In some embodiments, step S104 may include, but is not limited to, steps S401 to S403:
[0090] Step S401: If the number comparison result is that the number of feature points is greater than or less than the preset activation number, then the difference between the number of feature points and the preset activation number is obtained to get the target number difference.
[0091] Step S402: Determine the target intensity adjustment value based on the target quantity difference;
[0092] Step S403: Adjust the laser intensity of the laser according to the target intensity adjustment value.
[0093] In step S401 of some embodiments, if the quantity comparison result is that the number of feature points is greater than the preset activation number, it indicates that the actual number of activated fluorescent molecules is too large. If the quantity comparison result is that the number of feature points is less than the preset activation number, it indicates that the actual number of activated fluorescent molecules is too small. Both cases require adjustment of the laser intensity. Therefore, the difference between the number of feature points and the preset activation number is obtained to obtain the target quantity difference, and the laser intensity of the laser is adjusted based on the target quantity difference.
[0094] In step S402 of some embodiments, the mapping relationship between the target quantity difference and the target intensity adjustment value can be pre-defined to obtain a target mapping table. The corresponding target intensity adjustment value is then extracted from the target mapping table based on the target quantity difference.
[0095] In step S403 of some embodiments, when the number of feature points is greater than the preset activation number, it indicates that the laser intensity needs to be reduced, and the adjusted laser intensity is the difference between the laser intensity and the target intensity adjustment value. When the number of feature points is less than the preset activation number, it indicates that the laser intensity needs to be increased, and the adjusted laser intensity is the sum of the laser intensity and the target intensity adjustment value.
[0096] In this embodiment, steps S401 to S403 adjust the laser intensity based on the difference between the number of feature points and the preset activation number, so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby improving the image quality of the super-resolution image.
[0097] Please see Figure 5 In some embodiments, the duty cycle corresponding to the laser intensity of the laser is the current duty cycle, and step S104 may also include, but is not limited to, steps S501 to S503:
[0098] Step S501: If the number comparison result is that the number of feature points is greater than or less than the preset activation number, then obtain the ratio of the number of feature points to the preset activation number to obtain the target ratio.
[0099] Step S502: Calculate the target increment coefficient by substituting the target ratio, the preset initial increment coefficient, the current duty cycle, and the preset laser increment / decrement factor into the preset adjustment formula.
[0100] Step S503: Adjust the laser intensity of the laser according to the target increment coefficient.
[0101] In step S501 of some embodiments, if the number of feature points is greater than or less than a preset activation number, it indicates that the laser intensity needs to be adjusted. Therefore, the ratio of the number of feature points to the preset activation number is obtained to obtain a target ratio, and the laser intensity of the laser is adjusted based on the target ratio.
[0102] In step S502 of some embodiments, the preset adjustment formula is as shown in the following formula (1):
[0103] K n =K n-1 +0.1+D n +FD*(1-b), (1)
[0104] Among them, K n K represents the target increment coefficient. m-1 D represents the initial increment coefficient. n FD represents the current duty cycle, b represents the laser increment / decrement factor, and b represents the target ratio. Substitute the target ratio, initial increment factor, current duty cycle, and preset laser increment / decrement factor into formula (1) to calculate the target increment factor.
[0105] In step S503 of some embodiments, the target duty cycle is the sum of the target increment coefficient and the current duty cycle. After obtaining the target duty cycle, the laser intensity is adjusted to the laser intensity corresponding to the target duty cycle. By adjusting the laser intensity through the duty cycle, precise adjustment of the laser intensity can be achieved.
[0106] In steps S501 to S503 of this embodiment, the laser intensity is adjusted based on the ratio of the number of feature points to the preset activation number, so that the number of fluorescent molecules activated by the laser approaches the preset activation number, thereby improving the image quality of the super-resolution image.
[0107] Please see Figure 6 In some embodiments, the super-resolution image contains at least two pixels, and step S102 includes, but is not limited to, steps S601 to S603:
[0108] Step S601: Obtain the pixel value of each pixel;
[0109] Step S602: Pixels with values greater than a preset fluorescence pixel threshold are taken as target feature points;
[0110] Step S603: Count the number of target feature points to obtain the number of feature points.
[0111] In step S601 of some embodiments, it is determined whether a pixel is a feature point. This can be done by determining whether the pixel value is greater than a preset fluorescence pixel threshold. Therefore, it is necessary to obtain the pixel value of each pixel first.
[0112] In steps S602 to S603 of some embodiments, when a pixel value is greater than a preset fluorescence pixel threshold, the pixel corresponding to that pixel value is taken as a target feature point. The number of target feature points is counted to obtain the total number of feature points.
[0113] In this embodiment, steps S601 to S603 involve comparing the pixel value of each pixel with a preset fluorescence pixel threshold to obtain target feature points, thereby obtaining the number of feature points based on the target feature points.
[0114] Please see Figure 7 In some embodiments, step S602 may include, but is not limited to, steps S701 to S703:
[0115] Step S701: Divide the super-resolution image into regions according to the preset number of regions to obtain multiple target regions;
[0116] Step S702: Determine the maximum pixel value based on the pixel values within each target area;
[0117] Step S703: The pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area is taken as the target feature point.
[0118] In some embodiments, steps S701 to S702, comparing the pixel value of each pixel with a preset fluorescence pixel threshold would result in a slow comparison speed. To improve the comparison speed, the super-resolution image is first divided into regions according to a preset number of region divisions, resulting in multiple target regions. The maximum pixel value within each target region is then obtained, and only the maximum pixel value needs to be compared with the preset fluorescence pixel threshold, thus improving the comparison speed. In one example, a target region can be divided into 5x5 pixels, requiring only one comparison for every 25 pixels.
[0119] In step S703 of some embodiments, after obtaining the maximum pixel value in each target area, if the maximum pixel value is greater than a preset fluorescent pixel threshold, then the pixel point corresponding to the maximum pixel value is the target feature point.
[0120] In this embodiment, steps S701 to S703 involve dividing the super-resolution image into regions to obtain multiple target regions. Only the maximum pixel value within the target region is compared with a preset fluorescence pixel threshold, which reduces the number of comparisons and improves the comparison speed.
[0121] Please see Figure 8 This application also provides a laser intensity adjustment device that can implement the above-described laser intensity adjustment method. The laser intensity adjustment device includes a laser 81, an imaging device 82, and a controller 83. The controller 83 includes:
[0122] The acquisition module 830 is used to periodically acquire images of fluorescent samples irradiated by a laser to obtain super-resolution images; the fluorescent sample is a sample stained with a fluorescent dye.
[0123] The extraction module 831 is used to extract features from the super-resolution image to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by the laser.
[0124] The comparison module 832 is used to compare the number of feature points with the preset number of activations to obtain the comparison result for each cycle.
[0125] The adjustment module 833 is used to adjust the laser intensity of the laser according to the quantity comparison result so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
[0126] The specific implementation of this laser intensity adjustment device is basically the same as the specific embodiment of the laser intensity adjustment method described above, and will not be repeated here.
[0127] This application also provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described laser intensity adjustment method. This electronic device can be any smart terminal, including tablet computers, in-vehicle computers, etc.
[0128] Please see Figure 9 , Figure 9 The hardware structure of an electronic device according to another embodiment is illustrated. The electronic device includes:
[0129] The processor 901 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.
[0130] The memory 902 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 902 can store the operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 902 and is called and executed by the processor 901 to execute the laser intensity adjustment method of the embodiments of this application.
[0131] The input / output interface 903 is used to implement information input and output;
[0132] The communication interface 904 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).
[0133] Bus 905 transmits information between various components of the device (e.g., processor 901, memory 902, input / output interface 903, and communication interface 904);
[0134] The processor 901, memory 902, input / output interface 903, and communication interface 904 are connected to each other within the device via bus 905.
[0135] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described laser intensity adjustment method.
[0136] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0137] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.
[0138] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.
[0139] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.
[0140] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.
[0141] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0142] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.
[0143] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the apparatus or units may be electrical, mechanical, or other forms.
[0144] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0145] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0146] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0147] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.
Claims
1. A method for adjusting laser intensity, characterized in that, The method includes: A super-resolution image is obtained by periodically acquiring images of a fluorescent sample irradiated by a laser; the duty cycle corresponding to the laser intensity of the laser is the current duty cycle; the fluorescent sample is a sample stained with a fluorescent dye; and the super-resolution image contains at least two pixels. Obtain the pixel value of each pixel; The pixel points corresponding to the pixel values that are greater than the preset fluorescent pixel threshold are taken as target feature points; The number of target feature points is counted to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by laser. The number of feature points is compared with the preset number of activations to obtain the number comparison result for each cycle. If the quantity comparison result indicates that the number of feature points is equal to the preset activation number, then the image saturation of the super-resolution image is obtained; The preset activation number is adjusted according to the image saturation so that the quantity comparison result in the next cycle is determined based on the adjusted preset activation number. If the quantity comparison result is that the number of feature points is greater than or less than the preset activation number, then the ratio of the number of feature points to the preset activation number is obtained to get the target ratio. The target increase coefficient is calculated by substituting the target ratio, the preset initial increment coefficient, the current duty cycle, and the preset laser increase / decrease factor into a preset adjustment formula; wherein the adjustment formula is as follows: , in, This represents the target increment coefficient. This represents the initial increment coefficient. This indicates the current duty cycle. This represents the laser amplification / subtraction factor. This represents the target ratio; The target duty cycle is obtained by summing the target increment coefficient and the current duty cycle. The laser intensity of the laser is then adjusted to the laser intensity corresponding to the target duty cycle, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
2. The method according to claim 1, characterized in that, The step of adjusting the preset activation quantity based on the image saturation includes: If the image saturation is less than the first saturation threshold, the preset activation number is adjusted to the sum of the preset activation number and the number adjustment threshold. If the image saturation is greater than the second saturation threshold, the preset activation quantity is adjusted to the difference between the preset activation quantity and the quantity adjustment threshold; wherein the first saturation threshold is less than the second saturation threshold.
3. The method according to claim 1, characterized in that, The step of using the pixel points corresponding to the pixel values greater than a preset fluorescence pixel threshold as target feature points includes: The super-resolution image is divided into regions according to a preset number of regions to obtain multiple target regions. The maximum pixel value is determined based on the pixel values within each target region. The pixel point corresponding to the maximum pixel value greater than the preset fluorescent pixel threshold in each target area is taken as the target feature point.
4. A laser intensity adjustment device, characterized in that, The laser intensity adjustment device includes a laser, an imaging device, and a controller, and the device is used to implement the laser intensity adjustment method according to any one of claims 1 to 3; The controller includes: An acquisition module is used to periodically acquire images of fluorescent samples irradiated by a laser to obtain super-resolution images; the fluorescent sample is a sample stained with a fluorescent dye. An extraction module is used to extract features from the super-resolution image to obtain the number of feature points; wherein, the number of feature points represents the number of fluorescent molecules activated by laser. The comparison module is used to compare the number of feature points with the preset number of activations to obtain the comparison result of the number of each cycle; An adjustment module is used to adjust the laser intensity of the laser according to the quantity comparison result, so that the number of fluorescent molecules activated by the laser approaches the preset activation number.
5. An electronic device, characterized in that, The electronic device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the laser intensity adjustment method according to any one of claims 1 to 3.
6. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the laser intensity adjustment method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Method and device for automatically analyzing and adjusting brightness of biological fluorescence imaging
CN107436299A
Super-resolution microscopic imaging method and system for active structured light illumination
CN115308184A