Optical microscope, rapid focusing method thereof and electronic equipment

Abstract

The invention discloses an optical microscope, a rapid focusing method thereof and electronic equipment. The optical microscope comprises a first camera, a second camera, an objective table, a first light path assembly and a second light path assembly, the first light path assembly and the second light path assembly multiplex an objective lens, the first light path assembly is used for providing visible light and fluorescent light to a target sample placed on the objective table and transmitting the visible light and the fluorescent light to the first camera through the objective lens, and the second light path assembly is used for providing infrared light to the target sample. And transmitting to the second camera through the objective lens. The rapid focusing method comprises the following steps: acquiring a visible light image of a target sample through a first camera, and acquiring an infrared image of the target sample through a second camera; according to the visible light image and the infrared image, determining an offset condition of the target sample relative to the objective lens; and performing driving control on the objective lens according to the offset condition. According to the method, the infrared light path and the second camera are added, the objective lens is driven to focus according to the imaging difference of the double cameras, and the focusing speed of the optical microscope can be increased.

Description

Technical Field

[0001] The present invention relates to the technical field of optical microscopes, and in particular to an optical microscope and a rapid focusing method thereof, as well as electronic equipment. Background Art

[0002] Conventional autofocus technology is mainly divided into two methods: one is active autofocus, which uses an additional focused light beam to irradiate the slide, establish a defocus model for the reflected image, analyze and process the defocus image, obtain depth information, and drive the objective lens to complete focusing; the other is autofocus technology based on image clarity evaluation, that is, in the Z-axis search process, the clarity of the image to be collected is evaluated, the extreme value of the focus evaluation curve is determined, and the lens is moved according to the extreme value to complete autofocus.

[0003] However, the above-mentioned autofocus technology generally has a slow focusing speed and is mainly suitable for single-field or static samples. For samples that can swim in a large range in the culture medium, such as sperm and zebrafish, since the sample swims in the suspension, the sample may not always be in the X / Y plane, but may also be diagonally upward or downward. Both of the above methods will cause the sample to be out of focus and the image to be blurred. In addition, the second method will also lose the target due to the slow focusing speed. Summary of the invention

[0004] The present invention aims to solve the problems in the conventional focusing technology at least to a certain extent. To this end, the present invention aims to provide an optical microscope and a fast focusing method and electronic device thereof to improve the focusing speed of the optical microscope.

[0005] To achieve the above-mentioned purpose, a first aspect of the present invention provides a method for fast focusing of an optical microscope, wherein the optical microscope comprises a first camera, a second camera, an objective stage, and a first optical path component and a second optical path component of a multiplexed objective lens, wherein the first optical path component is used to provide visible light and fluorescence to a target sample placed on the objective stage, and transmit the light to the first camera through the objective lens, and the second optical path component is used to provide infrared light to the target sample, and transmit the light to the second camera through the objective lens; the method comprises: acquiring a visible light image of the target sample through the first camera, and acquiring an infrared image of the target sample through the second camera; determining an offset of the target sample relative to the objective lens based on the visible light image and the infrared image; and driving and controlling the objective lens based on the offset to achieve fast focusing.

[0006] In addition, the fast focusing method of the optical microscope proposed in the above embodiment of the present invention may also have the following additional technical features:

[0007] According to one embodiment of the present invention, determining the offset of the target sample relative to the objective lens based on the visible light image and the infrared image includes: respectively calculating a first clarity of the visible light image and a second clarity of the infrared image; and determining the offset of the target sample relative to the objective lens based on the first clarity and the second clarity.

[0008] According to one embodiment of the present invention, the method further includes: determining target parameters of the target sample, the target parameters including categories and / or target areas; wherein, when the target parameters include the target area, the first clarity is obtained by calculating the clarity of an area in the visible light image corresponding to the target area, and the second clarity is obtained by calculating the clarity of an area in the infrared image corresponding to the target area, wherein determining the offset of the target sample relative to the objective lens based on the first clarity and the second clarity includes: comparing the first clarity with a first reference clarity to obtain a first comparison result, and comparing the second clarity with a second reference clarity to obtain a second comparison result; determining a target mapping relationship based on the category of the target sample, and determining the offset of the target sample relative to the objective lens based on the target mapping relationship, the first comparison result and the second comparison result.

[0009] According to one embodiment of the present invention, when the category is cells, the offset of the target sample relative to the objective lens is determined based on the target mapping relationship, the first comparison result and the second comparison result, including: if the first comparison result is a decrease in clarity and the second comparison result is an increase in clarity, then it is determined that the target sample is far away from the objective lens; if the first comparison result is a decrease in clarity and the second comparison result is a decrease in clarity, then it is determined that the target sample is close to the objective lens.

[0010] According to one embodiment of the present invention, the target mapping relationship includes a relationship curve between focal length deviation and clarity change, and determining the offset of the target sample relative to the objective lens based on the first comparison result and the second comparison result includes: determining the focal length deviation of the objective lens based on the relationship curve between the focal length deviation and the clarity change, and the clarity change in the first comparison result and the clarity change in the second comparison result.

[0011] According to one embodiment of the present invention, before acquiring the visible light image of the target sample through the first camera and acquiring the infrared image of the target sample through the second camera, the method further includes: determining a pre-focusing position of the objective lens and controlling the objective lens to move to the pre-focusing position.

[0012] According to one embodiment of the present invention, respectively calculating the first clarity of the visible light image and the second clarity of the infrared image comprises: respectively calculating the first clarity of the visible light image and the second clarity of the infrared image using a Tenengrad gradient function through a Sobel operator.

[0013] According to an embodiment of the present invention, the target sample is a dynamic sample, and the category of the dynamic sample includes at least one of cells, zebrafish, nematodes, and plankton.

[0014] To achieve the above-mentioned purpose, a second aspect of the present invention proposes an electronic device, characterized in that it includes a memory, a processor and a computer program stored in the memory, and when the computer program is executed by the processor, it implements the fast focusing method of the optical microscope described in the first aspect.

[0015] To achieve the above-mentioned purpose, an embodiment of the third aspect of the present invention proposes an optical microscope, comprising: a first camera, a second camera, an objective stage, and a first optical path component and a second optical path component of a multiplexed objective lens, the first optical path component and the second optical path component multiplexed objective lens, the first optical path component is used to provide visible light and fluorescence to a target sample placed on the objective stage, and transmit it to the first camera through the objective lens, the second optical path component is used to provide infrared light to the target sample, and transmit it to the second camera through the objective lens; a driving component is used to drive the objective lens to move relative to the objective lens; the electronic device described in the embodiment of the second aspect is used to obtain a visible light image of the target sample through the first camera, and obtain an infrared image of the target sample through the second camera, and determine the offset of the target sample relative to the objective lens based on the visible light image and the infrared image, and drive and control the objective lens through the driving component based on the offset to achieve rapid focusing of the objective lens.

[0016] The optical microscope and its fast focusing method and electronic device of the embodiment of the present invention obtain a visible light image of a target sample through a first camera, obtain an infrared image of the target sample through a second camera, determine the offset of the target sample relative to the objective lens based on the visible light image and the infrared image, and drive and control the objective lens through a driving component based on the offset. Thus, fast focusing of the objective lens can be achieved, thereby meeting the observation requirements of dynamic samples.

[0017] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a flow chart of a fast focusing method for an optical microscope according to an embodiment of the present invention;

[0019] Figure 2 is a schematic structural diagram of an optical microscope according to an embodiment of the present invention;

[0020] Figure 3 is a schematic diagram of a visible light path according to an embodiment of the present invention;

[0021] Figure 4 is a schematic diagram of a fluorescent light path of an embodiment of the present invention;

[0022] Figure 5 is a schematic diagram of an infrared light path of an embodiment of the present invention;

[0023] Figure 6 is a flow chart of obtaining a focusing strategy according to an embodiment of the present invention;

[0024] Figure 7 is a structural block diagram of an electronic device according to an embodiment of the present invention;

[0025] Figure 8 It is a schematic structural diagram of an optical microscope according to another embodiment of the present invention. DETAILED DESCRIPTION

[0026] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0027] The optical microscope and its rapid focusing method and electronic device according to embodiments of the present invention are described below with reference to the accompanying drawings.

[0028] Figure 1 4 is a flow chart of a fast focusing method for an optical microscope according to an embodiment of the present invention.

[0029] In this embodiment, if Figure 2 As shown, the optical microscope 200 includes a first camera 10, a second camera 20, an objective stage 30, and a first optical path component and a second optical path component of a multiplexed objective lens 40. The first optical path component is used to provide visible light and fluorescence to a target sample 1 placed on the objective stage 30, and transmit it to the first camera 10 through the objective lens 40. The second optical path component is used to provide infrared light to the target sample 1, and transmit it to the second camera 20 through the objective lens 40.

[0030] The first camera 10 and the second camera 20 may be CCD (Charge Coupled Device) cameras, which have the characteristics of fast response speed and can quickly capture the required images.

[0031] For some examples, see Figure 2 The first optical path component may include a visible light path and a fluorescent light path, and the visible light path component includes a visible light source 51, a first collimating lens 52, a first dichroic mirror 53, a first condensing lens 54, a first optical integrator 55, a first beam expander and collimator 56, an objective lens 40, a second dichroic mirror 57 and a beam splitter component 58. The visible light path is as follows Figure 3 As shown; the fluorescent light path component includes a fluorescent array 61 (which may include an ultraviolet light array, a blue light array and a green light array), a second collimating lens 62, a filter 63, a second focusing lens 64, a second optical integrator 65, a second beam expander collimator 66, and multiplexes the beam splitter component 58, the second dichroic mirror 57 and the objective lens 40 of the visible light path component. The fluorescent light path is as shown in FIG. Figure 4 The second optical path component includes an infrared light path component, which includes an infrared light source 71, a third collimating lens 72, and multiplexes the first dichroic mirror 53, a first condensing lens 54, a first optical integrator 55, a first beam expander collimator 56, an objective lens 40, and a second dichroic mirror 57 of the visible light path component. The infrared light path is as shown in FIG. Figure 5 shown.

[0032] like Figure 1 As shown, the fast focusing methods of optical microscope include:

[0033] S11, acquiring a visible light image of the target sample through a first camera, and acquiring an infrared image of the target sample through a second camera.

[0034] Specifically, see Figure 2-Figure 5 When the optical microscope 200 is working, the visible light path, the fluorescent light path and the infrared light path are working. At this time, the visible light image of the target sample can be obtained through the first camera 10 below the spectroscope assembly 58, and the infrared image of the target sample can be obtained through the second camera 20 on the right side of the second dichroic mirror 56.

[0035] S12, determining the offset of the target sample relative to the objective lens according to the visible light image and the infrared image.

[0036] S13, driving and controlling the objective lens according to the offset condition to achieve rapid focusing.

[0037] Specifically, a mapping relationship between a visible light image, an infrared image, and the offset of a target sample relative to an objective lens may be established in advance, for example, a mapping relationship between the clarity of a visible light image, the clarity of an infrared image, and the offset of a target sample relative to an objective lens may be established in advance. A learning model may also be obtained by training in advance using machine learning, for example, a neural network model, the input of which is the clarity of a visible light image, the clarity of an infrared image, or the difference between the clarity of a visible light image, the clarity of an infrared image, and a corresponding reference clarity, and the output is the offset.

[0038] When using an optical microscope to adjust the focus, the first clarity of the visible light image and the second clarity of the infrared image can be calculated respectively; then the pre-established mapping relationship or the pre-trained learning model can be called to determine the offset of the target sample relative to the objective lens according to the first clarity and the second clarity. In this way, the offset of the target sample relative to the objective lens can be quickly obtained, and then the objective lens can be driven and controlled according to the offset to achieve rapid focusing.

[0039] The fast focusing method of the optical microscope calculates the offset direction of the target sample and predicts the offset distance by adding an infrared light path and a second camera, and drives the objective lens to complete the focusing by using the difference in the clarity of the dual-camera imaging. This method can achieve fast automatic focusing on the target sample and can achieve fast and effective tracking when the target sample is a dynamic sample. In addition, by driving the objective lens to focus instead of driving the stage, the influence of focusing on the movement of the dynamic sample can be avoided, which facilitates better focusing on the dynamic sample.

[0040] In some embodiments of the present invention, determining the offset of the target sample relative to the objective lens based on the visible light image and the infrared image includes: calculating a first clarity of the visible light image and a second clarity of the infrared image respectively; and determining the offset of the target sample relative to the objective lens based on the first clarity and the second clarity.

[0041] Specifically, a mapping relationship between the definition of visible light images, the definition of infrared images and the offset of the target sample relative to the objective lens can be established in advance through experiments. When establishing the mapping relationship, a statistical method can be used, for example, to calculate a fitting curve of the collected data as the mapping relationship.

[0042] In some examples, the mapping relationship may be a mapping relationship between a change in the relative reference definition and an offset. When used, after calculating the first definition of the current visible light image and the second definition of the current infrared image, the first definition and the second definition may be compared with the corresponding reference definition to obtain corresponding comparison results, and then the mapping relationship may be called to determine the offset of the target sample relative to the objective lens according to the comparison results.

[0043] In other examples, the above mapping relationship may be a mapping relationship between the change in clarity before and after the preset step length of focus adjustment and the offset. When in use, after calculating the first clarity of the current visible light image and the second clarity of the current infrared image, the preset step length of focus may be adjusted, and then the first clarity of the visible light image and the second clarity of the infrared image after the adjustment of focus may be calculated, and the two first clarity before and after the adjustment of focus and the two second clarity may be compared to obtain corresponding comparison results, and then the mapping relationship may be called to determine the offset of the target sample relative to the objective lens according to the comparison results.

[0044] In this embodiment, the process of automatic focusing of the optical microscope can be considered as the process of evaluating the clarity of the image. If the focus is inaccurate, the image clarity is low and the visual effect is blurred. To achieve automatic focusing, the main thing is to distinguish the clarity of the image. There are many image clarity evaluation algorithms. In the spatial domain, the main focus is on the field contrast of the image, that is, the gradient difference of the grayscale features between adjacent pixels; in the frequency domain, the main focus is on the frequency components of the image. The image with clear focus has more high-frequency components, and the image with blurred focus has more low-frequency components.

[0045] As an implementation manner, respectively calculating the first clarity of the visible light image and the second clarity of the infrared image may include: respectively calculating the first clarity of the visible light image and the second clarity of the infrared image using a Tenengrad gradient function through a Sobel operator.

[0046] Specifically, the Tenengrad gradient function uses the Sobel operator to extract the gradient values ​​in the horizontal and vertical directions respectively. The image clarity based on the Tenengrad gradient function is defined as follows:

[0047] D(f)=∑ y ∑ x |G(x,y)|G(x,y)>T

[0048] in, T represents a given edge detection threshold, G x (x,y),G y (x, y) represents the convolution of the Sobel horizontal and vertical edge detection operators at the pixel point (x, y).

[0049] In some embodiments of the present invention, the fast focusing method of an optical microscope further includes: determining target parameters of the target sample, wherein the target parameters include a category and / or a target area.

[0050] In this embodiment, when the target parameter includes a target area, the first clarity is obtained by calculating the clarity of an area in the visible light image corresponding to the target area, and the second clarity is obtained by calculating the clarity of an area in the infrared image corresponding to the target area. Based on the first clarity and the second clarity, the offset of the target sample relative to the objective lens is determined, including: comparing the first clarity with a first reference clarity to obtain a first comparison result, and comparing the second clarity with a second reference clarity to obtain a second comparison result; determining a target mapping relationship according to the category of the target sample, and determining the offset of the target sample relative to the objective lens based on the target mapping relationship, the first comparison result, and the second comparison result.

[0051] Specifically, the target sample may be a dynamic sample, and its category may include at least one of cells (such as sperm), zebrafish, nematodes, and plankton. Since different dynamic samples such as sperm and zebrafish have different swimming rules and amplitudes in suspension or culture medium, their corresponding focusing strategies are also different. Figure 6 As shown, for different dynamic samples, such as cells, zebrafish, nematodes, plankton, etc., visible light images and infrared images with different focal lengths (i.e., the distance between the focal plane of the objective lens and the focal plane of the sample) can be obtained in advance through two CCD cameras, and the clarity of the visible light image and the infrared image can be calculated respectively according to the numerical evaluation method of the image clarity, so as to obtain a large amount of clarity and focal length data and store them in a database; afterwards, the focusing strategy of each dynamic sample can be obtained by using mathematical statistics or machine learning methods.

[0052] After focusing based on the overall clarity of the visible light image and the infrared image, a relatively clear target sample image can be obtained. The target object in the target sample, such as an object with good morphology and activity, can be determined based on the clear target sample image, and the area where the target object is located can be determined as the target area, and then the target area can be tracked to better meet the observation needs of dynamic samples. Among them, in order to improve the observation effect, the clarity of the visible light image and the infrared image can be calculated based on the target area, and further focusing can be performed according to the clarity to improve the observation effect of the target object in the target sample, and it can also facilitate tracking, positioning, grabbing and other processing of the target object.

[0053] It should be noted that the focusing strategies obtained in the above experiments are obtained for different dynamic samples respectively. A learning model can also be obtained by training the data of all dynamic samples to be suitable for different dynamic samples.

[0054] In some embodiments of the present invention, when the category is cells, the offset of the target sample relative to the objective lens is determined based on the target mapping relationship, the first comparison result and the second comparison result, including: if the first comparison result is a decrease in clarity and the second comparison result is an increase in clarity, then it is determined that the target sample is far away from the objective lens; if the first comparison result is a decrease in clarity and the second comparison result is a decrease in clarity, then it is determined that the target sample is close to the objective lens.

[0055] Specifically, when the sample is a cell, the focusing strategy shown in Table 1 below is also obtained in advance through experiments. As shown in Table 1 below, when the focal plane is normal, the first clarity is clear and the second clarity is blurred, which can be represented by a specific value or a numerical range. At this time, it is considered that the focusing is accurate, and the clarity corresponding to the normal focal plane can be used as a benchmark, respectively recorded as the first reference clarity and the second reference clarity. In the actual use of the optical microscope, the current visible light image and infrared image are respectively acquired by two CCD cameras, and the first clarity and the second clarity are respectively calculated, which are respectively compared with the first reference clarity and the second reference clarity to obtain the first comparison result and the second comparison result. If the first comparison result is a decrease in clarity and the second comparison result is an increase in clarity, it is determined that the target sample is far away from the objective lens, and the objective lens can be driven to approach the target sample to achieve rapid focusing; if the first comparison result is a decrease in clarity and the second comparison result is a decrease in clarity, it is determined that the target sample is close to the objective lens, and the objective lens can be driven away from the target sample to achieve rapid focusing.

[0056] Table 1

[0057] First clarity Second clarity Offset Objective lens driving direction Clarity Vague Normal focal plane Accurate focus Loss of clarity Improved clarity The sample is far away from the objective Approaching the sample Loss of clarity Loss of clarity The sample is close to the objective Leave the sample

[0058] To improve the focusing effect, in the above experiment, the first camera and the second camera can be adjusted to be in focus under visible light, that is, the image acquired by the first camera under the visible light source and the image acquired by the second camera under the visible light source have the same clarity and are both relatively clear. Then, the visible light source corresponding to the second camera is replaced with an infrared light source, and the experiment to obtain the above focusing strategy is continued.

[0059] In some embodiments of the present invention, the target mapping relationship includes a relationship curve between focal length deviation and clarity change, and the offset of the target sample relative to the objective lens is determined based on the first comparison result and the second comparison result, including: determining the focal length deviation of the objective lens based on the relationship curve between focal length deviation and clarity change, and the clarity change in the first comparison result and the clarity change in the second comparison result.

[0060] It should be noted that the relationship curve in this embodiment is the same as the above table, which is one of the above mapping relationships, and the specific form of the mapping relationship can be set as needed.

[0061] In some embodiments of the present invention, before acquiring a visible light image of the target sample through the first camera and acquiring an infrared image of the target sample through the second camera, the method further includes: determining a pre-focus position of the objective lens and controlling the objective lens to move to the pre-focus position.

[0062] Specifically, the approximate focusing range of the objective lens can be determined first, and then the objective lens can be driven to move into the approximate focusing range, thereby greatly reducing the time and error consumed in focusing.

[0063] It should be noted that the focal plane thickness of the objective lens is different under objective lenses of different magnifications. Therefore, when adjusting the focus, a fine-tuning device can be set to quickly and accurately adjust the imaging distance difference of the focal planes of the dual CCD cameras under different magnifications. This distance difference can change the effective capture range of the autofocus.

[0064] In summary, the fast focusing method of the optical microscope of the embodiment of the present invention can realize the fast focusing of the optical microscope. Compared with the traditional solution of focusing and comparing only based on the visible light image, the focusing time can be improved from 5 to 10 seconds in the traditional solution to 10ms to 20ms.

[0065] In addition, in some embodiments of the present invention, the infrared light source in the optical microscope can be eliminated, and the beam splitter assembly 58 can be replaced with a semi-transparent and semi-reflective mirror, and the position of the second camera can be adjusted. After that, the above-mentioned focusing solution can be used to drive the objective lens. This solution can also achieve fast focusing, but compared with the above-mentioned visible light solution, the imaging effect is affected due to the attenuation of light intensity, which may affect the focusing speed.

[0066] Based on the fast focusing method of the optical microscope in the above example, the present invention provides an electronic device.

[0067] Figure 7 It is a structural block diagram of an electronic device according to an embodiment of the present invention.

[0068] like Figure 7 As shown, the electronic device 500 includes: a processor 501 and a memory 503. The processor 501 and the memory 503 are connected, such as through a bus 502. Optionally, the electronic device 500 may also include a transceiver 504. It should be noted that in actual applications, the transceiver 504 is not limited to one, and the structure of the electronic device 500 does not constitute a limitation on the embodiments of the present invention.

[0069] Processor 501 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of the present invention. Processor 501 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0070] The bus 502 may include a path to transmit information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0071] The memory 503 is used to store a computer program corresponding to the fast focusing method of the optical microscope of the above embodiment of the present invention, and the computer program is controlled and executed by the processor 501. The processor 501 is used to execute the computer program stored in the memory 503 to implement the contents shown in the above method embodiment.

[0072] Figure 7 The electronic device 500 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0073] Figure 8 It is a schematic structural diagram of an optical microscope according to another embodiment of the present invention.

[0074] like Figure 8 As shown, the optical microscope 200 includes: a first camera 10, a second camera 20, a stage 30, a driving assembly 80, a first optical path assembly and a second optical path assembly of a multiplexed objective lens 40, and the electronic device 500 of the above embodiment.

[0075] In this embodiment, the first optical path component is used to provide visible light and fluorescence to the target sample 1 placed on the stage 30, and transmits it to the first camera 10 through the objective lens 40, and the second optical path component is used to provide infrared light to the target sample 1, and transmits it to the second camera 20 through the objective lens 40. The driving component 80 is used to drive the objective lens 40 to move relative to the stage 30. The electronic device 500 is used to obtain a visible light image of the target sample 1 through the first camera 10, and to obtain an infrared image of the target sample 1 through the second camera 20, and to determine the offset of the target sample relative to the objective lens based on the visible light image and the infrared image, and to drive and control the objective lens 40 through the driving component 80 based on the offset, so as to achieve rapid focusing of the objective lens 40.

[0076] It should be noted that, for other specific implementations of the optical microscope of the embodiment of the present invention, reference may be made to the specific implementation of the fast focusing method of the optical microscope of the above embodiment.

[0077] The optical microscope of the embodiment of the present invention can achieve rapid focusing through the rapid focusing method of the optical microscope of the above embodiment.

[0078] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0079] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0080] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0081] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0082] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0083] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0084] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0085] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A fast focusing method for an optical microscope, It is characterized in that The optical microscope comprises a first camera, a second camera, an objective stage, and a first optical path component and a second optical path component of a multiplexed objective lens, wherein the first optical path component is used to provide visible light and fluorescence to a target sample placed on the objective stage and transmit the visible light and fluorescence to the first camera through the objective lens, and the second optical path component is used to provide infrared light to the target sample and transmit the infrared light to the second camera through the objective lens; the method comprises: Acquire a visible light image of the target sample through the first camera, and acquire an infrared image of the target sample through the second camera; Determining the displacement of the target sample relative to the objective lens according to the visible light image and the infrared image; The objective lens is driven and controlled according to the offset condition to achieve rapid focusing.

2. The fast focusing method of an optical microscope according to claim 1, It is characterized in that Determining the displacement of the target sample relative to the objective lens according to the visible light image and the infrared image includes: respectively calculating a first definition of the visible light image and a second definition of the infrared image; The offset of the target sample relative to the objective lens is determined according to the first definition and the second definition.

3. The fast focusing method of an optical microscope according to claim 2, It is characterized in that The method further comprises: Determining target parameters of the target sample, wherein the target parameters include a category and / or a target area; Wherein, when the target parameter includes the target area, the first clarity is obtained by calculating the clarity of an area corresponding to the target area in the visible light image, and the second clarity is obtained by calculating the clarity of an area corresponding to the target area in the infrared image, and determining the offset of the target sample relative to the objective lens according to the first clarity and the second clarity includes: Comparing the first definition with a first reference definition to obtain a first comparison result, and comparing the second definition with a second reference definition to obtain a second comparison result; A target mapping relationship is determined according to the category of the target sample, and an offset of the target sample relative to the objective lens is determined according to the target mapping relationship, the first comparison result, and the second comparison result.

4. The fast focusing method of an optical microscope according to claim 3, It is characterized in that When the category is a cell, determining the offset of the target sample relative to the objective lens according to the target mapping relationship, the first comparison result, and the second comparison result includes: If the first comparison result is that the clarity decreases, and the second comparison result is that the clarity increases, it is determined that the target sample is far away from the objective lens; If the first comparison result is that the clarity is reduced and the second comparison result is that the clarity is reduced, it is determined that the target sample is close to the objective lens.

5. The fast focusing method of an optical microscope according to claim 3, It is characterized in that The target mapping relationship includes a relationship curve between focal length deviation and clarity change, and determining the offset of the target sample relative to the objective lens according to the first comparison result and the second comparison result includes: The focal length deviation of the objective lens is determined according to the relationship curve between the focal length deviation and the clarity change, and the clarity change in the first comparison result and the clarity change in the second comparison result.

6. The fast focusing method of an optical microscope according to claim 1, It is characterized in that Before acquiring the visible light image of the target sample by the first camera and acquiring the infrared image of the target sample by the second camera, the method further includes: Determine a pre-focus position of the objective lens, and control the objective lens to move to the pre-focus position.

7. The fast focusing method of an optical microscope according to claim 2, It is characterized in that The respectively calculating the first clarity of the visible light image and the second clarity of the infrared image comprises: The first definition of the visible light image and the second definition of the infrared image are calculated respectively by using the Tenengrad gradient function through the Sobel operator.

8. The fast focusing method of an optical microscope according to claim 3, It is characterized in that The target sample is a dynamic sample, and the category of the dynamic sample includes at least one of cells, zebrafish, nematodes, and plankton.

9. An electronic device, It is characterized in that The invention comprises a memory, a processor and a computer program stored in the memory, wherein when the computer program is executed by the processor, the fast focusing method of the optical microscope as described in any one of claims 1 to 8 is implemented.

10. An optical microscope, It is characterized in that include: A first camera, a second camera, an objective stage, and a first optical path component and a second optical path component multiplexing an objective lens, wherein the first optical path component and the second optical path component multiplex the objective lens, the first optical path component is used to provide visible light and fluorescence to a target sample placed on the objective stage, and transmit the visible light and fluorescence to the first camera through the objective lens, and the second optical path component is used to provide infrared light to the target sample, and transmit the infrared light to the second camera through the objective lens; A driving assembly, used for driving the objective lens to move relative to the stage; The electronic device as described in claim 9 is used to obtain a visible light image of the target sample through the first camera, and to obtain an infrared image of the target sample through the second camera, and to determine the offset of the target sample relative to the objective lens based on the visible light image and the infrared image, and to drive and control the objective lens through the driving component based on the offset to achieve rapid focusing of the objective lens.

Images