Methods for judging whether oil dripping is successful and digital microscope
By obtaining the image difference value before and after the blood smear dripping oil in a digital microscope, the successful dripping oil is quickly and accurately judged, which solves the problems of dark field of view and inaccurate automatic dripping oil detection in the existing technology medium and high-power oil mirrors, and improves the detection speed.
Patent Information
- Application Number
- CN201910517967.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-14
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2039-06-14
AI Technical Summary
In the prior art, when using high-power oil mirrors for blood cell analysis, problems such as light refraction lead to dark field of view, affecting sample observation, and inaccurate detection of refueling status and refueling volume during automatic oil dropping, which reduces the detection speed.
By applying a method to determine whether the oil drop is successful in a digital microscope, using multiple objective lenses (including 4×, 10×, 40× and 100× objective lenses) and a digital camera, the cell images of the blood smear before and after the oil drop are obtained, the image difference value is calculated, and the oil drop is determined to be successful when the difference value is greater than the predetermined threshold.
It realizes a quick and accurate judgment of whether the drip is successful, and improves the detection speed without setting the waiting time or increasing the hardware structure.
Smart Images

Figure CN112082991B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the field of in vitro diagnosis, and in particular to a method for judging whether oil dripping is successful and a digital microscope. Background Art
[0002] In clinical practice, blood cell classification and counting are mainly carried out using blood cell analyzers and manual microscopic examination. Specifically, the samples are first screened using a blood cell analyzer. When abnormal samples are screened out, they are manually observed using a microscope and classified and counted. Manual microscopic examination is the gold standard for white blood cell classification, with an accuracy rate of more than 95%. However, manual microscopic examination has the disadvantages of low efficiency and slow classification speed, and the accuracy of manual microscopic examination is affected by the experience and status of the inspector.
[0003] In order to improve the shortcomings of manual microscopic examination, a fully automatic blood cell digital image analysis system has been developed to simulate the process of manual morphological blood cell examination under a microscope, which can achieve full automation from blood smear uploading to report generation, and improve the detection speed. Typically, the workflow of the fully automatic blood cell digital image analysis system is: first browse the blood smear under a 10× or 40× low-power objective to find white blood cells, and then take cell images under a high-power oil objective (such as a 100× objective), identify various types of white blood cells and count them. Among them, the working distance of the high-power oil objective is small. Due to reasons such as light refraction, less light will enter the lens barrel and the field of view will be dark, resulting in unclear sample observation. Therefore, when using a high-power oil objective, cedar oil with a refractive index similar to that of glass should be added to the observed area to increase the light entering the oil objective, increase the brightness of the field of view, and make the image clear.
[0004] At present, sensors are installed in the blood cell digital image analysis system and waiting time is set. When the oil is dripping automatically, the refueling status and refueling amount are prompted by the sensor and waiting time, which reduces the detection speed.
[0005] Therefore, a fast and accurate oil dripping judgment method is urgently needed. Summary of the invention
[0006] To solve the above technical problems, the embodiments of the present invention are intended to provide a method for determining whether oil dripping is successful and a digital microscope, which can quickly and accurately determine whether oil dripping is successful, thereby improving the detection speed.
[0007] The embodiment of the present invention first provides a method for determining whether oil dripping is successful, which is applied to a digital microscope with multiple objective lenses. The method includes:
[0008] Step a), placing a blood smear under a designated objective lens of the digital microscope, and acquiring a first set of cell images at one or more positions of the blood smear under the designated objective lens;
[0009] Step b), dripping immersion oil on the blood smear, and acquiring a second set of cell images at the one or more positions of the blood smear under the designated objective lens;
[0010] Step c), determining an image difference value between the first group of cell images and the second group of cell images;
[0011] Step d), when the image difference value is greater than a predetermined threshold, it is determined that the oil dripping is successful.
[0012] In the above method, the multiple objective lenses may include a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens and include a 100× objective lens, and the designated objective lens may be a 4× objective lens or a 10× objective lens or a 40× objective lens or a 100× objective lens, in particular a 10× objective lens or a 40× objective lens.
[0013] In the above method, the method may further include: when the image difference value is not greater than the predetermined threshold, outputting an oil dripping failure prompt or repeating steps b) to d).
[0014] In the above method, after step b), the method may further include: recording the number of oil drops. In this embodiment, the method may further include: when the image difference value is not greater than the predetermined threshold and the number of oil drops is not greater than the preset number of oil drops, repeating steps b) to e); when the image difference value is not greater than the predetermined threshold and the number of oil drops is greater than the preset number of oil drops, outputting a prompt of oil drop failure.
[0015] In the above method, the one or more positions may include at least three positions, and the image difference values include at least three sets of image difference values between the first set of cell images and the second set of cell images respectively acquired at the at least three positions. In this embodiment, the step d) includes: when the number of image difference values greater than the predetermined threshold value in the at least three sets of image difference values is greater than a predetermined number, it is determined that the oil dripping is successful.
[0016] In the above method, the image difference value between the first group of cell images and the second group of cell images can be determined by calculating the image clarity and / or image gray value standard deviation of the first group of cell images and the second group of cell images.
[0017] In the above method, the step c) may include:
[0018] respectively acquiring a first image clarity of the first group of cell images and a second image clarity of the second group of cell images;
[0019] determining a clarity ratio between the first image clarity and the second image clarity;
[0020] The clarity ratio is determined as an image difference value between the first set of cell images and the second set of cell images.
[0021] In the above method, respectively acquiring the first image clarity of the first group of cell images and the second image clarity of the second group of cell images may include:
[0022] The first image clarity and the second image clarity are obtained by using any one of the image clarity calculation functions including a gradient function, a spectrum function and an entropy function.
[0023] The embodiment of the present invention further provides a digital microscope for analyzing a blood smear, the digital microscope comprising:
[0024] A digital imaging device, comprising a plurality of objective lenses and a digital camera, wherein the digital camera is used to take an image of the blood smear under the objective lenses;
[0025] A position adjustment device, used for adjusting the relative position of the digital imaging device and the blood smear;
[0026] An oil dropping device, used for dropping immersion oil on the blood smear;
[0027] A control device comprises a memory controlled by a processor, wherein the memory stores instructions that enable the processor to perform the following operations: controlling the position adjustment device to place the blood smear under a designated objective lens, and controlling the digital camera to photograph a first group of cell images of the blood smear at one or more positions under the designated objective lens; controlling the oil dripping device to drip immersion oil on the blood smear, and controlling the digital camera to photograph a second group of cell images of the blood smear at the one or more positions under the designated objective lens; acquiring the first group of cell images and the second group of cell images and determining an image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than a predetermined threshold value, the control device determines that the oil dripping is successful.
[0028] In the above digital microscope, the multiple objective lenses may include a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens and include a 100× objective lens, and the designated objective lens may be a 4× objective lens or a 10× objective lens or a 40× objective lens or a 100× objective lens, in particular a 10× objective lens or a 40× objective lens.
[0029] In the above digital microscope, the memory may also store instructions that enable the processor to perform the following operations:
[0030] When the image difference is not greater than the predetermined threshold: outputting a prompt indicating that the oil dripping has failed; and / or controlling the oil dripping device to continue dripping immersion oil on the blood smear; controlling the digital camera to re-shoot a second group of cell images at the one or more positions of the blood smear under the designated objective lens; acquiring the first group of cell images and the second group of cell images and determining an image difference value between the first group of cell images and the second group of cell images; and determining that the oil dripping has succeeded when the image difference value is greater than the predetermined threshold.
[0031] In the above digital microscope, the memory may further store instructions that enable the processor to perform the following operations: after controlling the oil dripping device to drip immersion oil on the blood smear, record the number of oil dripping. In this embodiment, the memory may further store instructions that enable the processor to perform the following operations: when the image difference is not greater than the predetermined threshold and the number of oil dripping is less than or equal to the preset number of oil dripping, control the oil dripping device to continue dripping immersion oil on the blood smear, record the number of oil dripping, control the digital camera to re-shoot the second group of cell images of the blood smear in the one or more positions under the specified objective lens, obtain the first group of cell images and the second group of cell images and determine the image difference value between the first group of cell images and the second group of cell images, and determine that the oil dripping is successful when the image difference value is greater than the predetermined threshold; when the image difference is not greater than the predetermined threshold and the number of oil dripping is greater than the preset number of oil dripping, output a prompt of oil dripping failure.
[0032] In the above digital microscope, the image difference value between the first group of cell images and the second group of cell images can be determined by calculating the image clarity and / or image gray value standard deviation of the first group of cell images and the second group of cell images.
[0033] In the above digital microscope, the memory may further store instructions that enable the processor to perform the following operations: respectively obtain the first image clarity of the first group of cell images and the second image clarity of the second group of cell images; determine the clarity ratio between the first image clarity and the second image clarity; determine the clarity ratio as the image difference value between the first group of cell images and the second group of cell images. Here, the memory may further store instructions that enable the processor to perform the following operations: obtain the first image clarity and the second image clarity using any one of the image clarity calculation functions of the gradient function, the spectrum function and the entropy function.
[0034] The embodiment of the present invention provides a method for judging whether oil dripping is successful and a digital microscope. The method is applied to a digital microscope with multiple objective lenses, and the method includes: placing a blood smear under a designated objective lens of the digital microscope, and obtaining a first group of cell images in one or more positions of the blood smear under the designated objective lens; dripping immersion oil on the blood smear, and obtaining a second group of cell images in one or more positions of the blood smear under the designated objective lens; determining the image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than a predetermined threshold, judging that the oil dripping is successful. That is, the digital microscope obtains the first group of cell images before oil dripping and the second group of cell images after oil dripping at one or more positions, respectively, and judges whether the oil dripping is successful by comparing the image difference value between the first group of cell images and the second group of cell images. There is no need to set a waiting time, and there is no need to add a hardware structure in the digital microscope. It can timely and accurately judge whether the oil dripping is successful, thereby improving the detection speed. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 A process for determining whether oil dripping is successful provided by an embodiment of the present invention Figure 1 ;
[0036] Figure 2 A process for determining whether oil dripping is successful provided by an embodiment of the present invention Figure 2 ;
[0037] FIG3(a) and FIG3(b) are schematic diagrams showing an exemplary comparison of images before and after oil dripping provided by an embodiment of the present invention;
[0038] Figure 4 Flow chart 3 of a method for determining whether oil dripping is successful provided by an embodiment of the present invention;
[0039] Figure 5(a)-Figure 5(j) A schematic diagram of comparing images before and after oil dripping when an exemplary oil dripping is successful provided in an embodiment of the present invention;
[0040] Figure 6(a)-Figure 6(j) A schematic diagram of comparing images before and after oil dripping when an exemplary oil dripping failure is provided in an embodiment of the present invention;
[0041] Figure 7 A schematic structural diagram of a digital microscope provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0042] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. The present invention should not be understood as being limited to the embodiments provided. On the contrary, the contents recorded in the embodiments of the present invention make the present invention comprehensive and complete, and convey the concept of the embodiments of the present invention to those skilled in the art. Therefore, other embodiments obtained by ordinary technicians in this field without creative work are all within the scope of protection of the present invention.
[0043] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.
[0044] The embodiment of the present invention first provides a method for determining whether oil dripping is successful, which is applied to a digital microscope with multiple objective lenses. The multiple objective lenses may include a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens and / or a 100× objective lens. Of course, the multiple objective lenses may also include a 20× objective lens and / or a 60× objective lens. The specific selection is based on actual conditions, and the embodiment of the present invention does not make specific limitations. Figure 1 As shown, the method includes:
[0045] S101, placing a blood smear under a designated objective lens of a digital microscope, and acquiring a first group of cell images in one or more positions of the blood smear under the designated objective lens.
[0046] The method for determining whether oil dripping is successful provided by the embodiment of the present invention is applicable to the scenario of using a digital microscope to classify and count blood cells. The digital microscope can also be called a blood cell digital image analysis system.
[0047] In the embodiment of the present invention, the designated objective lens is selected from one of a plurality of objective lenses, and is specifically selected according to actual conditions, and the embodiment of the present invention does not make any specific limitation.
[0048] Exemplarily, the designated objective lens is preferably a low-power objective lens. In the present invention, the low-power objective lens includes a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens, and the high-power objective lens includes a 100× objective lens (i.e., a high-power oil objective lens). The blood smear in the embodiment of the present invention is a substrate on which a blood specimen is smeared, such as a glass slide after blood is evenly smeared and blood cells therein are stained.
[0049] Specifically, in step S101, for example, a blood smear is first placed under a low-power objective lens of a microscope, and then the microscope coarse and fine focus knobs and the stage are adjusted to find a suitable focus plane and shooting area. Next, the digital microscope adjusts the position of the blood smear for shooting, that is, the blood smear is moved to one or more positions in sequence, and a cell image is obtained at each position under a low-power objective lens using a digital camera to obtain a first set of cell images. The digital camera is a camera that uses an electronic sensor to convert an optical image into electronic data.
[0050] In the embodiment of the present invention, the one or more positions may include at least three positions, and the one or more positions may include the current position of the blood smear under the low-power objective lens. The specific selection is based on actual conditions and is not specifically limited in the embodiment of the present invention.
[0051] Exemplarily, in step S101, five low-magnification microscopic images without immersion oil can be taken at the current position of the blood smear and at positions 3 mm in front, back, left and right of the current position. The five low-magnification microscopic images without immersion oil are the first group of cell images.
[0052] S102, dripping immersion oil on the blood smear, and acquiring a second set of cell images at one or more positions of the blood smear under a designated objective lens.
[0053] After the digital microscope acquires a first set of cell images at one or more positions of the blood smear under the designated objective lens, immersion oil is dripped on the blood smear, and a second set of cell images at the same one or more positions of the blood smear is acquired under the designated objective lens.
[0054] In an embodiment of the present invention, after the digital microscope uses a digital camera to photograph the blood smear and obtains a first set of cell images without oil under a low-power objective lens, the digital microscope drops immersion oil on the blood smear, and moves the blood smear to the same one or more positions in sequence, and obtains an image at each position under a low-power objective lens to obtain a second set of cell images, wherein the immersion oil can be cedar oil having a refractive index similar to that of glass.
[0055] It should be noted that when the digital microscope acquires the first set of cell images under the low-magnification objective lens, the digital microscope also acquires the second set of cell images under the low-magnification objective lens; when the digital microscope acquires the first set of cell images under the high-magnification objective lens, the digital microscope also acquires the second set of cell images under the high-magnification objective lens.
[0056] S103, determining an image difference value between the first group of cell images and the second group of cell images.
[0057] After the digital microscope acquires a second set of cell images in one or more locations of the blood smear under the designated objective lens, the digital microscope determines image difference values between the first set of cell images and the second set of cell images.
[0058] In the embodiment of the present invention, the digital microscope can determine the image difference value between the first group of cell images and the second group of cell images by calculating the image clarity and / or image gray value standard deviation of the first group of cell images and the second group of cell images.
[0059] Those skilled in the art should understand that image clarity represents the clarity of image boundaries and details. Image clarity is an important indicator for measuring image quality, and it can correspond well to people's subjective feelings. Image clarity algorithms include gradient functions, spectrum functions, and entropy functions, etc. The specific ones are selected according to actual conditions and are not specifically limited in the embodiments of the present invention.
[0060] Exemplarily, the gradient function is a Brenner gradient function, wherein the Brenner gradient function calculates the square of the grayscale difference between two adjacent pixels.
[0061] Those skilled in the art should understand that the standard deviation of image grayscale values refers to the degree of dispersion of image pixel grayscale values relative to the mean. The larger the standard deviation of image grayscale values, the more dispersed the grayscale levels in the image are, and the better the image quality is. In the embodiment of the present invention, when the oil dripping is successful, the standard deviation of the image grayscale values of the first group of cell images should be greater than the standard deviation of the image grayscale values of the second group of cell images.
[0062] Specifically, the process of determining the image difference value between the first group of cell images and the second group of cell images by calculating the image clarity can be: respectively obtaining the first image clarity of the first group of cell images and the second image clarity of the second group of cell images; determining the clarity ratio between the first image clarity and the second image clarity; and determining the clarity ratio as the image difference value between the first group of cell images and the second group of cell images. Among them, the digital microscope can use any image clarity calculation function among the gradient function, the spectrum function and the entropy function to obtain the first image clarity and the second image clarity. The specific method of obtaining the first image clarity and the second image clarity is selected according to the actual situation, and the embodiment of the present invention does not make any specific limitation.
[0063] Of course, in the embodiment of the present invention, the digital microscope can also determine the image difference value between the first group of cell images and the second group of cell images by calculating other characteristic values of the first group of cell images and the second group of cell images, such as the average value of the image grayscale value, and the embodiment of the present invention does not make specific limitations.
[0064] S104: When the image difference value is greater than a predetermined threshold, it is determined that the oil dripping is successful.
[0065] After the digital microscope determines the image difference value between the first group of cell images and the second group of cell images, the digital microscope compares the image difference value with a predetermined threshold value. When the digital microscope determines that the image difference value is greater than the predetermined threshold value, the digital microscope determines that the oil dripping is successful.
[0066] In the embodiment of the present invention, the digital microscope pre-sets a predetermined threshold value, and the digital microscope compares the image difference value with the predetermined threshold value. When the digital microscope determines that the image difference value is greater than the predetermined threshold value, it determines that the oil dripping is successful; when the digital microscope determines that the image difference value is not greater than the predetermined threshold value, it determines that the oil dripping fails. At this time, the digital microscope prompts that the oil dripping fails, and / or continues the oil dripping operation and retakes the second group of cell images, that is, repeats steps S102 to S104. Figure 2 shown.
[0067] As shown in FIG3 , before dripping immersion oil, the cells in the cell image are clear and rich in image content, as shown in FIG3 (a), and after dripping immersion oil, the focus plane changes, and the cells in the cell image become blurred or even completely invisible, as shown in FIG3 (b). Therefore, the present invention can judge whether the dripping of oil is successful by comparing the images before and after dripping immersion oil on the blood smear obtained under a specified objective lens of a digital microscope, such as a low-power objective lens.
[0068] In the embodiment of the present invention, when the digital microscope determines that the oil dripping is successful, the digital microscope switches the objective lens to a high-power objective lens (e.g., a 100× objective lens), and uses a digital camera to take a high-power image of the blood smear, and the digital microscope identifies various types of blood cell particles from the high-power image and counts them. For example, the digital microscope browses the blood smear under a 10× objective lens or a 40× objective lens to find nucleated cells, and after the oil dripping is successful, it takes an image under an oil objective lens (100×), identifies various types of white blood cells, and classifies and counts them.
[0069] It can be understood that the digital microscope obtains a first group of cell images before oil dropping and a second group of cell images after oil dropping at one or more positions respectively, and judges whether the oil dropping is successful by comparing the image difference values between the first group of cell images and the second group of cell images. There is no need to set a waiting time or add a new hardware structure in the digital microscope. It can judge whether the oil dropping is successful in time, thereby improving the detection speed.
[0070] exist Figure 1 In an advantageous variation of the embodiment shown, a method for determining whether oil dripping is successful provided by an embodiment of the present invention may further include recording the number of oil dripping times and determining the number of oil dripping times. Figure 4 As shown, it may include:
[0071] S201, placing a blood smear under a designated objective lens of a digital microscope, and acquiring a first group of cell images in one or more positions of the blood smear under the designated objective lens.
[0072] Here, S201 of the embodiment of the present invention is Figure 1 S101 of the illustrated embodiment is the same and will not be described again here.
[0073] S202, dripping immersion oil on the blood smear, and acquiring a second set of cell images at one or more positions of the blood smear under a designated objective lens.
[0074] Here, S202 of the embodiment of the present invention is Figure 1 S102 of the illustrated embodiment is the same and will not be described again here.
[0075] S205, recording the number of oil dripping times.
[0076] In the embodiment of the present invention, the digital microscope records the number of oil drops after each drop of the immersion oil, and when it is determined that the oil drops are successful or unsuccessful, the digital microscope clears the number of oil drops recorded by itself.
[0077] S203 , determining an image difference value between the first group of cell images and the second group of cell images.
[0078] After the digital microscope acquires a second set of cell images in one or more locations of the blood smear, the digital microscope determines an image difference value between the first set of cell images and the second set of cell images.
[0079] Here, the description of S203 in the embodiment of the present invention is consistent with the description of S103 in the first embodiment, and will not be repeated here.
[0080] S204: When the image difference value is greater than a predetermined threshold, the digital microscope determines that the oil dripping is successful.
[0081] After the digital microscope determines the image difference value between the first group of cell images and the second group of cell images, the digital microscope compares the image difference value with a predetermined threshold value. When the image difference value is greater than the predetermined threshold value, the digital microscope determines that the oil dripping is successful.
[0082] In the embodiment of the present invention, a predetermined threshold is pre-set for the digital microscope, and the digital microscope compares the image difference value with the predetermined threshold. When the digital microscope determines that the image difference value is greater than the predetermined threshold, the digital microscope determines that the oil dripping is successful. At this time, the digital microscope places the blood smear under a high-power objective lens, and uses a digital camera to take a high-power image of the blood smear. The digital microscope identifies various types of blood cell particles from the high-power image and counts them.
[0083] It should be noted that S203, S204 and S205 are three parallel steps after S202, and the specific execution order is selected according to the actual situation, and the embodiment of the present invention does not make any specific limitation.
[0084] S206. When the image difference value is not greater than the predetermined threshold value and the number of oil drops is not greater than the preset number of oil drops, re-execute steps S202 to S205.
[0085] After the digital microscope determines the image difference value between the first group of cell images and the second group of cell images, when the digital microscope determines that the image difference value is not greater than a predetermined threshold value, the digital microscope also needs to determine whether the number of oil drops is greater than a preset number of oil drops. When the digital microscope determines that the number of oil drops is less than or equal to the preset number of oil drops, that is, the number of oil drops has not reached the upper limit of the oil drops, the digital microscope continues to drop the microscope oil and performs a subsequent determination operation on whether the oil drops are successful.
[0086] S207: When the image difference value is not greater than a predetermined threshold and the number of oil drops is greater than a preset number of oil drops, output an oil drop failure prompt.
[0087] After the digital microscope determines the image difference value between the first group of cell images and the second group of cell images, when the digital microscope determines that the image difference value is not greater than a predetermined threshold and the number of oil drops is greater than a preset number of oil drops, that is, the number of oil drops has reached the oil drop upper limit, the digital microscope prompts that the oil drop has failed.
[0088] By recording the number of oil drops and setting an upper limit on the number of oil drops, both efficiency and accuracy can be taken into account.
[0089] In a preferred embodiment of the above method, the one or more positions may include at least three positions, and the image difference values include at least three sets of image difference values between the first set of cell images and the second set of cell images respectively acquired at the at least three positions. At this time, the manner of judging whether the oil dripping is successful is: when the number of image difference values greater than a predetermined threshold value among the at least three sets of image difference values is greater than a predetermined number, the oil dripping is judged to be successful.
[0090] In an embodiment of the present invention, after the digital microscope obtains at least three sets of image difference values between the first set of cell images and the second set of cell images at at least three positions respectively, the digital microscope compares the at least three sets of image difference values with a predetermined threshold value respectively. When the number of image difference values greater than the predetermined threshold value among the at least three sets of image difference values is greater than a predetermined number, the digital microscope determines that the oil dripping is successful; when the number of image difference values greater than the predetermined threshold value among the at least three sets of image difference values is not greater than a predetermined number, it is determined that the oil dripping has failed. At this time, the digital microscope prompts that the oil dripping has failed and continues the oil dripping operation.
[0091] Exemplarily, as shown in Table 1, the digital microscope acquires images of the blood smear at five positions, namely position 1, position 2, position 3, position 4 and position 5, respectively. The digital microscope calculates the clarity of five groups of images before and after the oil drop, and calculates five groups of clarity ratios of the five groups of images before and after the oil drop. After that, the digital microscope compares the five groups of clarity ratios with a preset threshold in turn. The preset threshold here is set to 10. If at least four of the five groups of clarity ratios are greater than 10, it is judged that the oil drop is successful. The image clarity ratios of the blood smear at five positions before and after the oil drop in Table 1 are 55.4, 65.1, 39.7, 45.6 and 47.9, respectively, all exceeding 10, indicating that the oil drop is successful. Figure 5(a)-Figure 5(h) The cell images at five positions before and after the oil drop corresponding to Table 1 are shown respectively, wherein Fig. 5(a) is the image of the blood smear before the oil drop at position 1, Fig. 5(b) is the image of the blood smear after the oil drop at position 1, Fig. 5(c) is the image of the blood smear before the oil drop at position 2, Fig. 5(d) is the image of the blood smear after the oil drop at position 2, Fig. 5(e) is the image of the blood smear before the oil drop at position 3, Fig. 5(f) is the image of the blood smear after the oil drop at position 3, Fig. 5(g) is the image of the blood smear before the oil drop at position 4, Fig. 5(h) is the image of the blood smear after the oil drop at position 4, Fig. 5(i) is the image of the blood smear before the oil drop at position 5, and Fig. 5(j) is the image of the blood smear after the oil drop at position 5.
[0092] Table 1 The clarity ratio of the blood smear at five positions before and after the successful oil drop
[0093]
[0094] For example, as shown in Table 2, in another embodiment, the image clarity ratios of the blood smear at five positions before and after oil dripping are 36.9, 13.8, 1.0, 3.1, and 1.0, respectively. Among the five groups of clarity ratios, only the two groups of image clarity ratios at positions 1 and 2 are greater than the threshold value 10, so it is determined that the oil dripping fails. FIG6 shows the cell images at five positions before and after oil dripping corresponding to Table 2, wherein FIG6(a) is the image of the blood smear at position 1 before oil dripping, FIG6(b) is the image of the blood smear at position 1 after oil dripping, and FIG6(c) is the image of the blood smear at position 2 after oil dripping. Fig. 6(d) is the image of the blood smear before dropping oil at position 2, Fig. 6(e) is the image of the blood smear before dropping oil at position 3, Fig. 6(f) is the image of the blood smear after dropping oil at position 3, Fig. 6(g) is the image of the blood smear before dropping oil at position 4, Fig. 6(h) is the image of the blood smear after dropping oil at position 4, Fig. 6(i) is the image of the blood smear before dropping oil at position 5, and Fig. 6(j) is the image of the blood smear after dropping oil at position 5. It can be seen from Fig. 6 that the image clarity before and after dropping oil at positions 3, 4 and 5 is similar.
[0095] Table 2 Ratio of clarity of five positions before and after oil dripping on blood smears with failed oil dripping
[0096]
[0097] The embodiment of the present invention also provides a digital microscope 1 for analyzing blood smears, such as Figure 7 As shown, the digital microscope 1 comprises:
[0098] A digital imaging device 10, comprising a plurality of objective lenses 100 and a digital camera 101, wherein the digital camera 101 is used to take an image of the blood smear under the objective lenses 100;
[0099] A position adjustment device 11, used for adjusting the relative position between the digital imaging device 10 and the blood smear;
[0100] An oil dropping device 12, used for dropping immersion oil on the blood smear;
[0101] The control device 13 includes a memory 130 controlled by a processor 131, wherein the memory 130 stores instructions that enable the processor 131 to perform the following operations: controlling the position adjustment device to place the blood smear under the designated objective lens 100, and controlling the digital camera 101 to photograph a first group of cell images of the blood smear in one or more positions under the designated objective lens 100; controlling the oil dripping device 12 to drip immersion oil on the blood smear, and controlling the digital camera 101 to photograph a second group of cell images of the blood smear in the one or more positions under the designated objective lens 100; acquiring the first group of cell images and the second group of cell images and determining an image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than a predetermined threshold value, the control device 13 determines that the oil dripping is successful.
[0102] Further, the plurality of objective lenses 100 may include a low-power objective lens 1001 and a high-power objective lens 1002, and the designated objective lens is a low-power objective lens.
[0103] Preferably, the designated objective lens may be a 4× objective lens, a 10× objective lens, a 40× objective lens, or a 100× objective lens.
[0104] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operations: output a prompt indicating that the oil dripping has failed; and / or control the oil dripping device to continue dripping immersion oil on the blood smear; control the digital camera to re-shoot the second group of cell images of the blood smear at the one or more positions under the designated objective lens; acquire the first group of cell images and the second group of cell images and determine the image difference value between the first group of cell images and the second group of cell images; and determine that the oil dripping is successful when the image difference value is greater than the predetermined threshold.
[0105] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operation: recording the number of oil drops after controlling the oil drop device to drop immersion oil on the blood smear.
[0106] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operations: when the image difference is not greater than the predetermined threshold and the number of oil drops is less than or equal to the preset number of oil drops, control the oil drop device to continue to drop immersion oil on the blood smear; record the number of oil drops; control the digital camera to re-shoot the second group of cell images of the blood smear at the one or more positions under the designated objective lens; acquire the first group of cell images and the second group of cell images and determine the image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than the predetermined threshold, determine that the oil drop is successful.
[0107] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operations: when the image difference is not greater than the predetermined threshold and the number of oil dripping times is greater than the preset number of oil dripping times, outputting a prompt of oil dripping failure.
[0108] Furthermore, the image difference value between the first group of cell images and the second group of cell images can be determined by calculating the image clarity and / or the image gray value standard deviation.
[0109] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operations: respectively obtain the first image clarity of the first group of cell images and the second image clarity of the second group of cell images; determine the clarity ratio between the first image clarity and the second image clarity; and determine the clarity ratio as the image difference value between the first group of cell images and the second group of cell images.
[0110] Furthermore, the memory 130 may also store instructions that enable the processor 131 to perform the following operation: using any one of the image clarity calculation functions including a gradient function, a spectrum function, and an entropy function to obtain the first image clarity and the second image clarity.
[0111] In practical applications, the processor 131 may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to implement the function of the processor 131 may also be other, and the embodiment of the present invention does not specifically limit it. The memory 130 is used to store executable program code, which includes computer operation instructions. The memory 130 may include a high-speed RAM memory, and may also include a non-volatile memory, for example, at least one disk memory.
[0112] In practical applications, the memory 130 may be a volatile memory, such as a random access memory (RAM); or a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk (HDD) or a solid-state drive (SSD); or a combination of the above types of memories, and provide instructions and data to the processor 131.
[0113] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.
[0114] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
[0115] The embodiment of the present invention provides a storage medium on which a computer program is stored, which is applied to the digital microscope 1. When the computer program is executed by the processor 130, the following steps are implemented:
[0116] Acquire a first group of cell images at one or more positions of the blood smear under a designated objective lens before adding immersion oil;
[0117] Acquire a second set of cell images at the one or more positions of the blood smear under the designated objective lens after dripping immersion oil;
[0118] determining an image difference value between the first group of cell images and the second group of cell images;
[0119] When the image difference value is greater than a predetermined threshold, it is determined that the oil dripping is successful.
[0120] It should be understood that the features, structures and advantages mentioned in the specification, claims and drawings can be arbitrarily combined with each other as long as they are meaningful within the scope of the present invention. The features, structures and advantages described for the method of the present invention are applicable to the digital microscope of the present invention in a corresponding manner, and vice versa. It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The serial numbers of the above-mentioned invention embodiments are for description only and do not represent the advantages and disadvantages of the embodiments.
[0121] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, servers, or computer program products. Therefore, the present invention may take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.
[0122] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (servers), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0123] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0124] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1The steps for the functions specified in one or more boxes.
[0125] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention.
Claims
1. A method for judging whether oil dripping is successful. It is characterized in that Applied to a digital microscope having multiple objective lenses, the method comprises: Step a), placing a blood smear under a designated objective lens of the digital microscope, and acquiring a first set of cell images at one or more positions of the blood smear under the designated objective lens; Step b), dripping immersion oil on the blood smear, and acquiring a second set of cell images at the one or more positions of the blood smear under the designated objective lens; Step c), determining an image difference value between the first group of cell images and the second group of cell images; Step d), when the image difference value is greater than a predetermined threshold, it is determined that the oil dripping is successful; Wherein, the image difference value between the first group of cell images and the second group of cell images is determined by at least one of the following methods: 1) calculating the image clarity of the first group of cell images and the second group of cell images, 2) calculating the standard deviation of the image grayscale values of the first group of cell images and the second group of cell images, 3) calculating the average value of the image grayscale values of the first group of cell images and the second group of cell images.
2. The method according to claim 1, It is characterized in that The plurality of objective lenses include a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens, and include a 100× objective lens.
3. The method according to claim 1 or 2, It is characterized in that The designated objective lens is a 4× objective lens, a 10× objective lens, a 40× objective lens, or a 100× objective lens.
4. The method according to claim 1, It is characterized in that The method further comprises: When the image difference value is not greater than the predetermined threshold, an oil dripping failure prompt is output and / or steps b) to d) are repeated.
5. The method according to claim 1, It is characterized in that After step b), the method further comprises: e), record the number of oil drops.
6. The method according to claim 5, It is characterized in that The method further comprises: When the image difference value is not greater than the predetermined threshold value and the number of oil drops is not greater than the preset number of oil drops, repeating steps b) to e); When the image difference value is not greater than the predetermined threshold and the number of oil drops is greater than the preset number of oil drops, a prompt indicating that the oil drops have failed is output.
7. The method according to claim 1, It is characterized in that The one or more positions include at least three positions, and the image difference values include at least three sets of image difference values between the first set of cell images and the second set of cell images respectively acquired at the at least three positions.
8. The method according to claim 7, It is characterized in that The step d) comprises: When the number of the image difference values greater than the predetermined threshold in the at least three groups of image difference values is greater than a predetermined number, it is determined that the oil dripping is successful.
9. The method according to claim 1, It is characterized in that In the case where the image difference value between the first group of cell images and the second group of cell images is determined by calculating the image clarity of the first group of cell images and the second group of cell images, the step c) comprises: respectively acquiring a first image clarity of the first group of cell images and a second image clarity of the second group of cell images; determining a clarity ratio between the first image clarity and the second image clarity; The clarity ratio is determined as an image difference value between the first set of cell images and the second set of cell images.
10. The method according to claim 9, It is characterized in that The step of respectively acquiring the first image clarity of the first group of cell images and the second image clarity of the second group of cell images comprises: The first image clarity and the second image clarity are obtained by using any one of the image clarity calculation functions including a gradient function, a spectrum function and an entropy function.
11. A digital microscope for analyzing blood smears. It is characterized in that The digital microscope comprises: A digital imaging device, comprising a plurality of objective lenses and a digital camera, wherein the digital camera is used to take an image of the blood smear under the objective lenses; A position adjustment device, used for adjusting the relative position of the digital imaging device and the blood smear; An oil dropping device, used for dropping immersion oil on the blood smear; The control device comprises a memory controlled by a processor, wherein the memory stores instructions that enable the processor to perform the following operations: controlling the position adjustment device to place the blood smear under a designated objective lens, and controlling the digital camera to photograph a first group of cell images of the blood smear at one or more positions under the designated objective lens; controlling the oil dripping device to drip immersion oil on the blood smear, and controlling the digital camera to photograph a second group of cell images of the blood smear at the one or more positions under the designated objective lens; acquiring the first group of cell images and the second group of cell images and determining an image difference value between the first group of cell images and the second group of cell images; and determining that the oil dripping is successful when the image difference value is greater than a predetermined threshold value; Wherein, the image difference value between the first group of cell images and the second group of cell images is determined by at least one of the following methods: 1) calculating the image clarity of the first group of cell images and the second group of cell images, 2) calculating the standard deviation of the image grayscale values of the first group of cell images and the second group of cell images, 3) calculating the average value of the image grayscale values of the first group of cell images and the second group of cell images.
12. The digital microscope according to claim 11, It is characterized in that The plurality of objective lenses include a 4× objective lens and / or a 10× objective lens and / or a 40× objective lens, and include a 100× objective lens.
13. The digital microscope according to claim 11 or 12, It is characterized in that The designated objective lens is a 4× objective lens, a 10× objective lens, a 40× objective lens, or a 100× objective lens.
14. The digital microscope according to claim 11, It is characterized in that The memory also stores instructions that enable the processor to perform the following operations: When the image difference is not greater than the predetermined threshold, Outputting a prompt indicating that oil dripping has failed; and / or Control the oil dripping device to continue dripping immersion oil on the blood smear; control the digital camera to re-photograph the second group of cell images in the one or more positions of the blood smear under the designated objective lens; acquire the first group of cell images and the second group of cell images and determine the image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than the predetermined threshold value, determine that the oil dripping is successful.
15. The digital microscope according to claim 11, It is characterized in that The memory also stores instructions that enable the processor to perform the following operations: The number of oil drops is recorded after the oil drop device is controlled to drop immersion oil on the blood smear.
16. The digital microscope according to claim 15, It is characterized in that The memory also stores instructions that enable the processor to perform the following operations: When the image difference is not greater than the predetermined threshold and the number of oil drops is not greater than the preset number of oil drops, controlling the oil drop device to continue dropping immersion oil on the blood smear; recording the number of oil drops; controlling the digital camera to re-shoot the second group of cell images in the one or more positions of the blood smear under the designated objective lens; acquiring the first group of cell images and the second group of cell images and determining the image difference value between the first group of cell images and the second group of cell images; when the image difference value is greater than the predetermined threshold, determining that the oil drop is successful; When the image difference is not greater than the predetermined threshold and the number of oil drops is greater than the preset number of oil drops, a prompt indicating that the oil drops have failed is output.
17. The digital microscope according to claim 11, It is characterized in that In the case where the image difference value between the first group of cell images and the second group of cell images is determined by calculating the image clarity of the first group of cell images and the second group of cell images, the memory further stores instructions that enable the processor to perform the following operations: respectively acquiring a first image clarity of the first group of cell images and a second image clarity of the second group of cell images; determining a clarity ratio between the first image clarity and the second image clarity; The clarity ratio is determined as an image difference value between the first set of cell images and the second set of cell images.
18. The digital microscope according to claim 17, It is characterized in that The memory also stores instructions that enable the processor to perform the following operations: The first image clarity and the second image clarity are obtained by using any one of the image clarity calculation functions including a gradient function, a spectrum function and an entropy function.
Citation Information
Patent Citations
Blood sample detection device, blood sample detection method and blood sample detection system
CN105136795A
Autofocus systems and methods for particle analysis in blood samples
CN105143850A