Biological specimen measuring device and calibrating method

The biological sample measuring device addresses miniaturization and measurement inaccuracies by using an area camera and calibration techniques to correct for distortion and misalignment, ensuring precise liquid volume measurement in samples with multiple components.

JP2024165391APending Publication Date: 2024-11-28HITACHI HIGH TECH CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023081552
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing biological sample measuring devices face challenges in miniaturization due to vertical scanning mechanisms and are prone to measurement inaccuracies from device misalignment and lens aberration, especially when measuring samples with multiple component regions.

Method used

A biological sample measuring device that uses an area camera to capture transmitted images, calculates distortion and liquid height conversion coefficients from a calibrated pattern, and corrects image distortion to enhance measurement accuracy.

Benefits of technology

The device achieves accurate liquid height measurement by correcting for device misalignment and lens aberration, thereby improving the precision of liquid volume determination in biological samples.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165391000001_ABST
    Figure 2024165391000001_ABST
Patent Text Reader

Abstract

To prevent a decline in liquid height measurement accuracy caused by measuring device misalignment and lens aberration when measuring biological specimens with one or more component areas.SOLUTION: A biological specimen measuring device acquires a distortion coefficient and a liquid height conversion coefficient from a picked-up image of a calibrator with a pattern shape on its surface, and corrects liquid height of a specimen accordingly.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an apparatus for measuring a biological sample separated into multiple component regions. [Background technology]

[0002] To improve the efficiency of clinical testing such as blood tests, there is a demand for technology to automate the task of checking the liquid volume of biological samples before analysis (before dispensing), which was previously performed by visual inspection. The target samples are separated into multiple layers by centrifugation or other methods, and technology is required to measure only the liquid volume of the sample to be analyzed, such as serum or plasma. In addition, when the sample is a blood sample, the blood collection tube that contains the sample has a barcode label for patient identification affixed to it, and technology is required to enable measurement with the label affixed. Furthermore, there is a demand for the option of equipping sample measurement devices to sample transport devices that have already been introduced, and so the devices must be made smaller.

[0003] As an example of such a biological sample measurement device, Patent Document 1 discloses a technology in which a sample separated into multiple layers is irradiated with two wavelengths of pulsed light by switching between them in a time-division manner, and the sample is scanned vertically while measuring the transmitted light, thereby detecting the height of a specific area of ​​the sample separated into multiple layers.

[0004] Patent Document 2 discloses a technology for generating an image of a biological sample using a light source with two wavelength components emitted by a light source and an area camera, and for selecting an image that most clearly identifies the part of the biological sample to be measured by comparing the images generated using two or more exposure times or gains during imaging. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] US2012 / 0013889 [Patent Document 2] JP 2022-178784 A Summary of the Invention [Problem to be solved by the invention]

[0006] The technology disclosed in Patent Document 1 relates to a liquid volume measurement technology that measures the liquid volume of a biological sample composed of multiple components by accurately identifying the boundary of a measurement target area from signals of transmitted light of two wavelengths with different absorptivities for the measurement target. However, in Patent Document 1, it is necessary to perform measurement while vertically scanning the specimen (blood collection tube) in the longitudinal direction, and it is difficult to miniaturize the device due to the scanning mechanism.

[0007] The technology disclosed in Patent Document 2 relates to a liquid volume measurement technology that can realize miniaturization of the device by acquiring a near-infrared light transmission image using an area camera, eliminating the need for sample rotation or vertical scanning mechanisms even for labeled biological samples. This technology detects the area to be measured from the transmission image, obtains the liquid height, and calculates the liquid volume, but a conversion coefficient is required to convert the number of pixels in the measurement area to length. Since the conversion coefficient is determined according to the distance from the biological sample to the area camera, it is a challenge to avoid the influence of misalignment of the device due to installation, etc. In addition, since the image captured using the area camera is distorted due to lens aberration, it is necessary to correct the distortion of the captured image in order to detect the liquid height with high accuracy.

[0008] The present disclosure has been made in consideration of the above-mentioned problems, and aims to avoid a decrease in liquid height measurement accuracy due to misalignment of the measurement device and lens aberration when measuring a biological sample having one or more component regions. [Means for solving the problem]

[0009] The biological sample measuring device according to the present disclosure obtains a distortion coefficient and a liquid height conversion coefficient from a captured image of a calibrator having a pattern shape on its surface, and corrects the liquid height of the sample based on these. Effect of the Invention

[0010] According to the biological sample measurement device of the present disclosure, when measuring a biological sample having one or more component regions, it is possible to avoid a decrease in liquid height measurement accuracy due to device misalignment and lens aberration, thereby improving analysis accuracy. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing the configuration of a biological sample measuring device 101 pertaining to embodiment 1. [Figure 2A] FIG. 2 is a diagram illustrating the principle of identifying a measurement target region. [Figure 2B] FIG. 2 is a diagram illustrating the principle of identifying a measurement target region. [Figure 3A] 3 is an example of a calibrator 301. [Figure 3B] 3 is an example of a calibrator 301. [Figure 4A] FIG. 3 shows an example of a pattern 302. [Figure 4B] FIG. 3 shows an example of a pattern 302. [Diagram 5] 1 is a diagram for explaining a method of capturing an image of a calibrator 301. FIG. [Figure 6A] 6 is an explanatory diagram of a calibrator image 601 obtained by capturing an image of the calibrator 301 having a constant light and dark stripe spacing using the configuration of FIG. 5. FIG. [Figure 6B] FIG. 6B is a diagram showing the distribution of the number of pixels [pixels] between fringes when lens distortion aberration is present, for the analysis range 602 in FIG. 6A. [Figure 7] 6C is a diagram for explaining a liquid height conversion coefficient [mm / pixel] obtained by dividing the actual stripe interval length [mm] of FIG. 6B by the stripe period [pixel]. [Figure 8] 13 is a flowchart showing a process in which the distortion coefficient calculation unit 109 acquires distortion coefficients. [Figure 9] 13 is a flowchart illustrating a method for determining a liquid height conversion coefficient after performing distortion correction on a calibrator image 601. [Figure 10]9 is a flowchart for explaining a method for acquiring a liquid height conversion coefficient as a distribution (function) with the vertical coordinate as a variable, based on the distortion coefficient and distortion function acquired in FIG. 8. [Figure 11] 10 is a flowchart illustrating a liquid volume measurement method using a constant liquid height conversion coefficient obtained in FIG. 9. [Figure 12] 11 is a flowchart illustrating a liquid volume measurement method using the distribution of liquid height conversion coefficients acquired in the process of FIG. 10. [Figure 13] FIG. 11 is a diagram showing the configuration of a biological sample measuring device 101 pertaining to embodiment 2. [Figure 14] 13 is a flowchart illustrating a method for adjusting the imaging position of the biological sample 102 based on the value of the liquid height conversion coefficient. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Embodiment 1> The biological sample to be measured in the embodiment of the present disclosure is assumed to be a labeled specimen before opening (before analysis) and separated into multiple component layers (typically 1 to 3 layers) by the presence or absence of centrifugation. The measurement target is a portion of the specimen separated into multiple layers, such as plasma or serum, that is to be analyzed (dispensed) by a biochemical analyzer or the like.

[0013] FIG. 1 is a configuration diagram of a biological sample measuring device 101 according to embodiment 1 of the present disclosure. Biological sample measuring device 101 is an apparatus that measures a biological sample 102. Biological sample 102 is a sample made up of multiple layers as described above. Biological sample measuring device 101 identifies a measurement target region 103 of biological sample 102 and measures its liquid volume. Biological sample measuring device 101 comprises a surface illumination light source 104, an area camera 105, a time-division control driver 106, a calibration data acquisition section 107, and a liquid volume measurement section 108.

[0014] The surface illumination light source 104 is configured to be able to switch the wavelength of light emitted between two wavelengths, and illuminates the biological sample 102 with the light. The light emitted by the surface illumination light source 104 can simultaneously illuminate two or more component layers constituting the biological sample 102 (i.e., across two or more component layers). In addition, regardless of the component layer, the upper surface of the uppermost layer (the boundary between the sample and the air layer) can be irradiated. Switching the wavelength of light does not necessarily require emitting light having only a single wavelength, but only requires switching the wavelength component with the strongest intensity (wavelength λ1 = 970 ± 100 nm, wavelength λ2 = 1550 ± 100 nm, etc.). In the biological sample 102 with one or three component layers, if the number of component layers is known before measurement, it is sufficient to use one of the two wavelengths, and there is no need to switch the wavelength. The reason and the method of selecting the wavelength will be explained in the measurement principle described later.

[0015] The area camera 105 captures the surface illumination light transmitted through the biological sample 102 to generate a two-dimensional captured image of the biological sample 102. The area camera 105 has a sensitivity characteristic that allows it to detect light in a wavelength band emitted by the surface illumination light source 104. The area camera 105 can be configured, for example, by an InGaAs camera. The area camera 105 also captures a calibrator image. The calibrator will be described in detail later.

[0016] The time-division control driver 106 switches the wavelength of light emitted by the surface illumination light source 104 in a time-division manner. In synchronization with the wavelength switching, the time-division control driver 106 adjusts the exposure time (or gain) of the area camera 105 to a time suitable for that wavelength. The imaging timing of the area camera 105 is controlled by the time-division control driver 106 in synchronization with the wavelength emitted by the surface illumination light source 104. The time-division control driver 106 may receive a processing result from the liquid volume measurement unit 108 and control re-imaging according to the result.

[0017] The calibration data acquisition unit 107 analyzes the calibrator image acquired by the area camera 105. The calibration data acquisition unit 107 includes a distortion coefficient calculation unit 109, a liquid height conversion coefficient calculation unit 110, and a calibration data storage unit 111. The distortion coefficient calculation unit 109 calculates a distortion coefficient that represents image distortion caused by the influence of lens aberration. The liquid height conversion coefficient calculation unit 110 calculates a conversion coefficient that converts the number of pixels in the liquid height region of the image of the biological sample 102 acquired by the area camera 105 into a liquid height [mm]. The calculation method of the distortion coefficient and the liquid height conversion coefficient will be described later. The calibration data storage unit 111 stores the distortion coefficient acquired by the distortion coefficient calculation unit 109 and the liquid height conversion coefficient acquired by the liquid height conversion coefficient calculation unit 110.

[0018] The liquid volume measuring unit 108 extracts the measurement target area 103 from the captured image acquired by the area camera 105, and acquires the number of liquid height pixels [pixels] in the vertical direction corresponding to the liquid height in the captured image. The liquid volume measuring unit 108 accesses the calibration data storage unit 111 to acquire the stored distortion coefficient and liquid height conversion coefficient, and uses these to convert the number of liquid height pixels [pixels] acquired from the captured image to a liquid height [mm], and further calculates the liquid volume using information on the container diameter of the biological sample 102. Details of the processing contents executed by the liquid volume measuring unit 108 will be described later.

[0019] <Embodiment 1: Principle of liquid volume measurement> 2A and 2B are diagrams for explaining the principle of identifying a measurement target region. In the configuration of Fig. 1, the area camera 105 captures a two-dimensional transmission image of the biological sample 102 as shown in Fig. 2A and Fig. 2B.

[0020] Fig. 2A shows an example where the biological sample 102 is separated into three layers. Fig. 2B shows an example where the biological sample 102 is separated into two layers. The blood clot 202 is formed in the lower layer when the biological sample 102 is centrifuged. The separation material 201 is mixed in order to separate the blood clot 202 from the measurement target region 103.

[0021] Comparing the first wavelength (wavelength 1) and the second wavelength (wavelength 2) emitted by the surface illumination light source 104, the transmittance when wavelength 1 passes through the blood clot 202 is almost the same as the transmittance when wavelength 2 passes through the blood clot 202. Therefore, there is only a slight difference between the captured image of the blood clot 202 acquired using wavelength 1 and the captured image of the blood clot 202 acquired using wavelength 2. Similarly, for the separation material 201, the transmittance of wavelength 1 and the transmittance of wavelength 2 are almost the same, so there is only a slight difference between the two images.

[0022] In contrast, the transmittance when wavelength 1 passes through measurement target area 103 is significantly different from the transmittance when wavelength 2 passes through measurement target area 103. Therefore, the difference between the captured image of measurement target area 103 acquired using wavelength 1 and the captured image of measurement target area 103 acquired using wavelength 2 is significant. By identifying this difference, measurement target area 103 can be extracted from the captured image.

[0023] The wavelength bands adopted as wavelength 1 and wavelength 2 must be selected in advance so that a significant difference occurs between the wavelengths in the measurement target area 103, but there is almost no difference in other areas, as illustrated in Figures 2A and 2B. As long as this condition is satisfied, the specific wavelength values ​​may be arbitrary. That is, it is sufficient that at least the difference between the transmittance when wavelength 1 passes through the measurement target area 103 and the transmittance when wavelength 2 passes through the measurement target area 103 is greater than the difference between the transmittance when wavelength 1 passes through areas other than the measurement target area 103 and the transmittance when wavelength 2 passes through areas other than the measurement target area 103.

[0024] By using the above measurement principle, when the biological sample 102 is separated into a plurality of component layers, the measurement target region 103 can be identified. The liquid volume measurement unit 108 identifies the measurement target region 103 according to this principle. The number of component layers is not important, but typical biological samples such as plasma and serum are separated into one to three layers. In either case, the measurement target region 103 can be identified with high accuracy.

[0025] For biological samples 102 with one component layer and biological samples 102 with three component layers, if the number of component layers is known before measurement, it is possible to measure using a transmission image of only one wavelength. In the case of three layers as shown in Figure 2A, a wavelength at which there is a difference in absorptance between the separation material 201 or air layers located above and below the measurement target area 103 and the measurement target area 103 may be selected. In the case of a single layer, a wavelength at which there is a difference in absorptance between the air layer above the measurement target area 103 and the measurement target area 103 may be selected.

[0026] The liquid volume measurement unit 108 detects the boundary of the measurement target area 103 obtained as described above, obtains the number of liquid height pixels corresponding to the liquid height, and calculates the liquid height [mm] using the obtained number of liquid height pixels and the liquid height conversion coefficient [mm / Pixel] stored in the calibration data storage unit 111 of Fig. 1. The method of calculating the liquid height conversion coefficient will be described later. The liquid volume measurement unit 108 calculates the liquid volume based on the liquid height [mm] obtained in this manner and the diameter information of the blood collection tube.

[0027] <First embodiment: Purpose of calibration> As mentioned above, in order for biological sample measuring device 101 to calculate the liquid volume, a liquid height conversion coefficient [mm / Pixel] is required to convert the liquid height pixel number obtained from the captured image to liquid height [mm]. The liquid height conversion coefficient can be calculated from the field of view [mm] captured by area camera 105 and the number of sensor pixels of area camera 105, but in order to calculate the liquid height [mm] with high accuracy, the liquid height conversion coefficient must be calculated accurately, which poses the following two problems.

[0028] The first point concerns the deviation in the distance (working distance) between the imaging position of biological sample 102 and area camera 105. The field of view of area camera 105 expands and contracts depending on the working distance, and the liquid height conversion coefficient is also determined by the working distance. If the imaging position of biological sample 102 or the position of area camera 105 shifts from device to device due to installation of the device, the working distance will change and the value of the liquid height conversion coefficient will also shift, directly leading to a decrease in the accuracy of detection of the liquid height [mm]. Therefore, in order to obtain a more accurate liquid height conversion coefficient, calibration is required to obtain the liquid height conversion coefficient for each individual biological sample measuring device 101.

[0029] The second point concerns image distortion caused by lens aberration. When capturing an image using a general lens that is not a telecentric optical system, image distortion occurs from the center of the image to the edge of the image due to lens distortion aberration. Details will be described later, but when such image distortion is present, the liquid height conversion coefficient will change depending on the pixel position. Therefore, to obtain an accurate liquid height conversion coefficient, it is necessary to detect the image distortion and correct the liquid height conversion coefficient according to the image distortion. In particular, since biological sample measuring device 101 measures the liquid height in measurement target area 103, correction is required for distortion in the liquid height direction.

[0030] In order to solve the above two problems, a calibration, described below, is performed on each individual biological sample measuring device 101. In the calibration, with the aim of finding a highly accurate liquid height conversion coefficient, a distortion coefficient that represents the distortion of the image and a liquid height conversion coefficient that calculates and corrects the liquid height based on the distortion coefficient are obtained for each device, and these are stored in calibration data storage unit 111. The liquid volume measurement unit 108 obtains the distortion coefficient and liquid height conversion coefficient stored in calibration data storage unit 111, and uses these in calculating the liquid height, thereby being able to calculate the liquid height [mm] with high accuracy.

[0031] <First embodiment: Calibration procedure> 3A and 3B are examples of a calibrator 301. The calibration data acquisition unit 107 acquires an image of the calibrator 301 captured by the area camera 105, and analyzes a shape pattern formed on the surface of the calibrator 301 to acquire a distortion coefficient and a liquid height conversion coefficient.

[0032] The calibrator 301 has a pattern 302 formed on a flat housing as shown in Fig. 3A or a cylindrical housing as shown in Fig. 3B. The pattern 302 in Fig. 3 is an example having a black and white striped pattern in the vertical direction. The shape of the calibrator 301 may be a flat plate, a cylinder, or a rectangular parallelepiped, but regardless of the shape, the pattern 302 is on the surface of the housing. If the shape of the calibrator 301 is the same as or similar to the shape of the container for the biological sample 102, the computational load for calculating the distortion coefficient and the liquid height conversion coefficient can be reduced.

[0033] The housing of calibrator 301 is made of a material such as resin or plastic that transmits at least one wavelength of surface illumination light source 104 of biological sample measuring device 101. Pattern 302 may be printed directly on the housing, or pattern 302 may be printed on paper and attached to the surface of the housing. It may be formed on the housing by any other appropriate method. Since calibration data acquisition unit 107 analyzes the contrast of pattern 302 acquired by area camera 105, pattern 302 is composed of areas that transmit and areas that do not transmit the wavelength of surface illumination light source 104. By calculating each coefficient using light that has transmitted through calibrator 301, the device settings (position of the object to be imaged, optical configuration, etc.) used when imaging calibrator 301 can be used as is when imaging the sample.

[0034] 4A and 4B are diagrams showing examples of a pattern 302. The duty ratios of light and dark are different between FIG. 3A and FIG. 4A. The pattern 302 is a stripe pattern in FIG. 4A or a grid pattern in FIG. 4B, which has a light and dark pattern in the vertical direction. As long as the stripe interval [mm] of the pattern 302 is known, it does not have to be a stripe or grid pattern, and the black and white duty ratio may be arbitrary. When a stripe or grid pattern in which light and dark are repeated at equal intervals is used, the amount of calculation required for the distortion coefficient acquisition process performed by the calibration data acquisition unit 107 is reduced. A random pattern may be used as long as it is a known pattern.

[0035] The printing range of the pattern 302 must be a range that can cover the vertical area of ​​the biological sample 102 to be imaged, and the pattern 302 must be present in an area that is at least wider than the height range of the measurement target area 103. Specifically, when an area of ​​90 mm in a blood collection tube having a length of 100 mm is imaged by the area camera 105, the pattern 302 must be present over the entire vertical field of view of the area camera 105. When the range of the image analyzed by the liquid volume measurement unit 108 is narrower than the field of view of the area camera 105, the amount of calculation required for the distortion coefficient acquisition process by the calibration data acquisition unit 107 can be reduced by adjusting the printing range to the analysis range of the liquid volume measurement unit 108.

[0036] 5 is a diagram for explaining a method of imaging the calibrator 301. The calibrator 301 is arranged so as to be parallel to the lens surface of the area camera 105, and the area camera 105 images the transmitted light when the light of the surface illumination light source 104 is irradiated onto the calibrator 301. Only one wavelength of light is required to be irradiated onto the calibrator 301. When using a surface illumination light source 104 that irradiates light of two wavelengths, such as 970 nm and 1550 nm, the contrast of the pattern 302 can be improved and analyzed with high accuracy by imaging the calibrator 301 using the light of the shorter wavelength (970 nm) which is less blurred due to chromatic aberration.

[0037] The calibrator 301 may be positioned at any position as long as the distance from the area camera 105 to the calibrator 301 is known. If the position of the calibrator 301 is made to coincide with the imaging position of the biological sample 102, the amount of calculation required to obtain the distortion coefficient and the liquid height conversion coefficient can be reduced.

[0038] <Embodiment 1: Method for correcting image distortion caused by lens aberration> Figures 6A and 6B are diagrams for explaining distortion of captured images. Figure 6A is an explanatory diagram of a calibrator image 601 captured using the configuration of Figure 5 of a calibrator 301 with a constant light and dark fringe spacing. Figure 6B is a diagram showing the distribution of fringe spacing pixel counts [pixels] in the analysis range 602 of Figure 6A when lens distortion aberration is present. The horizontal axis of Figure 6B indicates the vertical coordinate of the calibrator image 601, and the vertical axis indicates the fringe spacing pixel counts [pixels].

[0039] Even when calibrator 301, which has a constant light-dark pattern stripe spacing, is imaged, if there is lens distortion, the stripe spacing will not be constant, and the number of pixels at the stripe spacing will become smaller as you approach the edge of the image, as shown in Figure 6B. This distribution of stripe spacing on calibrator 301 represents image distortion.

[0040] FIG. 7 is a diagram for explaining the liquid height conversion coefficient [mm / pixel] obtained by dividing the actual stripe interval length [mm] in FIG. 6B by the stripe period [pixel]. Since the number of stripe interval pixels changes due to image distortion, the liquid height conversion coefficient also has a distribution that depends on the vertical coordinate. In other words, the liquid height conversion coefficient differs depending on the liquid surface position of the biological sample 102, and if the liquid height conversion coefficient obtained from the stripe period at the center of the image is used as is to convert the number of liquid height pixels at the edge of the image, the liquid height accuracy decreases. To obtain the liquid height [mm] with high accuracy, it is necessary to convert the number of liquid height pixels taking into account the distribution in FIG. 6B and FIG. 7.

[0041] The distortion coefficient calculation unit 109 obtains a distortion coefficient that represents the distortion described above. The liquid height conversion coefficient calculation unit 110 obtains a liquid height conversion coefficient based on the distortion coefficient. A specific method will be described below.

[0042] FIG. 8 is a flowchart showing the process in which the distortion coefficient calculation unit 109 acquires the distortion coefficient. The area camera 105 acquires the calibrator image 601 (S801). The vertical fringe period distribution as shown in FIG. 6 is acquired from the luminance distribution of the analysis range 602 set in the central region of the image (S802). The width of the analysis range 602 is set to be approximately the diameter of a blood collection tube at the maximum, and the fringe period distribution is acquired by averaging the pixel values ​​in the horizontal direction of the analysis range 602, thereby reducing the influence of noise. The distortion coefficient for fitting the acquired fringe period distribution and the distortion function is acquired (S803). Equation 1 is an example of the distortion function. yd is the distortion function, y is the vertical coordinate, and k1 and k2 are the distortion coefficients. The distortion coefficient is set so that the error between Equation 1 and the fringe period distribution acquired in S802 is minimized, and the acquired distortion coefficient is stored in the calibration data storage unit 111 (S804).

[0043] Since only distortion in the vertical direction (liquid height direction) affects the liquid height accuracy, distortion in the horizontal direction does not need to be taken into consideration, and the distortion function may be one-way with the vertical coordinate as a variable. When detecting the blood collection tube diameter as described below, the horizontal distortion function may be calculated in the same way, or the vertical distortion function may also be used as the horizontal distortion function. Calculating only the distortion function in one direction has the effect of reducing the amount of calculation required.

[0044]

number

[0045] The liquid height conversion coefficient calculation unit 110 acquires the liquid height conversion coefficient based on the distortion coefficient stored in the calibration data storage unit 111. Figures 9 and 10 are flowcharts explaining a method for obtaining the liquid height conversion coefficient. There are two methods for obtaining the liquid height conversion coefficient taking image distortion into consideration. The first method is to obtain a constant liquid height conversion coefficient after correcting the fringe period distribution in Figure 6B by correcting the distortion of the calibrator image 601 (Figure 9). The second method is to obtain the distribution of the liquid height conversion coefficient from the distortion function (Figure 10).

[0046] FIG. 9 is a flow chart for explaining a method for obtaining a liquid height conversion coefficient after performing distortion correction of the calibrator image 601. First, the calibrator image 601 and the distortion coefficient stored in the calibration data storage unit 111 are acquired (S901). Next, the pixel interval is expanded or reduced according to a distortion function such as Equation 1 defined using the distortion coefficient, thereby performing distortion correction in the vertical direction of the calibrator image (S902). Next, the light-dark cycle distribution of the calibrator image 601 after distortion correction is acquired (S903). By the process of S902, the light-dark cycle distribution of FIG. 6B acquired in S903 becomes flat so as to match the distribution of the actual calibrator cycle. Finally, the actual calibrator cycle [mm] is divided by the light-dark cycle [pixel] to acquire a constant liquid height conversion coefficient [mm / pixel] (S904), which is stored in the calibration data storage unit 111 (S905). In step S902, the distortion of the calibrator image 601 is corrected. However, the vertical fringe period distribution may be corrected by the distortion function instead of the calibrator image 601.

[0047] Fig. 10 is a flow chart for explaining a method of acquiring a liquid height conversion coefficient as a distribution (function) with the vertical coordinate as a variable based on the distortion coefficient and distortion function acquired in Fig. 8. First, the calibrator image 601 and distortion coefficient are acquired (S1001), and a reference value of the liquid height conversion coefficient is acquired using the stripe period of the central region of the calibrator image 601, etc. (S1002). Next, the distortion function of Fig. 8 is set based on the distortion coefficient, and the inverse of the distortion function is used to acquire a distribution of the liquid height conversion coefficient in which the reference value of the liquid height conversion coefficient is corrected depending on the vertical coordinate (S1003). The acquired distribution of the liquid height conversion coefficient is similarly stored in the calibration data storage unit 111 (S1004).

[0048] In either method of Fig. 9 or Fig. 10, a liquid height conversion coefficient that takes image distortion into consideration can be obtained, and it is sufficient to implement and execute either one of the methods. However, the contents of the liquid height conversion coefficient to be stored differ depending on whether Fig. 9 or Fig. 10 is executed, and the flow of the liquid volume measurement process described below also differs.

[0049] The above process is performed in advance as calibration for each device. When measuring the liquid volume of the biological sample 102, the distortion coefficient and liquid height conversion coefficient stored in the calibration data storage unit 111 are acquired and the liquid volume is measured. This makes it possible to avoid deviations in the working distance due to installation, etc., and deterioration in the liquid height measurement accuracy due to image distortion.

[0050] <Embodiment 1: Liquid volume measurement method> Figures 11 and 12 are flow charts for explaining the process of measuring the liquid volume by the liquid volume measuring unit 108. Figure 11 shows a method using the liquid height conversion coefficient obtained by the method of Figure 9, and Figure 12 shows a method using the distribution of the liquid height conversion coefficient obtained by the method of Figure 10. It is possible to switch between using Figure 11 and Figure 12 depending on the processing content (Figure 9 or Figure 10) executed by the liquid height conversion coefficient calculation unit 110.

[0051] FIG. 11 is a flow chart for explaining a liquid volume measurement method using the constant liquid height conversion coefficient acquired in FIG. 9. The liquid volume measurement unit 108 acquires the captured image of the biological sample 102 acquired by the area camera 105 (S1101), accesses the calibration data storage unit 111, and acquires the distortion coefficient and the liquid height conversion coefficient (constant) (S1102). Next, the image distortion of the captured image of the biological sample 102 is corrected (S1103) using the distortion coefficient in the same manner as S902 in FIG. 9. The image distortion is corrected at least in the vertical direction, and when performing detection of the blood collection tube diameter described later, horizontal distortion correction is also performed similarly to the correction of the calibrator image 601. The measurement target region 103 is extracted by detecting the brightness gradient of the boundary of the biological sample image after image distortion correction based on the principle described in FIG. 2 (S1104). The number of pixels in the vertical direction of the extracted measurement target area is set as the number of liquid height pixels, and the number of liquid height pixels is multiplied by the liquid height conversion coefficient obtained in S1102 to obtain the liquid height [mm] (S1105). The liquid volume is calculated using the liquid height [mm] and the blood collection tube diameter information (S1106). The blood collection tube information may be obtained from the information on the blood collection tube to be used before the measurement, or may be obtained from an image of the biological sample 102 by a method described later.

[0052] 11 can also acquire a one-dimensional luminance signal by processing such as extracting a central region from a captured image of the biological sample 102 to detect the boundary of the measurement target region 103. In that case, one-dimensional luminance signal acquisition processing may be performed on the distortion-corrected image output by the biological sample image distortion correction processing (S1103), or one-dimensional luminance signal acquisition processing may be performed before S1103, and distortion correction in S1103 may be performed on the acquired one-dimensional luminance signal. By performing distortion correction and measurement target region 103 extraction processing on the one-dimensional luminance signal, the amount of calculations can be reduced.

[0053] FIG. 12 is a flow chart for explaining a liquid volume measurement method using the distribution of the liquid height conversion coefficient acquired in the process of FIG. 10. The process of FIG. 12 is different from the process of FIG. 11 in that the distortion correction of the captured image of the biological sample 102 is not performed, and a measurement target area is extracted from the captured image acquired in S1201 by the same process as S1104 of FIG. 11 (S1203). In S1204, a liquid height conversion coefficient corresponding to the coordinates (in pixels) of the measurement target area detected in S1203 is acquired from the liquid height conversion coefficient distribution acquired in S1202, and the liquid height conversion coefficient is integrated within the range of the measurement target area in the vertical direction to acquire the liquid height [mm]. As in the process of FIG. 11, S1203 may perform boundary detection on the one-dimensional luminance signal. The liquid volume calculation process of S1205 is the same as S1106 of FIG. 11.

[0054] By the above processing of Figs. 11 and 12, image distortion can be corrected, so that the liquid height can be obtained and the liquid amount can be measured with high accuracy.

[0055] <Embodiment 1: Use of blood collection tube diameter> As explained above, the deviation of the working distance, which affects the value of the liquid height conversion coefficient, affects the accuracy of the liquid height. In addition to deviations due to the installation of the device, the working distance also changes depending on the diameter of the blood collection tube, which affects the accuracy of the liquid height measurement. For example, the distance from the camera to the surface of the blood collection tube differs by 1.5 mm between a blood collection tube with a diameter of 13 mm and one with a diameter of 16 mm. To avoid the effect of this deviation, there is a method of preparing a liquid height conversion coefficient according to the blood collection tube diameter and using it according to the blood collection tube diameter information obtained during measurement.

[0056] Possible methods for obtaining a liquid height conversion coefficient according to the blood collection tube diameter include the following: (a) prepare cylindrical calibrators 301 as shown in FIG. 3B with the same diameter as the blood collection tubes for each type of diameter, perform calibration using each of them, and obtain and store the distortion coefficient and liquid height conversion coefficient corresponding to the blood collection tube diameter; (b) take into account the difference between the diameter of calibrator 301 and the actual diameter of the blood collection tube, obtain a scaled liquid height conversion coefficient according to the ratio of each working distance, and store it in advance in calibration data storage unit 111, or obtain the scaled liquid height conversion coefficient each time the liquid volume is measured.

[0057] When a planar calibrator 301 as shown in FIG. 3A is used, the liquid height conversion coefficient obtained from the calibrator 301 is scaled according to the ratio between the working distance when imaging the calibrator 301 and the working distance when imaging the biological sample 102, which is determined by the diameter of the blood collection tube, and the liquid height conversion coefficient on the surface of the blood collection tube is obtained by scaling the liquid height conversion coefficient obtained from the calibrator 301.

[0058] The liquid volume measuring unit 108 acquires blood collection tube information to obtain the liquid volume from the liquid height. The blood collection tube information may be stored in advance in the liquid volume measuring unit 108, or the blood collection tube diameter may be detected from the captured image of the biological sample 102 for each measurement. In either case, by acquiring the blood collection tube diameter at the time of measurement, a liquid height conversion coefficient according to the blood collection tube diameter can be used. Methods for acquiring the blood collection tube diameter from the captured image of the biological sample 102 include a method of detecting the boundary from the brightness difference between the edges of the blood collection tube and the background to obtain the diameter.

[0059] <Embodiment 2> 13 is a diagram showing the configuration of a biological sample measuring device 101 according to embodiment 2 of the present disclosure. In addition to the configuration described in embodiment 1, this embodiment further comprises an imaging position adjustment section 1301, a gripping mechanism 1302, and a gripping mechanism control driver 1303. The other configuration is the same as in embodiment 1.

[0060] The gripping mechanism 1302 is a mechanism for gripping the biological specimen 102 and the calibrator 301. The gripping mechanism control driver 1303 is a driver for controlling the position of the gripping mechanism 1302 based on the output result of the imaging position adjustment unit 1301. The imaging position adjustment unit 1301 is composed of an imaging position storage unit 1304 and a biological specimen imaging position acquisition unit 1305. The imaging position storage unit 1304 stores the imaging position of the calibrator 301 and the imaging position of the biological specimen 102 acquired by the biological specimen imaging position acquisition unit 1305. The biological specimen imaging position acquisition unit 1305 acquires information on the imaging position of the calibrator 301 stored in the imaging position storage unit 1304 and information on the liquid height conversion coefficient stored in the calibration data storage unit, and acquires the imaging position of the biological specimen 102 using these.

[0061] In FIG. 13, the imaging position of the calibrator 301 and the biological sample 102 is adjusted using a gripping mechanism 1302, but the imaging position may be adjusted by a method other than gripping, such as by providing a jig for fixing the bottom of the biological sample 102 and the calibrator 301 and a rail for adjusting the position of the jig, and controlling the position of the jig with a control driver.

[0062] <Embodiment 2: Adjustment of calibrator and biological specimen imaging position> Since the liquid height conversion coefficient is determined by the working distance, in order to accurately determine the liquid height, it is necessary to match the imaging position of the pattern 302 surface of the calibrator 301 with the position of the measurement surface of the biological sample 102.

[0063] When using a cylindrical calibrator 301 having the same diameter as the blood collection tube to be measured, the imaging positions of the calibrator 301 and the biological sample 102 are aligned. The imaging position of the calibrator 301 stored in the imaging position storage unit 1304 is acquired by the biological sample imaging position acquisition unit 1305, and the imaging position of the biological sample 102 is sent to the gripping mechanism control driver 1303.

[0064] When the diameter of the calibrator 301 is different from the diameter of the blood collection tube, or when the position of the printed surface of the pattern 302 of the calibrator 301 is shifted from the position of the measurement surface of the biological sample 102 due to differences in shape such as a plate-shaped calibrator, the biological sample imaging position acquisition unit 1305 acquires an imaging position shifted by the amount of shift from the imaging position of the calibrator 301, and images the biological sample 102 at the acquired imaging position. This makes it possible to obtain the liquid height using the distortion coefficient and liquid height conversion coefficient acquired by the calibration as they are. In this case, the liquid height conversion coefficient can also be corrected by enlarging or reducing the liquid height conversion coefficient using the method described in the first embodiment.

[0065] <Embodiment 3> In the second embodiment, a method for adjusting the imaging position of the biological sample 102 based on the imaging position of the calibrator 301 has been described. According to this method, the liquid height can be measured with high precision using an accurate liquid height conversion coefficient. On the other hand, if the position of the area camera 105 or the gripping mechanism 1302 is shifted due to installation or the like, the working distance of the biological sample 102 will differ between devices. The shift in working distance will expand or reduce the field of view of the area camera 105, and therefore the resolution will change between devices.

[0066] In the third embodiment of the present disclosure, to address this problem, the imaging position of the biological sample 102 is adjusted based on the value of the liquid height conversion coefficient acquired by calibration in the configuration of Fig. 13. This allows a common working distance to be set between devices.

[0067] FIG. 14 is a flow chart for explaining a method for adjusting the imaging position of the biological sample 102 from the value of the liquid height conversion coefficient. First, an image 1 of the calibrator 301 is acquired at the first imaging position stored in the imaging position storage unit (S1401). Next, the gripping mechanism control driver 1303 moves the calibrator 301 to the second imaging position stored in the imaging position storage unit (S1402) and acquires an image 2 (S1403). The second imaging position is a position shifted in the depth direction from the first imaging position with respect to the area camera 105 (it may be in either the plus or minus direction). For each of the captured images 1 and 2, a liquid height conversion coefficient is acquired by the method of the first embodiment. The acquisition method may be either the method of FIG. 9 or FIG. 10. In the case of FIG. 9, a constant liquid height conversion coefficient is acquired, and in the case of FIG. 10, a reference value for determining the distribution of the liquid height conversion coefficient is acquired (S1404). The biological specimen imaging position acquisition unit 1305 sets a linear function with the horizontal axis representing the coordinate of the imaging position and the vertical axis representing the liquid height conversion coefficient from the two acquired liquid height conversion coefficients (or reference values ​​of the liquid height conversion coefficients) and the coordinates of each imaging position (S1405). From the acquired linear function, the coordinate of the imaging position at which a liquid height conversion coefficient common to the devices is obtained is acquired (S1406). The acquired imaging position is stored in the imaging position storage unit 1304 and used when measuring the biological specimen 102. By performing the above procedure during calibration for each device, the biological specimen 102 can be imaged at a working distance (and a common liquid height conversion coefficient) common to the devices.

[0068] The effect of capturing images at a common working distance is that images can be captured at the same resolution between devices, and lens focus deviations caused by deviations in working distance can also be reduced.

[0069] <Modifications of the present disclosure> The present disclosure is not limited to the above-described embodiments, and includes various modified examples. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those having all of the configurations described. In addition, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

[0070] The calibration in the first embodiment may be performed for each apparatus, such as when the apparatus is installed, or may be performed using the calibrator 301 each time a measurement is performed.

[0071] In the first embodiment, a specific example of the wavelength used to obtain a transmission image is described assuming a specific configuration (serum sample) of the biological sample 102. The present disclosure is not limited to this, and can be applied to other types of samples. That is, by appropriately selecting the wavelength for obtaining a transmission image as exemplified in FIG. 2A to FIG. 2B based on the absorbance characteristics of the sample, the present disclosure can be applied to other samples.

[0072] The calibration data acquisition unit 107, the liquid volume measurement unit 108, and the imaging position adjustment unit 1301 can be configured by hardware such as a circuit device that implements their functions, or can be configured by a calculation device such as a CPU (Central Processing Unit) executing software that implements their functions.

[0073] In the above embodiment, the calibrator 301 can be a component of the biological sample measuring device 101 , or can be configured as a separate member from the biological sample measuring device 101 .

[0074] In the above embodiments, the procedure for calculating the distortion coefficient and liquid height conversion coefficient does not necessarily have to be performed when measuring biological sample 102; for example, it may be performed in advance before measuring biological sample 102 and the results stored in biological sample measuring device 101. [Explanation of symbols]

[0075] 101: Biological sample measuring device 104: Area lighting light source 105: Area camera 106: Time sharing control driver 107: Calibration data acquisition unit 108: Liquid volume measurement section 301: Calibrator 1301: Image position adjustment unit

Claims

1. A biological sample measurement device for measuring a biological sample having one or more component regions, an imaging unit configured to generate a first captured image of the biological specimen using light transmitted through the biological specimen, and to generate a second captured image of the calibrator using transmitted light transmitted through a calibrator having a pattern shape formed on its surface; a distortion coefficient calculation unit that calculates a distortion coefficient for correcting distortion of the image captured by the imaging unit, using the second captured image; a conversion coefficient calculation unit that calculates a conversion coefficient for converting the number of pixels in the image captured by the imaging unit into a length using the distortion coefficient; a liquid level measuring unit that measures a liquid height of the biological sample by applying the conversion coefficient to the first captured image; Equipped A biological sample measuring device characterized by:

2. the liquid volume measurement unit is configured to identify a target portion of the biological sample to be measured from a captured image of the biological sample; the imaging unit generates a third captured image of the biological specimen by using a first wavelength component of the light transmitted through the biological specimen; the imaging unit generates a fourth captured image of the biological specimen by using a second wavelength component of the light transmitted through the biological specimen; the liquid amount measuring unit identifies an amount resulting from a difference between a portion generated by using the first wavelength component in the third captured image and a portion generated by the second wavelength component in the fourth captured image; and The liquid amount measuring unit specifies a range of the target portion by specifying a portion where the specified amount is equal to or greater than a threshold value.

2. The biological sample measuring device according to claim 1.

3. The pattern shape is composed of a plurality of shapes arranged along the liquid height direction of the biological sample.

2. The biological sample measuring device according to claim 1.

4. the biological sample measurement device further comprises a light source that irradiates the calibrator and the biological sample with a first light having a first wavelength component or a second light having a second wavelength component; the light source irradiates the calibrator with one of the first light and the second light, the one having a shorter wavelength; The imaging unit generates the second captured image using light transmitted through the calibrator.

2. The biological sample measuring device according to claim 1.

5. the conversion coefficient calculation unit calculates the conversion coefficient for each position in a liquid height direction of the biological sample; The liquid volume measurement unit measures the liquid height of the biological sample by applying the conversion coefficient corresponding to a position in the liquid height direction of the first captured image.

2. The biological sample measuring device according to claim 1.

6. the pattern shape is composed of a plurality of shapes periodically arranged along a liquid height direction of the biological sample, the distortion coefficient calculation unit acquires a period of the pattern shape in the second captured image for each position in the liquid height direction; the distortion coefficient calculation unit performs function fitting on a period of the pattern shape acquired from the second captured image to obtain a distortion function that represents the distortion; The distortion coefficient calculation unit uses parameters constituting the distortion function as the distortion coefficients.

2. The biological sample measuring device according to claim 1.

7. The conversion coefficient calculation unit corrects the distortion of the second captured image by using the distortion coefficient; The conversion coefficient calculation unit calculates the conversion coefficient by dividing an actual size of the pattern shape of the calibrator by the number of pixels of the pattern shape of the corrected second captured image.

2. The biological sample measuring device according to claim 1.

8. the distortion coefficient calculation unit calculates the distortion coefficient for distortion dependent on a position of the biological sample in a liquid height direction; the conversion coefficient calculation unit obtains a reference value of the conversion coefficient by dividing an actual size of the pattern shape of the calibrator at a reference position of the second captured image by a number of pixels of the pattern shape of the second captured image; The conversion coefficient calculation unit calculates the conversion coefficient that changes depending on the position in the liquid height direction by applying a function constructed using the distortion coefficient to the reference value.

2. The biological sample measuring device according to claim 1.

9. The liquid volume measurement unit corrects distortion of the first captured image by using the distortion coefficient; The liquid volume measuring unit measures the liquid height of the biological sample by applying the conversion coefficient to the corrected first captured image.

2. The biological sample measuring device according to claim 1.

10. The liquid volume measurement unit measures the liquid height of the biological sample by applying a value corresponding to a position in the liquid height direction of the first captured image, out of the conversion coefficients calculated for each position in the liquid height direction.

9. The biological sample measuring device according to claim 8.

11. the conversion coefficient calculation unit calculates the conversion coefficient for each size of a container that contains the biological sample by using the second captured images of each of the calibrators having different sizes, or The conversion coefficient calculation unit increases or decreases the conversion coefficient calculated from the second captured image in accordance with a ratio between a working distance when the imaging unit captures the second captured image and a working distance when the imaging unit captures the first captured image.

2. The biological sample measuring device according to claim 1.

12. The biological sample measuring device further comprises a position adjustment section that adjusts the position of the object imaged by the imaging section, The position adjustment unit adjusts the position of the biological sample so that a position of the pattern shape when the second captured image used to calculate the distortion coefficient and the conversion coefficient is captured is the same as a position of the measurement surface of the biological sample when the first captured image to which the distortion coefficient and the conversion coefficient are applied is captured.

2. The biological sample measuring device according to claim 1.

13. The biological sample measuring device further comprises a position adjustment section that adjusts the position of the object imaged by the imaging section, the imaging unit captures an image of the calibrator when the calibrator is in a first position; the imaging unit captures an image of the calibrator when the calibrator is at a second position different from the first position in a depth direction; the conversion coefficient calculation unit calculates, as the conversion coefficients, a first coefficient at the first position and a second coefficient at the second position; the conversion coefficient calculation unit calculates a function representing a relationship between a position of the calibrator and the conversion coefficient by using the first coefficient and the second coefficient; the conversion coefficient calculation section identifies pairs of the conversion coefficient and the position of the biological sample that are used in common for each individual biological sample measuring device, from the relationships described by the function; The position adjustment unit places the biological sample at a position specified by the pair, and the liquid volume measurement unit uses the conversion coefficient specified by the pair.

2. The biological sample measuring device according to claim 1.

14. The container for containing the biological sample and the calibrator have the same or similar shapes.

2. The biological sample measuring device according to claim 1.

15. A method for calibrating a biological sample measurement device for measuring a biological sample having one or more component regions, comprising the steps of: generating an image of the calibrator using light transmitted through the calibrator having a pattern shape formed on its surface; a step of calculating a distortion coefficient for correcting distortion of the image captured by the biological sample measuring device using the captured image; calculating a conversion coefficient for converting the number of pixels in an image captured by the biological sample measuring device into a length using the distortion coefficient; A calibration method having the following:

Citation Information

Patent Citations

  • Biological sample measuring device

    JP2022178784A

  • Method and Device for Determining the Position of a Boundary Between Two Phased in a Sample Tube

    US20120013889A1