Method and apparatus for body fluid testing

Abstract

The present invention relates to a method for examining bodily fluids, and includes the steps of: grasping the ROI region for each sperm in each of the set n video frames; reducing the brightness of the video in each of the n video frames to a set value; creating a single cumulative video frame by accumulating the images of each sperm within the n video frames; grasping the region of the migration path for each sperm in the cumulative video frame; calculating the size of the migration path region for each sperm and determining its activity based on the calculated size; and calculating the ratio of the width to the height of the rectangle surrounding the migration path region for each sperm and determining its straight-line movement based on the calculated width to height ratio.

Description

Technical Field

[0001] It relates to a body fluid inspection method and an apparatus therefor.

[0002] The present invention relates to a body fluid inspection method and an apparatus therefor, and more particularly to a body fluid inspection method and an apparatus therefor that can analyze semen images taken by a hospital inspection apparatus, a portable inspection apparatus, a mobile inspection application, etc. within a short time.

Background Art

[0003] Generally, as shown in FIG. 1(a), in semen inspection, semen is collected, the collected semen is photographed, and then the number of semen in the photograph and the movement of each semen are inspected by a body fluid measurement and analysis apparatus 10, and the analysis result (inspection result) is output on a screen.

[0004] Alternatively, as shown in FIG. 1(b), in semen inspection, after semen is collected by a sample collection apparatus 21, the semen collected by the sample collection apparatus 21 itself or an external photographing apparatus is photographed, and the photographed semen image (or video) is provided to a body fluid analysis apparatus 20. After the body fluid analysis apparatus 20 inspects the number of semen and the movement of each semen, the analysis result is output on a screen.

[0005] At this time, the semen inspection method creates a video of the semen collected as a sample, searches for and grasps the ROI (Region Of Interest) region (i.e., the sperm region) in the semen video, and then performs tracker analysis between the frames of the semen video to analyze whether the sperm can move, the degree of movement, the direction of movement, etc.

[0006] However, in the conventional semen inspection method, since the possibility of movement, the degree of movement, the direction of movement, etc. are analyzed for each set video frame of all semen, the inspection time for the ROI region search process, the tracker analysis process, the result analysis, and the output process requires an average of 88 seconds.

[0007] However, when applying traditional semen analysis methods to mobile devices, 88 seconds will likely feel like a long time to mobile users who are looking for faster results.

[0008] Therefore, there is a need for a solution that allows semen analysis to be performed at an earlier time. [Overview of the project] [Problems that the invention aims to solve]

[0009] The present invention aims to provide a bodily fluid analysis method and apparatus that can perform semen analysis in a shorter time than conventional methods. [Means for solving the problem]

[0010] A bodily fluid examination method according to an embodiment of the present invention for achieving the above objectives may include the steps of: grasping the ROI region for each sperm in each of the set n video frames; reducing the brightness of the video in each of the n video frames to a set value; creating a single cumulative video frame by accumulating the images of each sperm within the n video frames; grasping the region of the migration path for each sperm in the cumulative video frame; calculating the size of the migration path region for each sperm and determining its activity based on the calculated size; and calculating the ratio of the width to the height of the rectangle surrounding the migration path region for each sperm and determining its straight-line movement based on the calculated width to height ratio.

[0011] A bodily fluid examination method according to an embodiment of the present invention may include a step of performing a preprocessing operation to adjust the brightness and contrast for each of the n video frames.

[0012] The aforementioned setting values ​​can be (1 / n).

[0013] In the step of determining activity, if the calculated area is smaller than the first set area, it is not recognized as sperm; if the calculated area is larger than the first set area but smaller than the second set area, it is determined to be a stopped sperm; and if the calculated area is equal to or greater than the second set area, it is determined to be an active sperm.

[0014] The step of determining straightness allows a sperm to be determined to be moving straight if the calculated ratio of width to length is equal to or greater than the set ratio.

[0015] A bodily fluid testing method according to an embodiment of the present invention may further include the step of calculating the activity value and motility value for the sperm of the person being tested using the number of stopped sperm, the number of active sperm, and the number of progressive sperm.

[0016] A bodily fluid testing device according to an embodiment of the present invention for achieving the above objectives comprises a memory and a processor connected to the memory and configured to execute instructions contained in the memory, wherein the processor can be configured to perform each of the above steps. Specifically, the processor can be configured to perform the following steps: to grasp the ROI area for each sperm in each of the set n video frames; to reduce the brightness of the video in each of the n video frames to a set value; to create a single cumulative video frame by accumulating the images of each sperm in the n video frames; to grasp the area of ​​the migration path for each sperm in the cumulative video frame; to calculate the size of the migration path area for each sperm and determine the activity based on the calculated size; and to calculate the ratio of the width to the height of the rectangle surrounding the migration path area for each sperm and determine the straightness based on the calculated width to height.

[0017] The processor may be configured to further perform the steps of: performing a pre-processing operation for noise reduction for each of the n video frames.

[0018] The body fluid inspection device according to an embodiment of the present invention can further include an imaging unit that captures a subject and stores the captured image in the memory.

[0019] The body fluid inspection device according to an embodiment of the present invention can further include a chamber unit for storing a semen sample collected from an individual.

[0020] The imaging unit can be configured to capture the semen sample stored in the chamber unit.

[0021] The processor can be further configured to calculate an activity value and a straightness value for the sperm of the corresponding measurer using the number of immotile sperm, the number of motile sperm, and the number of straight-moving sperm.

Advantages of the Invention

[0022] The present invention has the advantage of significantly reducing the semen inspection time by accumulating the movement for each frame of each semen and analyzing the semen using the accumulated results.

Brief Description of the Drawings

[0023] [Figure 1] The drawing shows a body fluid inspection device according to a conventional embodiment. [Figure 2] The block diagram shows a body fluid inspection device according to the first embodiment of the present invention. [Figure 3] The drawing shows the process of accumulating an image according to an embodiment of the present invention. [Figure 4] The block diagram shows a body fluid inspection device according to the second embodiment of the present invention. [Figure 5] The schematic flowchart shows a body fluid inspection method according to an embodiment of the present invention. [Figure 6] The drawing shows grasping the motility of sperm according to an embodiment of the present invention. [Figure 7] The drawing shows grasping the straightness of sperm according to an embodiment of the present invention. [Figure 8]This figure shows the results of a clinical video verification test according to an embodiment of the present invention. [Modes for carrying out the invention]

[0024] Hereinafter, the embodiments disclosed herein will be described in detail with reference to the attached drawings, and identical and / or similar components will be assigned the same reference numeral regardless of the reference numerals in the drawings, and redundant descriptions thereof will be omitted. Furthermore, in describing the embodiments disclosed herein, if it is determined that a specific description of related prior art would obscure the gist of the embodiments disclosed herein, such detailed description will be omitted.

[0025] Terms including ordinal numbers, such as "1st," "2nd," etc., can be used to describe various components, but the components are not limited by such terms. These terms are used solely for the purpose of distinguishing one component from others.

[0026] A singular expression can include multiple expressions unless the context clearly indicates a different meaning.

[0027] In this application, each step described may be performed in any order, except where there is a specific causal relationship that dictates that the steps should be performed in that order.

[0028] In this application, terms such as "includes" or "has" are intended to specify the presence of features, numbers, steps, actions, components, parts, or combinations thereof as described in the specification, and should be understood not to pre-exist to exclude the existence or possibility of adding one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0029] The present invention will be described below with reference to the attached drawings.

[0030] Figure 2 is a block diagram of a body fluid testing device according to a first embodiment of the present invention. Referring to Figure 2, the body fluid testing device 100 according to the first embodiment of the present invention may include an input unit 110, an output unit 120, a communication unit 130, a memory 140, and a processor 150. Furthermore, the body fluid testing device 100 according to the first embodiment of the present invention may further include an imaging unit 160.

[0031] The body fluid testing device 100 according to this first embodiment of the present invention can be a device used in a hospital, a portable computer device such as a mobile phone or a laptop computer.

[0032] The input unit 110 can receive various types of information through user operations and input actions. Such an input unit 110 may include a touchscreen module, keyboard, mouse, buttons, stylus, and microphone.

[0033] The output unit 120 can output various types of information. The output unit 120 may include a display device, a speaker, a vibration generator, and a tactile sensor.

[0034] The communication unit 130 allows the body fluid testing device 100 to communicate with external devices via a network using wired or wireless methods. The communication unit 130 can receive images of the body fluid being tested from an external source.

[0035] The memory 140 functions as a storage medium and can store multiple application programs driven by the bodily fluid testing device 100, semen images of the bodily fluids being tested, data for the operation of the bodily fluid testing device 100, and instruction words (commands). Such memory can be provided in hardware in the form of various storage devices such as ROM, RAM, flash drives, hard drives, etc., and / or in the form of web storage.

[0036] The imaging unit 160 is a camera device that allows for the imaging of the subject. This imaging unit 160 is linked to a bodily fluid examination program among the application programs and can perform the function of imaging bodily fluids received by an external bodily fluid collection device. The bodily fluid (semen) images captured by the imaging unit 160 are stored in the memory 140.

[0037] The processor 150 controls the overall operation of the input unit 110, the output unit 120, the communication unit 130, the memory 140, and optionally the imaging unit 160, to enable bodily fluid examination. The processor 150 can examine semen images received through the communication unit 110 and / or semen images captured by the imaging unit 160.

[0038] The processor 150 sequentially performs the following processes on the semen video: ROI region identification, video brightness adjustment, frame accumulation, video analysis, and result output. Furthermore, the processor 150 can perform a video preprocessing step before the ROI region identification step to facilitate video analysis. This preprocessing step involves adjusting brightness and contrast. Of course, the preprocessing step can also include a noise reduction step.

[0039] The aforementioned result output process can be performed using a separate device.

[0040] The process of identifying the ROI (Region of Interest) is a conventional semen analysis method that involves searching for the region where each sperm is located (i.e., the region of interest) in each frame of the semen video. The process of adjusting the brightness of the video adjusts the brightness of each of the set number of video frames required for the semen analysis to a set value. Adjusting the brightness of the video to a low value would result in an increased brightness when the set number of frames are accumulated, making it too bright for the processor 150 to identify objects. Therefore, the processor 150 pre-sets the brightness of each frame to a set value so that the brightness of the accumulated frames becomes the brightness of the received frame or within the set range. The set value can be the brightness of the current frame × (1 / set number of video frames).

[0041] The frame accumulation process is the process of accumulating a set number of video frames in chronological order to create a single frame. One method of accumulating a set number of video frames to create a single frame is to use three frames as an example. In the first method, the object from the first frame (i.e., the image of sperm) is reflected (accumulated) in the second frame, and the object from the second frame, which has the object from the first frame accumulated, is accumulated in the third frame. In the second method, the opposite of the first method occurs, where the object from the second frame is accumulated in the first frame, and the object from the third frame is accumulated in the first frame. Therefore, in the first method, the last frame becomes a single image in which the objects from each frame have been accumulated, while in the second method, the first frame becomes a single image in which the objects from each frame have been accumulated.

[0042] Another method involves reflecting the first, second, and third objects in a new frame, so that the objects from each frame are accumulated in the new frame.

[0043] Refer to Figure 3 to explain how to accumulate objects in a frame. Figure 3 is a diagram showing the process of accumulating images according to an embodiment of the present invention.

[0044] Assuming that Figure 3(a) shows eight video frames for semen analysis (F1 to F8), and that each frame displays an image of the first sperm (T1) and the second sperm (T2), since sperm are mobile, the first sperm (T1) and the second sperm (T2) in the first frame (F1) will move over time, resulting in them moving to a different position in the eighth frame (F8) than they were in the first frame (F1).

[0045] If the images of the first sperm (T1) and the second sperm (T2) displayed in these eight video frames (F1 to F8) are accumulated and displayed in a single frame, an accumulated image of the first sperm (T1) (MC1) and an accumulated image of the second sperm (T2) (MC2) can be obtained, as shown in Figure 3(b). It can be seen that the accumulated images (MC1, MC2) show the trajectory of the sperm's movement, that is, its migration path. Hereafter, the accumulated image of the sperm will be referred to as the sperm's "migration path".

[0046] The video analysis process involves analyzing the activity and motility of each object (i.e., sperm) using the sperm migration path, and determining the number of stationary sperm, active sperm, and motility sperm. Furthermore, the video analysis process may include a step to calculate the activity value (size of activity) and motility value (size of motility) for the sperm of the individual being measured, using the number of stationary sperm, active sperm, and motility sperm.

[0047] Here, a stationary sperm is a sperm that is neither active nor motility-dependent, meaning an object that is large enough to be recognized by the sperm but has little to no movement. An active sperm is an active sperm that is large enough to be recognized by the sperm and has a large trajectory, but does not motility-dependent. A motility-dependent sperm is a sperm that motility-dependent, meaning an object that is large enough to be recognized by the sperm, has a large trajectory, and has a long trajectory either horizontally or vertically.

[0048] The motility value is an indicator of how actively sperm move, while the motility value is an indicator of how straight sperm move. The motility value is calculated by dividing the first number, which is the sum of the number of active sperm and the number of motility sperm, by the second number, which is the sum of the number of active sperm, the number of motility sperm, and the number of resting sperm, as shown in [Mathematical Formula 1].

[0049] [Mathematical formula 1] Sperm activity = (Number of active sperm + Number of progressive sperm) / (Number of active sperm + Number of progressive sperm + Number of resting sperm)

[0050] The linearity value is the number of linearly moving sperm divided by the second number, as shown in [Mathematical Formula 2].

[0051] [Mathematical formula 2] Progression value = (Number of progressive sperm) / (Number of active sperm + Number of progressive sperm + Number of resting sperm)

[0052] On the other hand, the activation rate can be calculated during the video analysis process. The activation rate is an indicator that shows how much faster or slower the measured average sperm velocity is compared to the general average sperm velocity. Activation rate (P 活性化 ) can be calculated using the following mathematical formula 3.

[0053] [Mathematical formula 3] P 活性化 =((ΣArea(irregular, straight) / ΣNum(irregular, straight))×(video FPS / F 測定フレーム数 )) / (V avg ×C0)

[0054] In [Mathematical Equation 3], ΣArea(irregular, linear) is the sum of the areas of movement (area) of irregularly moving objects (i.e., sperm) and linearly moving objects (i.e., sperm), and its unit is PIXEL. 2 Therefore, in [Mathematical Equation 3], ΣNum(irregular, linear) is a combination of irregular motion objects and linear motion objects, and has no units. V avg is the average sperm motility speed, in units of μm / sec. C0 is a coefficient that converts area to length, in units of pixels. 2It is / μm.

[0055] If the activation rate (P 活性化 If the value is 2, it means that the average sperm velocity of the person being measured is twice that of the average sperm velocity of the general population.

[0056] On the other hand, since C0 has a very small length, approximating it to PIXEL / μm does not result in a large error, and therefore it can be calculated using this approximation.

[0057] The process of outputting results allows the results of the video analysis to be output through the output unit 120. The analysis results can be in the form of video or tables (see Figure 8).

[0058] Figure 4 is a block diagram of a body fluid testing device according to a second embodiment of the present invention. Referring to Figure 4, the body fluid testing device 100a according to the second embodiment of the present invention may include an input unit 110, an output unit 120, a chamber unit 170, a memory 140, and a processor 150. Furthermore, the body fluid testing device 100 according to the second embodiment of the present invention may further include at least one of an imaging unit 160 and a communication unit 130.

[0059] The input unit 110, output unit 120, communication unit 130, memory 140, and processor 150 of the body fluid testing device 100a according to the second embodiment of the present invention have the same corresponding configurations as those of the body fluid testing measure 100 according to the first embodiment of the present invention.

[0060] The chamber section 170 is configured to store semen samples collected from an individual and to be photographed by the imaging section 160. In the second embodiment of the present invention, the imaging section 160 is configured to photograph the semen stored in the chamber section 170, and the image of the photographed semen is stored in the memory 140.

[0061] The following describes a bodily fluid testing method according to an embodiment of the present invention, with reference to Figures 5 to 8. Figure 5 is a schematic flowchart of the bodily fluid testing method according to an embodiment of the present invention, Figure 6 is a diagram showing how to assess sperm activity according to an embodiment of the present invention, and Figure 7 is a diagram showing how to assess sperm motility according to an embodiment of the present invention.

[0062] In Figure 5, the n video frames can be provided from an external source or captured by the system itself, and they are temporally consecutive video frames.

[0063] In step S501, the processor 150 performs a preprocessing operation to adjust the brightness and contrast of each of the n video frames that are the subject of the bodily fluid examination.

[0064] In step S502, the processor 150 searches for and identifies the ROI region for each sperm in each of the n video frames set up for semen analysis. Through this ROI region search, each sperm is identified frame by frame.

[0065] In step S503, the processor 150 reduces the brightness of each of the n video frames to a set value. For example, if the set value is 1 / 10, the processor 150 reduces the brightness of each video frame to 1 / 10. In another example, the processor 150 can calculate the set value based on the number of video frames. For example, if there are 30 video frames to be examined for bodily fluids, the processor 150 can set the set value to 1 / 30.

[0066] In step S504, the processor 150 creates a single cumulative video frame by accumulating the images of each sperm within n video frames. For example, if there are 8 video frames, the ROI region of each sperm in the first video frame is displayed in the first cumulative video frame, the ROI region of each sperm (i.e., the image of each sperm) in the second video frame is displayed in the first cumulative video frame, and so on with the third, fourth, and so on, until the eighth video frame is the last, and the ROI region of each sperm in each video frame is displayed in the first cumulative video frame. As a result, the ROI regions of each sperm are accumulated and displayed in chronological order as shown in Figure 4(b), and are displayed as the movement trajectory (movement path) of each sperm.

[0067] In step S505, the processor 150 identifies the migration path for each sperm in the accumulated video frames.

[0068] In step S506, the processor 150 identifies the area of ​​the migration path for each sperm, calculates the size (area) of the corresponding area, compares the calculated size with the first set size and the second set size, and determines the activity level of each sperm. If the size of the migration path of the object in question is smaller than the first set size, the processor 150 does not determine the object in question as a sperm. If the size of the migration path of the object in question is larger than the first set size but smaller than the second set size, the processor 150 determines the object in question as a sperm, but determines it to be a stationary sperm because it is not active. If the size of the migration path of the object in question is greater than or equal to the second set size, the processor 150 determines the object in question as an active sperm. As a result, in step S506, the number of stationary sperm and the number of active sperm for the person being measured are calculated.

[0069] In step S507, the processor 150 identifies the area of ​​the migration path for each sperm, creates a rectangle surrounding that area, calculates the ratio of the width to the height of the rectangle, and then compares the calculated ratio with a set ratio to determine straight-line movement. The rectangle can be the smallest rectangle surrounding the area of ​​the migration path. The processor 150 determines that a sperm is a straight-moving sperm if the width to height ratio of the migration path of that sperm is greater than or equal to the set ratio. As a result, in step S507, the number of straight-moving sperm for the observer is calculated.

[0070] Then, through steps S506 and S507, the processor 150 determines the number of active sperm and the number of motility sperm of the person being measured, and also determines the number of stationary sperm, which are sperm that are neither motility nor active.

[0071] In step S508, the processor 150 uses the number of stopped sperm, the number of active sperm, and the number of migrating sperm to calculate at least one of the sperm activity value, migrating value, and activation rate for the subject in question as test results, and outputs the generated test results through the output unit 120. Here, the test results include the number of sperm, sperm activity, sperm migrating, and the number of live sperm determined through sperm migrating and activity, etc., as determined through ROI region assessment.

[0072] In Figure 6, the first migration pathway MC1 is judged to be a stopped sperm because its area is larger than the first set area but smaller than the second set area. The second and third migration pathways MC2 and MC3 are judged to be active sperm because their areas are sufficiently large, i.e., larger than the second set area. The fourth migration pathway MC4 is not judged to be a sperm because its area is very small, i.e., smaller than the first set area.

[0073] In Figure 7, the first migration pathway MC1 consists of stationary sperm, and the fourth migration pathway MC4 does not consist of sperm; therefore, they are excluded from the assessment of straight-line progression.

[0074] Furthermore, the second migration pathway MC2 is judged to be a straight-moving sperm because the ratio of width (w) to height (h) that constitutes the smallest rectangle for the migration pathway MC2 is approximately 5:1 or greater. However, the third migration pathway MC3 is judged to be not straight-moving because the ratio of width (w) to height (h) that constitutes the smallest rectangle for the migration pathway MC3 is close to 1:1.

[0075] Figure 8 shows the results of a clinical video verification test according to an embodiment of the present invention. Figures 8(a) and (b) show the results measured by a nurse with the naked eye, the results obtained using a semen analysis algorithm used in a hospital, and the results obtained using a bodily fluid analysis method and apparatus according to an embodiment of the present invention. The total number is the number of sperm in the set area, and the converted number is the number of sperm obtained by converting the total number to the total area. The total time is the total time spent performing the semen analysis, and the calculation time is the tracker calculation time.

[0076] As can be seen in Figures 8(a) and (b), the activity and straight-line movement values ​​obtained using the fluid analysis method and apparatus are almost identical to the activity and straight-line movement values ​​obtained using the hospital algorithm.

[0077] However, the tracker calculation time was significantly faster when using the present invention, at 5.24 seconds or 6.02 seconds compared to 58.32 or 58.29 seconds when using the hospital algorithm. As a result, the total calculation time was also significantly faster when using the present invention, at 27.6 seconds or 31.02 seconds compared to 101.82 seconds or 75.22 seconds when using the hospital algorithm.

[0078] The technical features disclosed in each embodiment of the present invention are not limited to the respective embodiment, and as long as they are not incompatible with each other, the technical features disclosed in each embodiment can be combined and applied to different embodiments.

[0079] Therefore, while each embodiment will be described primarily based on its respective technical features, as long as the technical features are not mutually incompatible, they can be combined and applied to one another.

[0080] The present invention is not limited to the embodiments described above and the accompanying drawings, and various modifications and variations are possible from the perspective of those with ordinary skill in the art to which the invention pertains. Therefore, the scope of the present invention should be defined not only by the claims herein but also by equivalents thereof.

Claims

1. A method for performing a body fluid test using a body fluid testing device, The steps include: identifying the ROI region for each sperm in each of the set n video frames; The steps include reducing the brightness of each of the n video frames to a set value, The steps include creating a single cumulative video frame by accumulating the images of each sperm within the aforementioned n video frames, The steps include: identifying the region of the migration path for each sperm in the cumulative video frame; The steps include calculating the size of the migration path area for each sperm and determining its activity based on the calculated size, A method comprising the steps of: calculating the ratio of the width to the height of the rectangle surrounding the region of the migration path for each of the aforementioned sperm; and determining the straightness of migration based on the calculated width-to-height ratio.

2. In the method according to claim 1, A method further comprising the step of performing a preprocessing operation to adjust the brightness and contrast ratio for each of the n video frames.

3. In the method according to claim 1, The method is such that the set value is (1 / n) times.

4. In the method according to claim 1, The step of determining the activity is a method in which, if the calculated area is smaller than the first set area, it is not recognized as sperm; if the calculated area is larger than the first set area and smaller than the second set area, it is determined to be a stopped sperm; and if the calculated area is equal to or greater than the second set area, it is determined to be an active sperm.

5. In the method according to claim 4, The step of determining straightness is a method in which a sperm is determined to be straight-moving if the calculated ratio of width to length is equal to or greater than a set ratio.

6. In the method according to claim 5, A method further comprising the step of calculating the activity and motility values ​​for the sperm of the person being measured, using the number of stopped sperm, the number of active sperm, and the number of progressive sperm.

7. A body fluid testing device that performs body fluid testing, memory, and A processor connected to the memory and configured to execute instructions contained in the memory, The processor is configured to perform each step of the method according to any one of claims 1 to 6.

8. In the apparatus according to claim 7, The aforementioned processor, An apparatus configured to further perform the step of performing a pre-processing operation for noise reduction on each sperm in each of the n video frames.

9. In the apparatus according to claim 7 or claim 8, The apparatus further includes a shooting unit that photographs a subject and saves the captured image to the memory.

10. In the apparatus according to claim 9, The apparatus further includes a chamber for storing semen samples collected from individuals.

11. In the apparatus according to claim 10, The apparatus is configured such that the imaging unit is used to image a semen sample stored in the chamber.

12. In the apparatus according to claim 7, The aforementioned processor, The apparatus is configured to further perform the step of calculating the activity and motility values ​​for the sperm of the person being measured, using the number of stopped sperm, the number of active sperm, and the number of progressive sperm.

13. In the apparatus according to claim 7, The aforementioned setting value is (1 / n) items in the device.

Images