INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, MEASURING SYSTEM AND NON-TRANSITIOUS STORAGE MEDIUM

Description

BACKGROUNDTechnical Field

[0001] The present disclosure relates to an information processing device, an information processing method, a measurement system, and a non-transitory storage medium.

[0002] A urinary sediment examination is one example of a method in which material components contained in a sample solution are measured. A urinary sediment examination is an examination performed to investigate the amount and types of material components present in urine. In a urinary sediment examination, the content of each type of material component present in urine is investigated. In a urinary sediment examination, evaluation is performed based on measurements taken in a microscopic examination (standard method) using counts of material components present in a whole visual field (the range visible at any one time when viewed through a microscope). As an example of determination criteria, 0 to 4 red blood cells and 0 to 4 white blood cells in a whole visual field are determined to be normal. The whole visual field employed in evaluation varies according to the type of material components, and strong magnification (400×) or weak magnification (100×) may be employed. It is recommended to use 20 visual fields using an eyepiece lens having a magnification of 10×.

[0003] Progress is being made to automate such urinary sediment examinations (also referred to hereafter as "urinary material component examinations"). Broadly speaking, three methods are employed therefor: (1) observation and image capture of static samples using a microscope, (2) image capture using a flow method, and (3) scattergram analysis using a flow method.

[0004] For example, a method to display ultrafine particles is described in Japanese Patent Application Publication (JP-B) No. H03-41783. In this method a dilute biological liquid test sample containing ultrafine particles in a static state is not subjected to a physical concentration method such as centrifugal separation or the like, and instead the ultrafine particles are electronically concentrated. This method includes a step of distributing the liquid test sample over a wide area such that there is substantially no overlap between particles, and a step of forming plural still optical images of the liquid test sample to cover a plane of this area such that each of the still optical images represents a different location within this area. This method further includes a step of converting each of the still optical images into respective electronic images, and a step of combining images representing different particles from these electronic images to form a single composite electronic image. This method also includes a step of removing unnecessary image portions from the composite electronic image, or of processing the composite electronic image to extract useful image portions therefrom, and a step of displaying the processed composite electronic image as an image of the electronically concentrated ultrafine particles. Note that the method described in JP-B No. H03-41783 is technology relating to observation of a static sample using a microscope, as in method (1) above.

[0005] In image capture using a flow method as in method (2) above, images are captured of a test sample flowing through a flow cell, and material component images extracted from the captured images are categorized by material component type and examined. Image capture using a flow method does not allow the observation visual field to be moved or the magnification ratio to be changed while observing a sample, as is possible when observing a static sample through a microscope. Moreover, since the material component images extracted from the captured images are employed in analysis, the captured images themselves are not retained. Since an image of a static sample observed through a microscope includes various types of material components, there is accordingly a desire to view an image including plural material components even when image capture is performed using a flow method in order to enable the distribution of the material components and states of the material components to be observed at a glance.

[0006] Further background art is provided in WO 2014 / 145983 A1, EP 2 290 350 A1 and EP 3 279 657 A1.

[0007] WO 2014 / 145983 A1 discloses a method for imaging a plurality of particles using a particle analysis system configured for combined viscosity and geometric hydrofocusing, the particles included in a blood fluid sample having a sample fluid viscosity, the method comprising: flowing a sheath fluid along a flowpath of a flowcell, the sheath fluid having a sheath fluid viscosity that differs from the sample fluid viscosity by a viscosity difference in a predetermined viscosity difference range; injecting the blood fluid sample into the flowing sheath fluid within the flowcell so as to provide a sample fluid stream enveloped by the sheath fluid; flowing the sample fluid stream and the sheath fluid through a reduction in flowpath size toward an imaging site, such that a viscosity hydrofocusing effect induced by an interaction between the sheath fluid and the sample fluid stream associated with the viscosity difference, in combination with a geometric hydrofocusing effect induced by an interaction between the sheath fluid and the sample fluid stream associated with the reduction in flowpath size, is effective to provide a target imaging state in at least some of the plurality of particles at the imaging site while a viscosity agent in the sheath fluid retains viability of cells in the sample fluid stream leaving structure and content of the cells intact when the cells extend from the sample fluid stream into the flowing sheath fluid; and imaging the plurality of particles at the imaging site.

[0008] EP 2 290 350 A1 discloses a particle image analyzing method comprising: detecting particles flowing through a flow cell; determining from a particle detection signal obtained whether desired particles are to be imaged, and then acquiring images of the desired particles; storing an acquired overall image of a sample into an overall-image memory; extracting particle components contained in the sample, and the number of the particles, from the acquired overall image of the sample; analyzing the extracted particle components in accordance with feature parameters, then after classifying the particle components according to the kind of component, computing respective concentrations of the classified components, and storing the classified components with the computed concentrations into a cropped image memory; displaying on display means the overall image stored in the overall-image memory; and in accordance with to-be-added or to-be-changed particle component information entered from operating means, conducting modifications and concentration-modifying computations upon the components stored in the cropped image memory.

[0009] EP 3 279 657 A1 discloses a urine analysis system comprising: a testing apparatus that measures particles included in a urine sample according to a flow cytometry method; an image capturing apparatus that captures images of particles in the urine sample to acquire cell images; and a management apparatus that receives a measurement result obtained by the testing apparatus and the cell images acquired by the image capturing apparatus. The management apparatus generates an image capturing order for the urine sample based on the measurement result obtained by the testing apparatus. The image capturing apparatus executes the image capturing processing of the particles in the urine sample for which the image capturing order has been generated by the management apparatus, and transmits the acquired cell images to the management apparatus.SUMMARY

[0010] In consideration of the above circumstances, the present invention is as defined in the appended claims, and provides an information processing device, an information processing method, a measurement system, and a non-transitory storage medium capable of obtaining an image including plural material components such as that observed through a microscope, even in cases in which image capture is performed using a flow method.BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Exemplary embodiments of the present invention will be described in detail based on the following figures, wherein: Fig. 1 is a perspective view illustrating part of a configuration of a measurement system; Fig. 2 is a schematic diagram illustrating an example of a configuration of a measurement system; Fig. 3 is a block diagram illustrating an example of an electrical configuration of an information processing device; Fig. 4 is a block diagram illustrating an example of a functional configuration of an information processing device; Fig. 5 is a graph illustrating one example of a calibration curve as employed for each material component; Fig. 6 is a face-on view illustrating an example of an all-component image screen; Fig. 7 is a diagram illustrating an example of an item button array; Fig. 8 is a flowchart illustrating an example of a flow of processing of an image processing program; Fig. 9 is a face-on view illustrating an example of a material component image list screen; Fig. 10 is a face-on view illustrating an example of a measurement result screen; and Fig. 11 is a diagram to explain a process for generating an all-component image. DETAILED DESCRIPTION

[0012] Detailed explanation follows regarding an example of an exemplary embodiment of the present disclosure, with reference to the drawings.

[0013] Fig. 1 is a perspective view illustrating part of a configuration of a measurement system 70.

[0014] As illustrated in Fig. 1, the measurement system 70 according to the present exemplary embodiment includes a flow cell 40, casing 72, a camera 74, and a light source 76. Note that the arrow UP in Fig. 1 indicates upward in a vertical direction of the measurement system 70.

[0015] The flow cell 40 is, for example, applicable to urinary material component examinations (urinary sediment examinations) in which a urine sample serving as an example of a sample fluid is introduced together with a sheath fluid in order to capture images of material components in the urine sample using the camera 74 and to perform various analyses based on the shapes etc. of the material components in the captured image. The camera 74 is an example of an imaging section. Although explanation follows regarding an example in which a urine sample is not in a concentrated state, a concentrated sample may also be employed therefor. Plural types of material components (solid components) are contained in the urine sample. Examples of types of material components include red blood cells, white blood cells, epithelial cells, casts, bacteria, and the like. Note that although a case is described in which a urine sample serving as an example of a sample fluid is used to perform a urinary material component examination, blood, cells, bodily fluids, or the like may also be employed for material component examination.

[0016] The measurement system 70 includes the casing 72 to place the flow cell 40 in. A recess 72A for inserting the flow cell 40 into is formed in the casing 72. A position of the casing 72 that includes where the recess 72A is provided is formed by a transparent member (for example glass). The camera 74 is provided inside the casing 72 at a position facing toward the flow cell 40. The light source 76 is provided at the upper side of the casing 72, at a position facing toward the camera 74 across the flow cell 40. The camera 74 is disposed at a position that enables the sample fluid flowing through the flow cell 40 to be imaged.

[0017] The measurement system 70 includes a first supply device 78 to supply the sample fluid into a sample intake port 42 of a sample flow path (not illustrated in the drawings) in the flow cell 40. The first supply device 78 includes a supply tube 80 having one end connected to the sample intake port 42, a pump 82 provided partway along the supply tube 80, and a sample storage section 84 for storing the sample fluid in that is connected to the other end of the supply tube 80.

[0018] The measurement system 70 includes a second supply device 86 to supply the sheath fluid into a sheath intake port 44 of a sheath flow path (not illustrated in the drawings) in the flow cell 40. The second supply device 86 includes a supply tube 88 having one end connected to the sheath intake port 44, a pump 90 provided partway along the supply tube 88, and a tank 92 for storing the sheath fluid in that is connected to the other end of the supply tube 88.

[0019] A discharge port 46 is also provided to the flow cell 40 between the sample intake port 42 and the sheath intake port 44. One end of a discharge tube (not illustrated in the drawings) is connected to the sheath intake port 46, and the other end of the discharge tube is connected to a waste tank (not illustrated in the drawings). The flow cell 40 includes a merging section (not illustrated in the drawings) to merge the sample introduced through the sample intake port 42 with the sheath fluid introduced through the sheath intake port 44, and the merged fluid flows through a flow path. A tapered section is formed in the flow path where the height of the flow path gradually decreases. The sample therefore does not disperse in the sheath fluid even after the sample has merged with the sheath fluid, and instead the flow is localized to a flattened shape. The material components in the localized sample fluid are imaged by the camera 74.

[0020] Fig. 2 is a schematic diagram illustrating an example of a configuration of the measurement system 70.

[0021] As illustrated in Fig. 2, the measurement system 70 includes an information processing device 10. Note that the arrow UP in Fig. 2 indicates upward in the vertical direction of the measurement system 70, similarly to in Fig. 1.

[0022] The information processing device 10 includes the functionality of a control device to control the respective operations of the camera 74, a light source actuation section 77 electrically connected to the light source 76, the pump 82, and the pump 90. The information processing device 10 applies a pulse signal to the light source actuation section 77 so as to cause the light source 76 to emit light at a predetermined interval. The information processing device 10 drives the pump 82 to control the flow rate of the sample fluid, and drives the pump 90 to control the flow rate of the sheath fluid.

[0023] Fig. 3 is a block diagram illustrating an example of an electrical configuration of the information processing device 10.

[0024] As illustrated in Fig. 3, the information processing device 10 includes a control section 12, a storage section 14, a display section 16, an operation section 18, and a communication section 20.

[0025] For example, a generic computer such as a personal computer (PC) is employed as the information processing device 10. Note that a mobile computer such as a smartphone, tablet, or the like may also be employed as the information processing device 10. The information processing device 10 may also be split between plural units. For example, the information processing device 10 may be configured so as to include a unit for controlling a measurement system composed of the camera 74, the light source 76, the pump 82, the pump 90 etc., and to include a unit to perform processing and analysis on images captured by the camera 74. The information processing device 10 may be an external device connected to the measurement system 70.

[0026] The control section 12 includes a central processing unit (CPU) 12A, read only memory (ROM) 12B, random access memory (RAM) 12C, and an input / output interface (I / O) 12D. These sections are connected together through a bus.

[0027] Each of the functional sections including the storage section 14, the display section 16, the operation section 18, and the communication section 20 are connected to the I / O 12D. These functional sections are capable of communicating with the CPU 12A through the I / O 12D.

[0028] The control section 12 may be configured as a sub-control section to control the operation of parts of the information processing device 10, or may be configured as part of a main control section to control overall operation of the information processing device 10. For example, large scale integrated (LSI) circuits or integrated circuit (IC) chip sets are employed for some or all of the respective blocks of the control section 12. A separate circuit may be employed for each block, or circuits integrating together some or all of the blocks may be employed. The respective blocks may be provided so as to be integrated together, or some of the blocks may be provided separately. Alternatively, parts of the respective blocks may be provided separately. Integration of the control section 12 is not limited to integration employing LSIs, and dedicated circuits or generic processors may also be employed therefor.

[0029] Examples of the storage section 14 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. An image processing program 14A to perform processing for all-component image generation is stored in the storage section 14. Note that the image processing program 14A may alternatively be stored in the ROM 12B. The storage section 14 is also stored with a material component image set 14B for use in the all-component image generation processing. Note that the storage section 14 may have external memory attached that is expanded later.

[0030] The image processing program 14A may, for example, be pre-installed in the information processing device 10. The image processing program 14A may be stored on a non-volatile storage medium, or may be implemented by being distributed via a network and installed or uploaded to the information processing device 10 as appropriate. Note that examples of non-volatile storage media include compact disc read only memory (CD-ROM), a magneto-optical disc, an HDD, digital versatile disc read only memory (DVD-ROM), flash memory, a memory card, and so on.

[0031] For example, a liquid crystal display (LCD) or an organic electro luminescence (EL) display may be employed as the display section 16. The display section 16 may include an integral touch panel. A device for operation input, such a keyboard or a mouse, may be provided to the operation section 18. The display section 16 and the operation section 18 receive various instructions from a user of the information processing device 10. The display section 16 displays various information, such as the result of processing executed in response to an instruction received from the user and notifications relating to processing.

[0032] The communication section 20 is connected to a network such as the internet, a local area network (LAN), or a wide area network (WAN), and is capable of communicating over the network with external devices such as an image forming device or another PC.

[0033] When performing image capture using a flow method employing the flow cell 40 as described above, images of the sample fluid flowing through the flow cell 40 are captured, and anything identified as a material component is extracted from the captured images. These extracted images of material components are categorized by material component type, and examined. This accordingly means that an all-component image resembling an observation through a microscope is not obtainable. There is accordingly a desire to view an all-component image including plural material components even when image capture is performed using a flow method, in order to enable the distribution of the material components and states of the plural material components to be observed at a glance in such an all-component image.

[0034] The CPU 12A of the information processing device 10 functions as the respective sections illustrated in Fig. 4 by writing the image processing program 14A stored in the storage section 14 into the RAM 12C and executing the image processing program 14A.

[0035] Fig. 4 is a block diagram illustrating an example of a functional configuration of the information processing device 10.

[0036] As illustrated in Fig. 4, the CPU 12A of the information processing device 10 functions as a categorizing section 30, a count derivation section 32, a generation section 34, a display control section 36, and a setting section 38. Note that the display control section 36 is an example of a control section.

[0037] The categorizing section 30 takes plural images (for example 300 or 1000 images) obtained by the camera 74 imaging the sample fluid flowing through the flow cell 40, and from the plural images, extracts material component images of the plural types of material component contained in a sample fluid. The categorizing section 30 then categorizes the extracted material component images into predetermined categories (for example by the type, size, or shape of the material components, or by the presence or absence of a nucleus therein). The material component images categorized into the predetermined categories by the categorizing section 30 are stored in the storage section 14 as a material component image set 14B for each sample. Note that various known methods may be employed as the method for identifying material components in the images, such as a method employing machine learning or a method employing pattern matching. The material component image set 14B is also referred to as the material component images 14B when referring to individual material component images within the material component image set 14B.

[0038] The count derivation section 32 derives counts by category for material components contained in the sample fluid, and counts of material components present per standard visual field, based on the number of material component images categorized into each category by the categorizing section 30. Specifically, for each of the predetermined categories, the count derivation section 32 uses a calibration curve to convert the number of material component images acquired from a single sample measurement into counts per unit liquid volume of the sample fluid. Counts per standard visual field are then derived from the thus converted counts per unit liquid volume by using a predetermined correction coefficient for each visual field. Note that reference to calibration curves also encompasses functions, and data expressing correlations such as conversion coefficients, conversion tables, etc.

[0039] Fig. 5 is a graph illustrating an example of a calibration curve as employed for each material component.

[0040] In Fig. 5, the horizontal axis represents the count of material components actually identified in a single sample measurement, and the vertical axis represents the count of material components per unit liquid volume of the sample fluid. Note that a calibration curve for red blood cells is illustrated as a representative example.

[0041] The camera 74 is not actually capable of imaging all of the sample fluid when the sample fluid flows through the flow cell 40. A sample amount imageable by the camera 74 is accordingly ascertained. The imageable sample amount is determined using a control liquid containing standard particles. For example, if 500 standard particles are captured in plural images imaged by the camera 74 when 1 µl of a control liquid containing 2000 standard particles per µl flows through the flow cell 40, then the sample amount imageable by this measurement system is determined to be 0.25 µl, or in other words a sample amount corresponding to 25% of the sample amount that flowed.

[0042] The differing size, shape, composition, outline definition, and the like for each type of material component results in differences in the ease (rate) of flowing through an imaging area of the camera 74, the ease with which the camera 74 can be focused thereon, and the ease with which the material components can be identified in the captured images. There is accordingly a difference by category in the rate with which the material components are captured as extracted images.

[0043] In consideration of the above points, a calibration curve expressed by a function y = f(x) is created so as to reflect the imageable sample amount and the capture rate for each category. The calibration curve illustrated in Fig. 5 is a graph representing a relationship between red blood cell counts (measured values) actually identified in plural images captured by the camera 74, and red blood cell counts contained per unit liquid volume. The graph expressing this calibration curve is created based on actual measurement results obtained and on accurate count data for the corresponding material component as measured using another method. In addition to red blood cells, such calibration curves are also created for the other categories, namely white blood cells, epithelial cells, casts, bacteria, and the like. Note that data of the calibration curves created is stored in advance in the storage section 14 for reference by the count derivation section 32. The calibration curves are used to acquire counts of material components contained per unit liquid volume (for example per 1 µl) of the sample from the number of material component images.

[0044] Predetermined correction coefficients for respective visual fields are then used to derive the counts per standard visual field for material components of each category from the counts per unit liquid volume obtained for each category. Here, a "visual field" refers to the range that can be seen at any one time through a microscope using, for example, a high power field (HPF: strong magnification ratio equivalent to 400×) or a low power field (LPF: weak magnification ratio equivalent to 100×) for microscopic examination (standard method). The correction coefficient is decided based on the surface area of the standard visual field, as well as the placement of the sample at the imaging location, the concentration multiplier, and the urine sample volume. α is the correction coefficient for HPF, and β is the correction coefficient for LPF. The correction coefficient α is set based on the relationship between the imaging range captured by the camera 74 and that for an HPF, and the correction coefficient β is set based on the relationship between the imaging range captured by the camera 74 and that for an LPF. The correction coefficients α, β are stored in advance in the storage section 14. Note that N α and N β are computed using the following Equations (1) and (2), wherein N α is a count for an HPF, N β is a count for an LPF, and N u is a count per unit liquid volume. Note that N u is different for each category. N α = α × N u N β = β × N u

[0045] Explanation follows regarding specific examples in which HPF and LPF counts are derived for red blood cells, white blood cells, and bacteria. For example, if the actual red blood cell count measured is 10, then the calibration curve for red blood cells is employed to convert this count into a count of 15 / µl. Then Equation (1) and Equation (2) are used to derive counts of (α × 15) / HPF and (β × 15) / LPF. Moreover, if the actual white blood cell count measured is 15, the calibration curve for white blood cells is employed to convert this count into a count of 20 / µl, and then Equation (1) and Equation (2) are used to derive counts of (α × 20) / HPF and (β × 20) / LPF. Moreover, if the actual bacteria count measured is 20, the calibration curve for bacteria is employed to convert to this count into a count of 400 / µl, and then Equation (1) and Equation (2) are used to derive counts of (α × 400) / HPF and (β × 400) / LPF. Note that the standard visual field may also employ a visual field with a magnification ratio other than that of HPF or LPF, and a user may set a desired standard visual field size.

[0046] Next, the generation section 34 generates a single all-component image in which plural material component images corresponding to the counts for each category per standard visual field, as derived by the count derivation section 32, are randomly arranged in an area corresponding to the standard visual field. When this is performed, the plural material component images are preferably arranged such that they do not overlap each other. The background color often differs between each of these plural material component images, and this could result in an unnatural looking all-component image. In order to reduce any such unnaturalness in the all-component image the plural material component images are preferably adjusted to a uniform color tone. This color tone may, for example, be set as any one out of an average value, a maximum value, or a minimum value of pixel values representing the background colors of the plural material component images. Moreover, images in which the material component images are in focus are preferably employed therefor. The all-component image is a pseudo image generated by arranging material component images, which have been obtained by categorizing the images extracted from the captured images by material component, according to the respective quantities thereof contained in the sample fluid. For example, in a case in which the standard visual field is set to HPF (equivalent to 400×), the generated all-component image is an image equivalent to an image with a 400× magnification ratio as observed in a microscopic examination (standard method).

[0047] Next, as an example, the display control section 36 controls so as to display the all-component image generated by the generation section 34, as illustrated in Fig. 6.

[0048] Fig. 6 is a face-on view illustrating an example of an all-component image screen 50.

[0049] As illustrated in Fig. 6, the all-component image screen 50 displays the all-component image in which the material component images 14B are arranged according to the counts per category, as described above. The all-component image screen 50 is displayed on the display section 16. Although an example is described above in which the all-component image is created for the counts contained in a standard visual field, the all-component image may be created for a desired setting for the liquid volume and image size based on the respective counts contained per unit liquid volume of the sample, or the all-component image may be created for a unit liquid volume based thereon. Moreover, a display mode may be selected or changed by a user. In cases in which an all-component image is created for a unit liquid volume, the user is able to set or change the unit liquid volume to the desired unit liquid volume.

[0050] The display control section 36 may perform control so as to selectively display only specific material component images contained in the all-component image. Such control of display may, for example, be performed by selecting an item button corresponding to the specific material component image from an item button array 51, illustrated in Fig. 7.

[0051] Fig. 7 is a diagram illustrating an example of the item button array 51.

[0052] As illustrated in Fig. 7, the item button array 51 is displayed on the display section 16 together with the all-component image of the all-component image screen 50. The item button array 51 includes item buttons 51A, 51B, 51C, etc. corresponding to each of the material components.

[0053] As an example, the item button array 51 illustrated in Fig. 7 includes an item button 51A corresponding to red blood cells, an item button 51B corresponding to white blood cells, an item button 51C corresponding to casts, and so on. For example, when the item button 51A has been selected, only images of red blood cells are selectively displayed on the all-component image screen 50 illustrated in Fig. 6, and the other material components are not displayed. Similarly, when the item button 51B has been selected, images of only white blood cells are selectively displayed on the all-component image screen 50 illustrated in Fig. 6, and the other material components are not displayed. Moreover, configuration may be made such that when plural item buttons in the item button array 51 have been selected, the plural selected material components are displayed, and other material components are not displayed.

[0054] The display control section 36 is configured to perform control to change a display settings mode in which, for example, the item button array 51 illustrated in Fig. 7 is operated to select material components that are not of interest (components not of interest) from among the plural material component images contained in the all-component image, so that the material component images that are components selected as not of interest are not displayed. The display control section 36 is configured to perform control such that a number of images exceeding an upper limit value are not displayed for material component images of images that are not of interest. As another example, material component images corresponding to item buttons that were not selected from the item button array 51 illustrated in Fig. 7 may be determined to be not of interest. Note that the upper limit value is set in advance for each of the material components. For example, in a case in which an upper limit value of 30 has been set for material component images representing white blood cells, then in a case in which 40 material component images representing white blood cells would be displayed in the all-component image if white blood cells have not been selected as not being of interest, the display control section 36 may perform control such that up to 30 of the material component images representing white blood cells are displayed but the 31 st< image onward thereof are not displayed, or such that none of the material component images representing white blood cells are displayed, when white blood cells are not of interest. This enables a reduction in the number of material component images that are not of interest which are displayed, enabling greater emphasis to be placed on the material component images that are of interest.

[0055] Next, the setting section 38 sets an upper limit for the number of material component images for each category to be stored in the storage section 14 from out of the material component images categorized by the categorizing section 30. Note that this upper limit number may be modified as appropriate. For example configuration may be made such that even if 100 instances of a particular material component have been counted, the number stored as images is 30. If all the material component images for all the material components that had been counted were to be stored then the storage capacity of the storage section 14 might rapidly become insufficient therefor. It is thus desirable to store only the required number of the required material component images in each sample. Although such an approach could potentially lead to there being insufficient material component images to generate the all-component image, the ability to adjust the number of images stored by category in this manner would enable such issues to be addressed by measures such as increasing the number of images to be stored for material components that are of interest.

[0056] In cases in which the number of material component images for each category that are to be disposed as part of the all-component image exceeds the upper limit for the number of images stored in the storage section 14, the generation section 34 is configured so as to duplicate material component images from out of the material component images stored in the storage section 14 so as to acquire material component images to make up the excess amount. Namely, in cases in which there are insufficient material component images, duplicates of the material component images stored in the storage section 14 are employed. Such cases include not only configurations in which simple duplication is performed, but also configurations in which processing is performed to rotate the orientation of such images, or enlarge or shrink such images.

[0057] Explanation follows regarding operation of the information processing device 10, with reference to Fig. 8.

[0058] Fig. 8 is a flowchart illustrating an example of a flow of processing by the image processing program 14A.

[0059] First, each of the following steps is executed when the information processing device 10 receives an instruction to start all-component image display processing.

[0060] At step 100 in Fig. 8, the categorizing section 30 extracts material component images identified as each of the respective plural types of material components from the plural images acquired by imaging the sample fluid flowing through the flow cell 40 using the camera 74. The material component images thus extracted are then categorized by category (for example, by material component type). The material component images that have been categorized by category by the categorizing section 30 are then stored in the storage section 14 as the material component image set 14B.

[0061] At step 102, the count derivation section 32 derives for each category a count for the material components for a standard visual field or a count for the material components per unit liquid volume contained in the sample fluid, based on the numbers of material component images in each category as categorized at step 100. Specifically, as an example, the number of material component images are converted into the counts per unit liquid volume by employing a calibration curve such as that illustrated in Fig. 5. For example, the Equation (1) and Equation (2) described above are employed to derive the counts for a standard visual field from the converted counts per unit liquid volume.

[0062] At step 104, the generation section 34 generates the all-component image by arranging the plural material component images so as not to overlap with each other, in numbers according to the counts per category derived at step 102.

[0063] At step 106, as an example the display control section 36 performs control to display the all-component image generated at step 104 as illustrated in Fig. 6, and the sequence of processing by the image processing program 14Ais then ended.

[0064] Next, explanation follows regarding an example of a material component image list screen and a measurement result screen, with reference to Fig. 9 and Fig. 10.

[0065] Fig. 9 is a face-on view illustrating an example of a material component image list screen 52.

[0066] As illustrated in Fig. 9, the material component image list screen 52 is a display of the material component images 14B by category. The material component image list screen 52 is displayed on the display section 16.

[0067] Namely, as described above, the material component images categorized into each category by the categorizing section 30 are stored in the storage section 14 as the material component image set 14B. For example, when an operator wants to check the material component images for red blood cells, the operator selects a predetermined operation button (not illustrated in the drawings) to instruct the material component images 14B for red blood cells to be read from the storage section 14 and displayed as the material component image list screen 52. Note that the material component image list screen 52 is similarly displayable for material components other than red blood cells, for example white blood cells and bacteria.

[0068] Fig. 10 is a face-on view illustrating an example of a measurement result screen 54.

[0069] As illustrated in Fig. 10, the measurement result screen 54 is a display of a measurement results table, together with an operation button 54A for displaying an all-component image. The measurement results shown include a contained amount or count for a standard visual field (HPF) as computed by the count derivation section 32, a contained amount or count per unit liquid volume as computed thereby, and qualitative indices for contained amounts.

[0070] Main items among the items illustrated in Fig. 10 include, for example, RBC (red blood cells), WBC (white blood cells), NSE (non-squamous epithelial cells), SQEC (squamous epithelial cells), NHC (non-hyaline casts), and BACT (bacteria). Moreover, CRYS (crystals), YST (yeast), HYST (hyaline casts), MUCS (mucus), SPRM (spermatozoa), and WBCC (white blood cell clumps) are also illustrated.

[0071] The operation button 54A is a button labeled "VIEW ALL-COMPONENT IMAGE". When the operator selects the operation button 54A, as an example, the all-component image screen 50 illustrated in Fig. 6 described above is displayed.

[0072] Fig. 11 is a diagram to explain a process for generating the all-component image.

[0073] As illustrated at the top of Fig. 11, plural of the material component images 14B are arranged according to the counts for each category so as to obtain an image 56.

[0074] As illustrated at the bottom of Fig. 11, the color tones of background colors and the like of each of the material component images 14B are adjusted in the image 56 so as to generate a single natural-looking all-component image 58. The red blood cells, white blood cells, bacteria, casts, etc. serving as examples of material components are included in the all-component image 58 in numbers thereof similar to how they would appear if observed through a microscope.

[0075] Counts for material components imaged by the camera are derived per standard visual field for each category. This enables an all-component image with a feel similar to that of a microscope observation to be observed, even in cases in which image capture is performed using a flow method. Moreover, the ability to observe a screen displaying plural categorized elements imaged by the camera facilitates common properties and shapes (swollen, shriveled, etc.) to be ascertained in the plural material components, which would be more difficult to spot in individual extracted images.

[0076] Explanation has been given regarding an example of an information processing device according to an exemplary embodiment. The present exemplary embodiment may be provided in the format of a program configured to cause a computer to execute the functions with which the respective sections of the information processing device are equipped. The present exemplary embodiment may be provided in the format of a computer-readable storage medium stored with such a program.

[0077] Configurations of the information processing device described in the above exemplary embodiment are moreover merely examples thereof, and may be modified according to circumstances without departing from the scope of the present invention as defined in the appended claims.

[0078] The processing flow of the program described in the above exemplary embodiment is moreover also merely an example thereof, and steps not required may be omitted, new steps may be added, or the processing sequence may be altered without departing from the scope of the present invention as defined in the appended claims.

[0079] Although explanation in the above exemplary embodiment is regarding a case in which execution of the program results in the processing of the present exemplary embodiment being implemented by a software configuration employing a computer, there is no limitation thereto. For example, an exemplary embodiment may be implemented by a hardware configuration, or by a combination of a hardware configuration and a software configuration.

Claims

1. An information processing device (10) for examining images taken from a biological sample, the information processing device (10) comprising: a categorizing section (30) configured to: receive a plurality of images obtained by imaging a sample fluid using a camera (74) whilst the sample fluid is flowing through a flow cell (40), the sample fluid containing a plurality of types of material components; identify, from the plurality of images, a material component image set; extract, from the plurality of images, the identified material component images; and categorize the extracted material component images into predetermined categories, wherein the categorization is by at least one of: type, size, shape of material components, or presence of a nucleus; a storage section (14) configured to store the extracted material component images categorized by the categorizing section (30); a count derivation section (32) configured to compute a count of the material component in a visual field dependent on a magnification ratio, or compute a count per unit liquid volume of the material component contained in the flowing sample fluid, for each predetermined category based on the number of material component images categorized by the categorizing section (30); a generation section (34) configured to generate an image in which stored material component images are displayed, the displayed material component images being arranged such that they do not overlap with each other, and in numbers according to the counts that have been computed by the count derivation section (32) for each predetermined category, in an area corresponding to the visual field; and a setting section (38) configured to set an upper limit, for each of the categories, for a number of the material component images among the material component images that have been categorized by the categorizing section (30), to be stored in the storage section (14); wherein the upper limit number of material component images stored is adjustable by category of material component; and wherein the generation section (34) is configured to duplicate material component images stored in the storage section (14) in a case in which a number of material component images for each predetermined category to be displayed as part of the generated image exceeds the upper limit so as to acquire material component images for the amount by which the upper limit is exceeded.

2. The information processing device of claim 1, wherein the count derivation section (32) is configured to use a predetermined calibration curve for each predetermined category to convert a number of the material component images into a resulting count per unit liquid volume of the flowing sample fluid, and to use a predetermined correction coefficient to compute a count in the visual field from the resulting count per unit liquid volume.

3. The information processing device of claim 1, wherein the generation section (34) is configured to adjust a background color of each of the displayed material component images to a uniform color tone.

4. The information processing device of claim 3, wherein the color tone is determined by one out of an average value, a maximum value, or a minimum value of pixel values representing the background color in each of the displayed material component images.

5. The information processing device of any one of claims 1 to 4, further comprising: a control section (36) configured to perform control to display the image that has been generated by the generation section (34); wherein the control section (36) is configured to perform control to selectively display only specific material component images included in the generated image.

6. The information processing device of claim 5, wherein the control section (36) is further configured to perform control so as to not display any material component image selected among the at least some material component images included in the generated image, or to not display a number of images exceeding an upper limit value for material component images selected.

7. An information processing method for examining images taken from a biological sample, the method comprising: receiving a plurality of images obtained by imaging a sample fluid using a camera (74) whilst the sample fluid is flowing through a flow cell (40), the sample fluid containing a plurality of types of material components; identifying, from the plurality of images, a material component image set; extracting, from the plurality of images, the identified material component images; categorizing the extracted material component images into predetermined categories, wherein the categorization is by at least one of: type, size, shape of material components, or presence of a nucleus; storing the extracted and categorized material component images; computing a count of the material component in a visual field dependent on a magnification ratio, or computing a count per unit liquid volume of the material component contained in the flowing sample fluid, for each predetermined category based on the number of categorized material component images; generating an image in which stored material component images are displayed, the displayed material component images being arranged such that they do not overlap with each other, and in numbers according to the counts that have been computed for each predetermined category, in an area corresponding to the visual field; and setting an upper limit, for each of the categories, for a number of the material component images among the material component images that have been categorized, to be stored; wherein the upper limit number of material component images stored is adjustable by category of material component; and wherein the generating duplicates stored material component images in a case in which a number of material component images for each predetermined category to be displayed as part of the generated image exceeds the upper limit so as to acquire material component images for the amount by which the upper limit is exceeded.

8. A measurement system (70) comprising: a flow cell (40) configured to allow a sheath fluid and a sample fluid that contains a plurality of types of material components to flow through; an imaging section (74) configured to image the sample fluid flowing through the flow cell (40); and the information processing device (10) of any one of claims 1 to 6 configured to receive a plurality of images obtained by imaging with the imaging section (74).

9. A non-transitory storage medium storing a program (14A) for causing a computer to execute the method of claim 7.