Information processing device, measurement system, and non-transitory storage medium

Abstract

The present invention provides an information processing device, a measuring system and a non-temporary storage medium. The information processing device (10) comprises: a classification unit (30) which cuts out a shaped component image identified as a shaped component from a plurality of images obtained by photographing a specimen fluid including a plurality of shaped components and flowing through a flow cell, and classifies the cut shaped component image into a detection component according to each predetermined classification; and a display control unit (32) which performs the following control: when the shaped component image classified as a detection component by the classification unit (30) is reclassified into a different classification, a selection of a classification of a moving destination is accepted while a first image list of the detection component is displayed, and a shaped component image selected from the first image list is moved to the second image list while the first image list and a second image list of the moving destination are displayed simultaneously.

Description

Technical Field

[0001] The present invention relates to an information processing device, a measuring system and a non-transitory storage medium. Background Art

[0002] For example, Patent Document 1 describes a method for analyzing particles from a fluid sample including particles. The method includes: a step of causing the liquid sample to flow through a flow cell so that the particles are distributed in an enlarged area without substantially overlapping other particles; and a step of forming a plurality of optical still images of the fluid sample in the area in such a manner that each optical image represents a portion of a different area. Furthermore, the method includes: a step of converting the optical still images into electronic images including images of particles; a step of extracting the images of the particles to synthesize the electronic images; and a step of displaying the images of the particles arranged in a certain order according to the level of visual recognition characteristics.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Publication No. 6-43948

[0006] According to the technique described in Patent Document 1, particle images are displayed in order of size, and the user can delete particle images that do not belong to a specific class. However, the deleted particle images are not classified into another specific class, and thus it is desired to improve classification accuracy.

[0007] In the image photography utilizing the flow method, an image of a sample flowing in a flow cell is photographed, and a formed component image cut out from the photographed image is classified for each type of formed component for inspection. At this time, sometimes a user such as an inspection engineer confirms the formed component image that has been automatically classified and manually reclassifies it. However, even in the case of manual reclassification, a display suitable for the reclassification process is not performed, and sometimes the image is incorrectly reclassified due to a user's misoperation. Summary of the invention

[0008] The present invention has been developed in view of the above-mentioned problems, and its purpose is to provide an information processing device, a measurement system and a non-temporary storage medium that can suppress erroneous operations in classification operations when reclassifying images of shaped components classified into each specified classification by image photography using streaming.

[0009] Means for solving problems

[0010] In order to achieve the above-mentioned purpose, the first mode of the information processing device of the present invention comprises: a classification unit, which cuts out a shaped component image identified as a shaped component from a plurality of images obtained by photographing a specimen fluid including a plurality of shaped components and flowing through a flow cell, and classifies the cut shaped component image into a detection component according to each specified classification; and a control unit, which performs the following control: when the shaped component image classified as the detection component by the classification unit is reclassified into a different classification, a selection of a classification of a moving destination is accepted while a first image list of shaped component images included in the classification of the detection component is displayed on a display unit, and further, while the first image list and a second image list of shaped component images included in the classification of the moving destination are simultaneously displayed on the display unit, the shaped component image selected from the first image list is moved to the second image list.

[0011] Furthermore, in the information processing device according to a second aspect of the present invention, in the first aspect, the control unit further performs control to highlight and display a tangible component image moved from the first image list to the second image list.

[0012] Furthermore, in the information processing device according to the third aspect of the present invention, in the second aspect, the control of the emphasized display is control of displaying the shaped component image at the head of the second image list.

[0013] Furthermore, in the information processing device of the fourth mode of the present invention, in the first mode, the classification is divided into at least one of a large project and a small project obtained by subdividing the large project, and the control unit further performs the following control: when selecting the classification of the mobile destination, if the large project is selected, the formed component image is displayed in an image list of formed component images included in the large project, and if the small project is selected, the formed component image is displayed in an image list of formed component images included in the small project.

[0014] Furthermore, in the information processing device according to a fifth aspect of the present invention, in the fourth aspect, the small item is selectable after the large item is selected.

[0015] Furthermore, in the information processing device of the sixth aspect of the present invention, in the first aspect, the control unit further performs the following control: for each formed component image in the first image list, a plurality of formed component images having different focal positions in the depth direction of the flow cell are switched for display.

[0016] Furthermore, in the information processing device according to a seventh aspect of the present invention, in the first aspect, the control unit further performs control to display items corresponding to each of the categories in different colors.

[0017] Furthermore, in the information processing device of the eighth mode of the present invention, in the first mode, the classification unit further calculates the fitness of the shaped component images with respect to the classification results, and the control unit further performs the following control: the shaped component images of the first image list are arranged and displayed in a suitable order or an unsuitable order according to the fitness.

[0018] Furthermore, in the information processing device of the 9th mode of the present invention, in the 1st mode, the control unit further performs the following control: the measurement results are displayed at a glance according to each of the categories, and for the categories in the displayed at a glance, for the categories in which the shaped component images are confirmed by displaying the first image list, a mark indicating that the confirmation is completed is assigned.

[0019] Furthermore, in the information processing device according to the tenth aspect of the present invention, in the first aspect, the control unit further performs control to set a magnification ratio of the formed component image when the first image list is displayed.

[0020] Furthermore, in the information processing device according to the 11th aspect of the present invention, in the 1st aspect, the control unit further performs control to set at least one of brightness and contrast of the formed component image when the first image list is displayed.

[0021] Furthermore, in the information processing device of the 12th mode of the present invention, in the 1st mode, the information processing device further includes a storage unit, which stores the formed component images classified by the classification unit and the sample images of the formed component images, and the control unit further performs the following control: when the formed component image classified as the detection component by the classification unit is added as the sample image of the same classification, while the formed component image list of the formed component images included in the classification of the detection component is displayed on the display unit, an instruction to display the sample image is accepted, and then, while the formed component image list and the sample image list of the sample images are simultaneously displayed on the display unit, the formed component image selected from the formed component image list is copied to the sample image list.

[0022] Furthermore, the information processing device of the 13th mode of the present invention comprises: a classification unit, which cuts out a shaped component image identified as a shaped component from a plurality of images obtained by photographing a specimen fluid including a plurality of shaped components and flowing through a flow cell, and classifies the cut shaped component image into a detection component according to each specified classification; a storage unit, which stores the shaped component image classified by the classification unit and a sample image of the shaped component image; and a control unit, which performs the following control: when the shaped component image classified as the detection component by the classification unit is added as the sample image of the same classification, while a shaped component image list of the shaped component images included in the classification of the detection component is displayed on the display unit, an instruction to display the sample image is accepted, and further, while the shaped component image list and the sample image list of the sample image are simultaneously displayed on the display unit, the shaped component image selected from the shaped component image list is copied to the sample image list.

[0023] Furthermore, in the information processing device according to a fourteenth aspect of the present invention, in the thirteenth aspect, the control unit further performs control to highlight and display the shaped component image copied from the shaped component image list to the sample image list.

[0024] Furthermore, in the information processing device according to the fifteenth aspect of the present invention, in the fourteenth aspect, the control of the emphasized display is a control of displaying the formed component image at the head of the sample image list.

[0025] Furthermore, in the information processing device of the 16th mode of the present invention, in the 13th mode, the classification is divided into at least one of a large item and a small item that subdivides the large item, and the control unit further performs the following control: when selecting the classification of the detection component, when the large item is selected, the formed component image is displayed in an image list of formed component images included in the large item, and when the small item is selected, the formed component image is displayed in an image list of formed component images included in the small item.

[0026] Furthermore, in the information processing device of the 17th mode of the present invention, in the 13th mode, the control unit further performs the following control: for each formed component image in the formed component image list, a plurality of formed component images having different focal positions in the depth direction of the flow cell are switched for display.

[0027] Furthermore, in the information processing device according to the 18th aspect of the present invention, in the 13th aspect, the control unit further performs control to display the items corresponding to each of the categories in different colors.

[0028] Furthermore, in the information processing device of the 19th mode of the present invention, in the 13th mode, the classification unit also calculates the fitness of the formed component images with respect to the classification results, and the control unit also performs the following control: the formed component images in the formed component image list are arranged and displayed in a suitable order or an unsuitable order according to the fitness.

[0029] Furthermore, in the information processing device according to the twentieth aspect of the present invention, in the thirteenth aspect, the control unit further performs control to set a magnification ratio of the formed component image when the formed component image list is displayed.

[0030] Furthermore, in the information processing device according to the 21st aspect of the present invention, in the 13th aspect, the control unit further performs control to set at least one of brightness and contrast of the formed component images when the formed component image list is displayed.

[0031] Furthermore, in order to achieve the above-mentioned purpose, the 22nd mode of the measurement system of the present invention comprises: a flow cell, in which a specimen fluid and a sheath fluid including a plurality of formed components flow; a photographing unit, which photographs the specimen fluid flowing through the flow cell; and the information processing device as described in claim 1, which controls a plurality of images obtained by photographing the photographing unit.

[0032] Furthermore, in order to achieve the above-mentioned purpose, the non-temporary storage medium of the 23rd mode of the present invention stores a program, which enables a computer to execute the following processing: cutting out a shaped component image identified as a shaped component from a plurality of images obtained by photographing a specimen fluid including a plurality of shaped components and flowing through a flow cell, and classifying the cut shaped component image into a detection component according to each prescribed classification, and performing the following control: when the shaped component image classified as the detection component is subclassified into a different classification, while a first image list of shaped component images included in the classification of the detection component is displayed on a display unit, a selection of a classification of a moving destination is accepted, and further, while the first image list and a second image list of shaped component images included in the classification of the moving destination are simultaneously displayed on the display unit, the shaped component image selected from the first image list is moved to the second image list.

[0033] Effects of the Invention

[0034] As described above, it is possible to obtain an effect that, when reclassifying a formed component image classified into each predetermined classification by image capturing using streaming, it is possible to suppress erroneous operation in the classification work. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1It is a perspective view showing a partial configuration of the measurement system according to the first embodiment.

[0036] Figure 2 It is a schematic diagram showing an example of the configuration of the measurement system according to the first embodiment.

[0037] Figure 3 This is a block diagram showing an example of the electrical configuration of the information processing device according to the first embodiment.

[0038] Figure 4 This is a block diagram showing an example of the functional configuration of the information processing device according to the first embodiment.

[0039] Figure 5 This is a flowchart showing an example of the flow of processing by the image classification processing program according to the first embodiment.

[0040] Figure 6 This is a front view showing an example of the measurement result screen according to the first embodiment.

[0041] Figure 7 This is a front view showing an example of the tangible component image list screen according to the first embodiment.

[0042] Figure 8 This is a front view showing an example of the reclassification work screen according to the first embodiment.

[0043] Fig. 9A This is a front view showing an example of the reclassification work screen when the focus position is the upper layer according to the first embodiment.

[0044] Fig. 9B This is a front view showing an example of the reclassification work screen when the focus position is the middle layer according to the first embodiment.

[0045] Fig. 9C This is a front view showing an example of the reclassification work screen when the focus position is the lower layer according to the first embodiment.

[0046] Fig.10 This is a front view showing an example of the reclassification work screen before and after the image quality adjustment according to the first embodiment.

[0047] Fig.11 This is a front view showing an example of the reclassification work screen before and after image enlargement according to the first embodiment.

[0048] Fig.12 This is a flowchart showing an example of the flow of processing by the image classification processing program according to the second embodiment.

[0049] Fig.13 This is a front view showing an example of a sample operation screen according to the second embodiment.

[0050] Fig.14 This is a front view showing another example of the sample operation screen according to the second embodiment.

[0051] (Explanation of symbols)

[0052] 10 Information processing device

[0053] 12 Control Unit

[0054] 12A CPU

[0055] 12B ROM

[0056] 12C RAM

[0057] 12D I / O

[0058] 14 Storage

[0059] 14A Image Classification Processing Procedure

[0060] 14B Formed Component Image Group

[0061] 16 Display

[0062] 18 Operation Department

[0063] 20 Ministry of Communications

[0064] 30 Classification Department

[0065] 32 Display control unit

[0066] 40 Flow Cell

[0067] 42 Specimen intake

[0068] 44 Sheath fluid inlet

[0069] 46 Exhaust

[0070] 50 Measurement result screen

[0071] 50A Name of the formed ingredient

[0072] 50B Formed component button

[0073] 50C Mark

[0074] 51 Formed component image list screen

[0075] 52 Item 1 Button Group

[0076] 53 Item 2 Button Group

[0077] 54, 56, 58, 59 Reclassification operation screen

[0078] 54A, 56A, 58A, 59A 1st Image List

[0079] 54B, 56B 2nd image list

[0080] 55, 57A, 57B, 57C, 61 Formed component images

[0081] 60 Sample operation screen

[0082] 60A Formed Element Image List

[0083] 60B Sample Image List

[0084] 70 Measurement system

[0085] 72 Housing

[0086] 74 Camera

[0087] 76 Light Source

[0088] 78 1st supply device

[0089] 86 Second supply device DETAILED DESCRIPTION

[0090] Hereinafter, an example of a mode for implementing the present invention will be described in detail with reference to the drawings.

[0091] [First embodiment]

[0092] Figure 1 It is a perspective view showing a part of the structure of the measurement system 70 according to the first embodiment.

[0093] like Figure 1 As shown, the measurement system 70 of this embodiment includes a flow cell 40, a housing 72, a camera 74, and a light source 76. Figure 1 The arrow UP shown indicates the upper side of the measurement system 70 in the up-down direction.

[0094] The flow cell 40 of the present embodiment is suitable for, for example, the following urine formed component test (urine sediment test): by introducing it into a urine specimen as an example of a specimen fluid together with a sheath fluid, photographing the formed components in the urine specimen using a camera 74, and performing various analyses based on the shape of the formed components in the photographed image. The camera 74 is an example of a photographing unit. The urine specimen includes a variety of formed components. As the types of the formed components, as an example, red blood cells, white blood cells, epithelial cells, cylinders, bacteria, etc. can be listed. In addition, in the present embodiment, as an example of a specimen fluid, the case of using a urine specimen to perform a urine formed component test is described, but it can also be used for formed component tests using blood, cells, body fluids, etc. as objects.

[0095] The measuring system 70 includes a housing 72 in which a flow cell 40 is arranged. A recess 72A is formed in the housing 72, and the position including the recess 72A of the housing 72 is formed by a transparent member (glass, etc. as an example). Inside the housing 72, a camera 74 is provided at a position opposite to the flow cell 40. On the upper side of the housing 72, a light source 76 is provided at a position opposite to the camera 74 across the flow cell 40. The camera 74 is arranged at a position capable of photographing the specimen fluid flowing through the flow cell 40.

[0096] The measuring system 70 includes a first supply device 78 for supplying a sample fluid to a sample inlet 42 of a sample flow path (not shown) in a flow cell 40. The first supply device 78 includes a supply tube 80, one end of which is connected to the sample inlet 42, a pump 82 provided in the middle of the supply tube 80, and a sample storage unit 84, which is connected to the other end of the supply tube 80 and stores the sample fluid.

[0097] The measurement system 70 includes a second supply device 86 for supplying the sheath liquid fluid to the sheath liquid inlet 44 of the sheath liquid flow path (not shown) in the flow cell 40. The second supply device 86 includes a supply tube 88, one end of which is connected to the sheath liquid inlet 44, a pump 90 provided in the middle of the supply tube 88, and a tank 92 connected to the other end of the supply tube 88 and storing the sheath liquid fluid.

[0098] Furthermore, in the flow cell 40, a discharge port 46 is provided between the specimen intake port 42 and the sheath liquid intake port 44. The discharge port 46 is connected to one end of a discharge pipe (not shown in the figure), and the other end of the discharge pipe is connected to a waste tank (not shown in the figure). The flow cell 40 has a confluence portion (not shown in the figure) for merging the specimen introduced from the specimen intake port 42 and the sheath liquid introduced from the sheath liquid intake port 44, and the merged fluid flows in the flow path. A tapered portion is formed in the flow path in which the height of the flow path gradually decreases. Therefore, even after the specimen and the sheath liquid merge, the specimen will not diffuse in the sheath liquid, but will flow in a localized flat shape. The formed components in the localized specimen flow are photographed by the camera 74.

[0099] Figure 2 It is a schematic diagram showing an example of the configuration of the measurement system 70 according to the first embodiment.

[0100] like Figure 2 As shown, the measurement system 70 of this embodiment includes an information processing device 10. In addition, Figure 2 The arrows UP and Figure 1 Similarly, the upper side in the vertical direction of the measurement system 70 is shown.

[0101] The information processing device 10 has a function as a control device, and controls the operations of the camera 74, the light source working unit 77 electrically connected to the light source 76, the pump 82, and the pump 90 respectively. The information processing device 10 causes the light source 76 to emit light at a prescribed interval by providing a pulse signal to the light source working unit 77. In addition, the information processing device 10 drives the pump 82 to control the flow rate of the specimen fluid, and drives the pump 90 to control the flow rate of the sheath fluid. Although not shown in the figure, it is also possible to have a plurality of cameras 74 and an optical system for introducing light into each camera 74. Each optical system is adjusted so that each camera 74 focuses at a different position (depth) in the flow cell 40. In other words, a plurality of images focused at different depth positions are simultaneously photographed at the same position on the horizontal plane by a plurality of cameras 74. At the same time, the photographic images photographed are stored in the storage unit 14 accordingly. The depth direction referred to here refers to a direction perpendicular to the direction in which the specimen fluid flows, indicating Figure 2 The distances between each focus and the wall surface of the flow cell 40 close to the camera 74 are different.

[0102] Figure 3 This is a block diagram showing an example of the electrical configuration of the information processing device 10 according to the first embodiment.

[0103] like Figure 3 As shown, the information processing device 10 of the present embodiment includes a control unit 12 , a storage unit 14 , a display unit 16 , an operation unit 18 , and a communication unit 20 .

[0104] In the information processing device 10 of the present embodiment, for example, a general-purpose computer device such as a personal computer (PC) is applicable. In addition, in the information processing device 10, a portable computer device such as a smart phone and a tablet terminal can also be applied. In addition, the information processing device 10 can also be divided into a plurality of components. For example, it can also be configured to include a component for controlling a measurement system such as a camera 74, a light source 76, a pump 82, a pump 90, and a component for processing and analyzing an image taken by the camera 74. In addition, the information processing device 10 can also be externally connected to the measurement system 70.

[0105] The control unit 12 includes a CPU (Central Processing Unit) 12A, a ROM (Read Only Memory) 12B, a RAM (Random Access Memory) 12C, and an input / output interface (I / O) 12D, and these components are connected via a bus.

[0106] The I / O 12D is connected to various functional units including the storage unit 14, the display unit 16, the operation unit 18, and the communication unit 20. These various functional units can communicate with the CPU 12A via the I / O 12D.

[0107] The control unit 12 may be configured as a sub-control unit that controls a part of the operation of the information processing device 10, or may be configured as a part of the main control unit that controls the overall operation of the information processing device 10. In part or all of the modules of the control unit 12, for example, integrated circuits such as LSI (Large Scale Integration) or IC (Integrated Circuit) chipsets are used. As each of the above modules, individual circuits may be used, or circuits that integrate part or all of the modules may be used. The above modules may be integrated with each other, or some modules may be separately provided. Furthermore, in each of the above modules, a part thereof may be separately provided. In the integration of the control unit 12, it is not limited to LSI, and dedicated circuits or general-purpose processors may also be used.

[0108] As the storage unit 14, for example, a HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, etc. are used. In the storage unit 14, an image classification processing program 14A for performing the image classification processing of the present embodiment is stored. In addition, the image classification processing program 14A may also be stored in the ROM 12B. In addition, a shaped component image group 14B for image classification processing is stored in the storage unit 14. In addition, the storage unit 14 may also be provided with an external memory or may be added later.

[0109] The image classification processing program 14A may be pre-installed in the information processing device 10, for example. The image classification processing program 14A may be stored in a non-volatile storage medium or distributed via a network, and installed in the information processing device 10 or updated as appropriate. In addition, as examples of non-volatile storage media, CD-ROM (Compact Disc Read Only Memory), magneto-optical disk, HDD, DVD-ROM (Digital Versatile Disc Read Only Memory), flash memory, memory card, etc. are conceivable.

[0110] As the display unit 16, for example, a liquid crystal display (LCD: Liquid Crystal Display), an organic EL (Electro Luminescence) display, etc. are used. The display unit 16 may also have a touch panel integrally. In the operation unit 18, for example, a keyboard, a mouse, and other devices for operation input are provided. The display unit 16 and the operation unit 18 receive various instructions from the user of the information processing device 10. The display unit 16 displays various information such as the result of the processing executed according to the instruction received from the user and the notification of the processing.

[0111] The communication unit 20 is connected to a network such as the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network), and can communicate with external devices such as the image forming apparatus and other PCs via the network.

[0112] The CPU 12A of the information processing device 10 of the present embodiment writes the image classification processing program 14A stored in the storage unit 14 into the RAM 12C and executes the program, thereby serving as Figure 4 Each of the parts shown performs a function.

[0113] Figure 4 This is a block diagram showing an example of the functional structure of the information processing device 10 according to the first embodiment.

[0114] like Figure 4 As shown, the CPU 12A of the information processing device 10 of the present embodiment functions as the classification unit 30 and the display control unit 32. The display control unit 32 is an example of a control unit.

[0115] The classification unit 30 of this embodiment cuts out a plurality of formed components included in the specimen fluid as formed component images from a plurality of images (for example, 300 images or 1000 images) obtained by photographing the specimen fluid flowing through the flow cell 40 by the camera 74, and classifies the cut formed component images according to each specified classification (for example, the type, size, shape, presence or absence of nuclei of the formed component, etc.). The formed component images classified into each specified classification by the classification unit 30 are stored in the storage unit 14 as a formed component image group 14B for each specimen. In addition, as a method of identifying formed components from an image, various known techniques such as a method using machine learning and a method using pattern matching are applicable as an example. Moreover, when the formed component image group 14B is described as each formed component image, the formed component image group 14B is also referred to as a formed component image 14B.

[0116] The display control unit 32 of this embodiment controls to display the formed component image classified as the detection component by the classification unit 30 as a formed component individual image on the display unit 16. When an operator such as an inspection engineer visually inspects the formed component individual image, the classification can be manually changed. Therefore, when the operator reclassifies the formed component image, as an example, as described later Figure 8 As shown, the display control unit 32 controls to display a first image list of shaped component images included in the first category of the detection component and a second image list of shaped component images included in the second category of the movement destination on one screen. The shaped component images moved to the second image list are reclassified into the second category and stored. In addition, the detection component refers to an arbitrary shaped component cut out as a shaped component image from an image photographed by the camera 74.

[0117] In the present embodiment, the first category and the second category are different classifications, and the classification of the tangible component image is changed. In this case, the display control unit 32 performs the following control: while displaying the first image list classified as the first category, the selection of the classification of the mobile destination is accepted, and while displaying the first image list and the second image list classified as the second category as the mobile destination at the same time, the tangible component image selected from the first image list is moved to the second image list. In other words, in this case, the tangible component image selected from the first image list is deleted from the first image list and displayed in the second image list. In addition, a specific screen example will be described later.

[0118] Next, refer to Figure 5 , the function of the information processing device 10 according to the first embodiment is described.

[0119] Figure 5 This is a flowchart showing an example of the flow of processing of the image classification processing program 14A according to the first embodiment.

[0120] First, when the information processing device 10 receives an instruction to display the measurement result screen, the following steps are executed. In addition, in the present embodiment, as a result of automatic classification by the classification unit 30, the formed component image group 14B is stored in the storage unit 14. The above-mentioned measurement result screen is a screen displayed after the automatic classification by the classification unit 30.

[0121] exist Figure 5 In step 100, as an example, the display control unit 32 controls to display the Figure 6 The measurement result screen 50 is shown.

[0122] In step 102, the display control unit 32 selects the display displayed in step 100, which will be described later. Figure 6The measurement result screen 50 shown in the figure determines whether the selection of the classification item indicating the name of the tangible component of the detection component has been accepted according to the instruction from the operator. If it is determined that the selection of the classification item has been accepted (in the case of positive judgment), the process moves to step 104, and if it is determined that the selection of the classification item has not been accepted (in the case of negative judgment), the process becomes waiting in step 102.

[0123] In step 104, as an example, the display control unit 32 controls the display of the following categories according to the classification items selected in step 102. Figure 7 The tangible component image list screen 51 is shown.

[0124] In step 106, the display control unit 32 selects the display displayed in step 104, which will be described later. Figure 7 The tangible component image list screen 51 shown in the figure determines whether the selection of the classification item indicating the tangible component name of the moving destination is accepted according to the instruction from the operator. If it is determined that the selection of the tangible component name of the moving destination is accepted (in the case of affirmative determination), the process moves to step 108, and if it is determined that the selection of the tangible component name of the moving destination is not accepted (in the case of negative determination), the process becomes a waiting state in step 106.

[0125] In step 108, as an example, the display control unit 32 controls to display the Figure 8 The reclassification operation screen 54 is shown. In the reclassification operation screen 54, a first image list including images of formed components in the first category of the detection component and a second image list including images of formed components in the second category of the transfer destination are displayed on one screen. In the present embodiment, the first image list and the second image list are composed of formed component images obtained and cut out from the measurement of the same specimen, but the first category and the second category are formed components of different classifications.

[0126] In step 110 , the display control unit 32 receives selection of one material component image to be changed in classification from the first image list displayed in step 108 in accordance with an instruction from the operator.

[0127] In step 112 , the display control unit 32 performs control to delete the tangible component image selected in step 110 from the first image list and display it in the second image list displayed in step 108 , that is, to move the tangible component image selected from the first image list to the second image list.

[0128] In step 114, the display control unit 32 determines whether the confirmation of the classification change of the first image list displayed in step 108 has been completed. If it is determined that the confirmation of the classification change has not been completed (in the case of negative determination), the process returns to step 110 and repeats the process. On the other hand, if it is determined that the confirmation of the classification change has been completed (in the case of positive determination), a series of processes of the image classification processing program 14A are terminated.

[0129] Next, refer to Figure 6 to Figure 11 , a specific screen example in the image reclassification processing of this embodiment is explained.

[0130] Figure 6 It is a front view showing an example of the measurement result screen 50 according to the first embodiment.

[0131] like Figure 6 As shown, the measurement result screen 50 of this embodiment displays a list of measurement results for each item. As the measurement results, the name of the formed ingredient, the content or the number of the component, and a qualitative display that serves as an index of the content are displayed. In addition, the measurement result screen 50 is provided with a formed ingredient name 50A and a formed ingredient button 50B.

[0132] exist Figure 6 Among the items shown, as main items, for example, RBC represents red blood cells, WBC represents white blood cells, NSE represents non-squamous epithelial cells, SQEC represents squamous epithelial cells, NHC represents other cylinders, and BACT represents bacteria. In addition, CRYS represents crystals, YST represents yeast, HYST represents glass cylinders, MUCS represents mucus threads, SPRM represents sperm, and WBCC represents white blood cell clots.

[0133] Here, the display control unit 32 performs control such that, on the measurement result screen 50, a mark indicating that confirmation is completed is added to the category for which the shaped component image is confirmed by displaying the first image list of the category selected from the category items. Figure 6 In the measurement result screen 50 shown, a mark 50C indicating that the check is completed is given to the items in the classification items for which the first image list has been checked. In addition, when reclassification (classification change) is performed, the measurement result reflecting the result is displayed.

[0134] In this way, since a mark is given to the item whose formed component image is confirmed once, it is possible to suppress omission of confirmation.

[0135] exist Figure 6 In the measurement result screen 50 shown in FIG. 1 , when a shaped ingredient name 50A or a shaped ingredient button 50B is selected by a click operation or the like, as an example, an individual shaped ingredient image of the selected classification item is displayed on the screen. Figure 7 The tangible component image list screen 51 is shown.

[0136] Figure 7 This is a front view showing an example of the shaped component image list screen 51 according to the first embodiment.

[0137] like Figure 7 As shown in FIG. 1 , the tangible ingredient image list screen 51 of the present embodiment displays a tangible ingredient image list 51A selected as a tangible ingredient whose image is to be confirmed. The tangible ingredient image list screen 51 is displayed on the display unit 16 .

[0138] Figure 7 The shown formed component image list screen 51 includes a first item button group 52 of the detected component and a second item button group 53 of the mobile destination. The first item button group 52 of the detected component is set for each type of the detected component. Similarly, the second item button group 53 of the mobile destination is set for each classification item of the mobile destination. As an example, as mentioned above, "RBC" represents red blood cells, "WBC" represents white blood cells, and "SQEC" represents squamous cell epithelial cells. In addition, in Figure 7 In the example shown, “SQEC” of the first item button group 52 of the detection component is selected, and therefore a list of images of squamous epithelial cells is displayed on the formed component image list screen 51 .

[0139] And, in Figure 7 In the shaped component image list screen 51 shown, a plurality of operation buttons B1 to B6 are displayed in an operable manner. The operation button B1 is a button for enlarging and displaying a shaped component image and displaying a scale (length) in accordance with the enlargement of the image. Figure 7 In the example shown, the scale is displayed as 10 μm / pixel. In addition, the operation button B2 is a button for switching the display of the formed component images with different focus positions. Figure 7 In the example shown, the focus position in the depth direction of the flow cell 40 can be switched corresponding to the three layers of the upper layer, the middle layer and the lower layer. In addition, the operation button B3 is a button for moving the formed component image of the detection component to the moving destination. In addition, the operation button B4 is a button for returning the editing operation of the image classification to the previous one. In addition, the operation button B5 is a button for displaying the formed component image of the "sample" described later. In addition, the operation button B6 is a button for displaying a window for setting the magnification of the formed component image or setting the brightness, contrast, etc. of the formed component image.

[0140] Through Figure 7The plurality of operation buttons B1 to B6 shown can be operated to change the display mode of the formed component image, so that the formed component can be easily distinguished.

[0141] exist Figure 7 In the tangible component image list screen 51 shown in the figure, when any item button in the second item button group 53 of the transfer destination is selected by a click operation or the like, the following is displayed as an example: Figure 8 The reclassification operation screen 54 shown in the above figure is shown. In the reclassification operation screen 54, the first image list of the detection component and the second image list of the movement destination are displayed on one screen.

[0142] Figure 8 It is a front view showing an example of the reclassification work screen 54 according to the first embodiment.

[0143] like Figure 8 As shown, the reclassification operation screen 54 of the present embodiment displays a first item button group 52 of detection components, a first image list 54A, a second item button group 53 of the transfer destination, and a second image list 54B. The reclassification operation screen 54 is displayed on the display unit 16 .

[0144] like Figure 8 As shown in the figure above, in the reclassification operation screen 54 of the present embodiment, as a result of selecting and operating the item button "CAOX" of the first item button group 52, a first image list 54A including the shaped component images of "CAOX" is displayed in the upper stage. And, as a result of selecting and operating the item button "TP04" of the second item button group 53, a second image list 54B including the shaped component images of "TP04" is displayed in the lower stage.

[0145] exist Figure 8 In the figure above, in order to change the classification of the shaped component images 55 included in the first image list 54A, when the operator selects the shaped component image 55 and operates the operation button B3, the screen moves to Figure 8 The reclassification operation screen 54 shown in the following figure is displayed. In addition, the operation of dragging and dropping the selected shaped component image 55 to the second image list 54B can also be performed.

[0146] exist Figure 8 In the reclassification work screen 54 shown in the following figure, the above-selected tangible component image 55 is deleted from the first image list 54A and displayed in the second image list 54B.

[0147] Here, it is preferable that the display control unit 32 emphatically displays the shaped component image 55 selected from the first image list 54A in the second image list 54B. Figure 8 As shown in the following figure, the formed component image 55 is displayed at the head of the second image list 54B. Alternatively, a predetermined mark (for example, an asterisk, a circle, etc.) may be given to the formed component image 55. In addition, the outer frame of the formed component image 55 may be thickened or changed to a predetermined color (for example, red, blue, etc.) or displayed in a larger size than other images. In this way, the image moved to the destination can be easily identified.

[0148] Furthermore, each item button of the first item button group 52 of the detection component and each item button of the second item button group 53 of the movement destination are given a unique image color for each item. Figure 8 In the example shown, the difference in image color is indicated by the difference in hatching. Specifically, as an example, the item button of "RBC" is displayed in red, the item button of "WBC" is displayed in blue, and the item button of "SQEC" is displayed in green.

[0149] In this way, by giving each item a unique image color, each item can be displayed in a visually easy-to-understand manner. Therefore, it is possible to suppress the occurrence of misreading items. In addition, from the perspective of making it easy to understand the relationship between the detection component and the destination, making it easy to understand the grouping of large categories and small categories, or being able to focus on important items in terms of inspection, it is also possible to effectively suppress misreading and erroneous operations.

[0150] Furthermore, at least a part of the items of the second item button group 53 of the moving destination is divided into at least one of a large item and a small item that is a subdivision of the large item. In this case, the display control unit 32 displays the shaped component image 55 in the image list of shaped component images included in the large item when the large item is selected, and displays the shaped component image 55 in the image list of shaped component images included in the small item when the small item is selected. In this way, by providing the small item relative to the large item, it is easy to visually understand the moving destination, thereby improving operability. In addition, the shaped component images of the small items included in the large item can also be displayed simultaneously with the shaped component images of the large item.

[0151] exist Figure 8In the examples shown in the above and below figures, in the second item button group 53 where two buttons are displayed in one row, the 10 item buttons "CRYS" to "UNCL" displayed on the left are large items, and the 10 item buttons "CAOX" to "UNCX" arranged on the right side of the large items are small items. Here, as an example, even if a large item includes multiple small items, in order to reduce the display space, only one small item is displayed. In this case, it is preferred to select the small item after selecting the large item. Figure 8 In the examples shown in the above and below figures, as an example, after selecting "CRYS" as a large item, "CAOX" as a small item can be selected. This allows for compact display and prevents erroneous selection. In addition, in the case where a large item includes multiple small items, after selecting the large item, the multiple small items included in the large item can be expanded and displayed for selection. In addition, regarding the first item button group 52, buttons corresponding to the large item and the small item can also be displayed, and the same processing as above can be performed.

[0152] Furthermore, when the classification unit 30 classifies the formed component images, it calculates the fitness according to the image recognition method used (for example, pattern matching method, etc.). Furthermore, the display control unit 32 arranges and displays the formed component images of the first image list 54A according to the fitness, in a suitable order or an unsuitable order. The so-called fitness here means the classification accuracy of the image of the recognition result. For the images of each classification item, the higher the proportion of consistency with the correct image or the predetermined feature points, the higher the value is given. In the case of complete consistency with the correct image or the feature points, the fitness becomes 100%. In the case of a suitable order, the formed component images are displayed in order from high to low fitness, and in the case of an unsuitable order, the formed component images are displayed in order from low to high fitness. That is, the formed component images with relatively low fitness are images that need to be reclassified. In the case of arranging the formed component images in an unsuitable order, the images with high possibility of reclassification are displayed in front, so it is easy to attract the attention of the operator.

[0153] In this way, by displaying the images of the shaped components that need to be reclassified in a centralized manner and with priority, the operability in the reclassification operation can be improved and the load of confirmation can be reduced. In addition, it is also possible to indicate a numerical value of the degree of fitness or to give a mark indicating a high degree of fitness (e.g., 80% or more) or a low degree of fitness (e.g., 50% or less) or to display them in different colors.

[0154] And, as an example, it is also possible to Figures 9A to 9C As shown in FIG. 1 , when the respective tangible component images of the first image list are simultaneously photographed at a plurality of different focus positions, the display control unit 32 switches and displays the obtained plurality of images.

[0155] Fig. 9A This is a front view showing an example of the reclassification work screen 56 when the focus position is the upper layer according to the first embodiment. Fig. 9B This is a front view showing an example of the reclassification work screen 56 when the focus position is the middle layer according to the first embodiment. Fig. 9C This is a front view showing an example of the reclassification work screen 56 when the focus position is the lower layer according to the first embodiment.

[0156] like Figures 9A to 9C As shown in FIG. 1 , the first image list 56A and the second image list 56B are displayed on the reclassification work screen 56 of the present embodiment. The reclassification work screen 56 is displayed on the display unit 16 .

[0157] exist Fig. 9A In FIG. 5 , the three visible component images 57A included in the first image list 56A are images photographed at the focus position of the upper layer. Fig. 9B In FIG. 5 , the three visible component images 57B included in the first image list 56A are images photographed at a focal position in the middle layer. Fig. 9C , the three formed component images 57C included in the first image list 56A are images photographed at the focus position of the lower layer. In addition, the upper layer represents the case where the distance between the focus and the wall surface of the flow cell 40 on the side close to the camera 74 is the shortest, the lower layer represents the case where the distance between the focus and the wall surface of the flow cell 40 on the side close to the camera 74 is the longest, and the middle layer represents the case where the distance between the focus and the wall surface of the flow cell 40 on the side close to the camera 74 is between the upper layer and the lower layer. And, by operating the operation button B2, the images with different focus positions are switched. In addition, the images photographed at the focus position of the middle layer are displayed by default. The focus position can be switched for all the formed component images included in the first image list 56A or only for the selected formed component images.

[0158] In this way, the operator can switch the focus position of the formed component image included in the first image list 56A to display the formed component image with a different focus position, and can compare and confirm it with the formed component image included in the second image list 56B. Therefore, for example, the recognition of the formed component having an internal structure such as a nucleus is improved, and the classification accuracy is improved.

[0159] And, as an example, Fig.10 As shown, the display control unit 32 performs control to set at least one of the brightness and the contrast of the formed component image for each type of the detection component.

[0160] Fig.10 1 is a front view showing an example of the reclassification operation screen 58 before and after the image quality adjustment according to the first embodiment. Fig.10, the first image list of the glass cylinder "HYAL" is shown as an example.

[0161] exist Fig.10 The reclassification operation screen 58 shown in the figure above shows the first image list 58A before the image quality adjustment. Fig.10 The reclassification operation screen 58 shown in the following figure displays the first image list 58A after the image quality adjustment. The reclassification operation screen 58 is displayed on the display unit 16.

[0162] In operation Fig.10 When the operation button B6 is pressed, a window (not shown) for setting various parameters related to the image quality of the formed component image and setting the magnification of the formed component image is opened. The various parameters of the image quality include, for example, at least one of brightness and contrast. The various parameters related to the image quality set in the window displayed by the operation of the operation button B6 are applied to all the formed component images included in the corresponding item.

[0163] As an example, Fig.10 As shown in the figure above, it is sometimes difficult to observe the image due to the structure of the formed component depending on the item. In contrast, by adjusting the image quality of the formed component image for each item, the recognizability of the formed component image can be improved, and the efficiency of the reclassification operation can be achieved. For example, for items with few bumps and low contrast, such as glass cylinders, mucus lines, and some red blood cells, the contrast is increased compared to other items, thereby improving the recognizability.

[0164] And, as an example, Fig.11 As shown, the display control unit 32 performs control so as to set the magnification of the formed component image for each type of the detection component.

[0165] Fig.11 1 is a front view showing an example of the reclassification operation screen 59 before and after the image is enlarged according to the first embodiment. Fig.11 In FIG. 1 , the first image list of bacteria “BACT” is shown as an example.

[0166] exist Fig.11 The reclassification operation screen 59 shown in the above figure shows the first image list 59A before the image is enlarged. Fig.11 The reclassification work screen 59 shown in the following figure displays the first image list 59A after the images are enlarged. The reclassification work screen 59 is displayed on the display unit 16.

[0167] As mentioned above, in operation Fig.11When the operation button B6 is pressed, a window for setting the magnification of the shaped component image is opened. The magnification set in the window displayed in response to the operation of the operation button B6 is applied to all shaped component images included in the corresponding item.

[0168] As an example, Fig.11 As shown in the above figure, sometimes, depending on the project, the formed component image is small and difficult to observe, and the operability is not good. In contrast, by setting the magnification of the formed component image for each project, the recognizability and operability of the formed component image can be improved, misoperation can be reduced, and the efficiency of the reclassification operation can be achieved. In addition, an example in which each operation button B1 to B6 is set at the lower part of the first image list in the upper section is shown, but it is not limited to this position. For example, any operation button can also be set at the lower part of the second image list to adjust the image quality of the formed component image included in the second image list.

[0169] As described above, according to the present embodiment, when changing the classification of the shaped component images of each predetermined classification by image photography performed by streaming, the shaped component images of the detection component and the shaped component images of the moving destination are displayed simultaneously, and the operation can be accepted. Therefore, erroneous operation can be suppressed.

[0170] [Second embodiment]

[0171] In the first embodiment described above, as an example of reclassification, a method for changing the classification of a shaped component image is described. In this embodiment, as an example different from reclassification, a method for adding a sample of a shaped component image is described. The so-called "sample" here refers to a set of images (hereinafter referred to as "sample image list") that are concentrated according to each type of shaped component images that will serve as a reference when an operator such as an inspection engineer changes the classification of a shaped component image. As a sample image, an image that serves as a reference is selected from shaped component images obtained by measuring multiple specimens. The operator sometimes observes the sample image list and changes the classification of the shaped component image as needed. And sometimes, if there is a suitable image as a sample in the shaped component image, the operator will add it to the sample image list. However, the shaped component image and the sample image list saved according to the specimen are managed independently, and the observation of the shaped component image and the addition of the image to the sample image list are performed independently. In this embodiment, as part of the operation of observing and reclassifying the shaped component image, the shaped component image currently observed is added to the sample image list as a sample.

[0172] The storage unit 14 stores a formed component image and a sample image of the formed component image. When a formed component image classified as a detection component is added as a sample image of the same classification, as an example, as described later, Fig.13 As shown, the display control unit 32 controls to display the image list of the tangible components of the detection component and the sample image list on one screen. In addition, in order to avoid confusion between the image list of the mobile destination and the sample image list described in the first embodiment, for example, a watermark may be added to the background of one of the image lists or the background color may be changed to display it.

[0173] In the present embodiment, a sample of a shaped component image is added to a sample image list. In this case, the display control unit 32 performs the following control: while the shaped component image list is displayed, an instruction to display a sample image is accepted, and while the shaped component image list and the sample image list are displayed simultaneously, a shaped component image selected from the shaped component image list is copied to the sample image list. In other words, in this case, the shaped component image selected from the shaped component image list is displayed in the sample image list while remaining in the shaped component image list. In the case of sample addition, the classification of the copy source (first category) and the classification of the copy destination (second category) are the same. In addition, a specific screen example will be described later.

[0174] Next, refer to Fig.12 , the function of the information processing device 10 according to the second embodiment is described.

[0175] Fig.12 This is a flowchart showing an example of the flow of processing of the image classification processing program 14A according to the second embodiment.

[0176] First, similarly to the first embodiment described above, when the information processing device 10 receives an instruction to display a measurement result screen, the following steps are executed.

[0177] exist Fig.12 In step 120, as an example, the display control unit 32 controls to display the above Figure 6 The measurement result screen 50 is shown.

[0178] In step 122, the display control unit 32 selects the above-mentioned Figure 6 The measurement result screen 50 shown in the figure determines whether the selection of the classification item indicating the name of the tangible component of the detection component has been accepted according to the instruction from the operator. If it is determined that the selection of the classification item has been accepted (in the case of positive judgment), the process moves to step 124, and if it is determined that the selection of the classification item has not been accepted (in the case of negative judgment), the process becomes waiting in step 122.

[0179] In step 124, as an example, the display control unit 32 controls the display of the above-mentioned Figure 7 The tangible component image list screen 51 is shown.

[0180] In step 126, the display control unit 32 selects the above-mentioned Figure 7 The shaped component image list screen 51 shown in the figure determines whether the instruction to display the sample image has been accepted according to the instruction from the operator. If it is determined that the instruction to display the sample image has been accepted (in the case of positive determination), the process moves to step 128, and if it is determined that the instruction to display the sample image has not been accepted (in the case of negative determination), the process waits in step 126.

[0181] In step 128, as an example, the display control unit 32 controls to display the Fig.13 The sample operation screen 60 shown in FIG. 60 shows a list of images of the components to be detected and a list of sample images of the destinations to be copied. In this embodiment, the first category and the second category are the same category, so according to the operation instruction of adding the sample, Fig.13 Sample images of the same type as the formed components displayed in the upper section are automatically displayed in the lower section.

[0182] In step 130 , the display control unit 32 receives selection of one formed component image to be added as a sample from the formed component image list displayed in step 128 in accordance with an instruction from the operator.

[0183] In step 132, the display control unit 32 performs control such that the shaped component image selected in step 130 is displayed in the sample image list displayed in step 128 while remaining in the shaped component image list. In other words, as an example, as described later Fig.14 As shown, the selected formed component image is copied to the sample image list.

[0184] In step 134, the display control unit 32 determines whether to complete the confirmation of the sample addition to the list of formed component images displayed in step 128. If it is determined that the confirmation of the sample addition has not been completed (in the case of negative determination), the process returns to step 130 and repeats the process. On the other hand, if it is determined that the confirmation of the sample addition has been completed (in the case of positive determination), the series of processes of the image classification processing program 14A are completed.

[0185] Next, refer to Fig.13 and Fig.14, a specific screen example in the sample addition process of this embodiment is described. In fact, the first item button group 52, the second item button group 53 and the operation buttons B1 to B6 are used for operation, but for simplicity, Fig.13 and Fig.14 In the example shown, the Figure 7 and Figure 8 1 and 2. The first and second item button groups 52 and 53 are shown in FIG.

[0186] As an example, by clicking, etc. Figure 7 When the operation button B5 (sample addition button) is selected in the shaped component image list screen 51 shown in FIG. Fig.13 The sample operation screen 60 is shown. In the sample operation screen 60, a list of tangible component images of detection components and a list of sample images of copy destinations are displayed on one screen.

[0187] Fig.13 and Fig.14 It is a front view showing an example of a sample operation screen 60 according to the second embodiment.

[0188] like Fig.13 As shown, a sample operation screen 60 of the present embodiment displays a list 60A of shaped component images of detection components and a list 60B of sample images of copy destinations. The sample operation screen 60 is displayed on the display unit 16 .

[0189] like Fig.13 As shown, in the sample operation screen 60 of this embodiment, the first item button group 52 (see Figure 7 ) is pressed, a list 60A of formed component images of formed component images included in "SQEC" is displayed in the upper section. And, by pressing the operation button B5, a list 60B of sample images of formed component images included in "SQEC" as the same item is displayed in the lower section.

[0190] exist Fig.13 In order to add the formed component image 61 included in the formed component image list 60A as a sample, when the operator selects the formed component image 61 and selects the operation button B3 by clicking the formed component image 61, the screen moves to Fig.14 The sample operation screen 60 is shown. Alternatively, the following operation may be performed: the selected shaped component image 61 may be dragged and dropped to the sample image list 60B.

[0191] like Fig.14As shown, when the operation button B3 is operated, the formed ingredient image 61 selected from the formed ingredient image list 60A is displayed in the sample image list 60B while remaining in the formed ingredient image list 60A.

[0192] Here, the display control unit 32 is similar to the first embodiment described above, and preferably displays the formed component image 61 selected from the formed component image list 60A in the sample image list 60B in an emphasized manner. As an example, the formed component image 61 is displayed at the head of the sample image list 60B. Alternatively, a predetermined mark (for example, an asterisk, a circle, etc.) may be given to the formed component image 61. In addition, the outer frame of the formed component image 61 may be thickened or changed to a specified color (for example, red, blue, etc.) or displayed in a larger size than other images. Thus, the image to be copied as a sample can be easily determined.

[0193] In addition, in the present embodiment, the above-mentioned classification items may also be divided into at least one of a large item and a small item that is a subdivision of the large item. When selecting the classification of the detection component, if a large item is selected, the formed component image is displayed in the image list of the formed component images included in the large item, and if a small item is selected, the formed component image is displayed in the image list of the formed component images included in the small item.

[0194] Furthermore, in this embodiment, as in the first embodiment described above, items corresponding to each classification may be displayed using distinguishing colors. Furthermore, the following control may be performed: for each formed component image in the formed component image list, multiple images obtained by photographing at multiple different focus positions may be switched and displayed. Furthermore, the following control may be performed: the formed component images in the formed component image list may be arranged and displayed in a suitable order or an unsuitable order according to the above-mentioned fitness. Furthermore, control may be performed to set the magnification of the formed component image for each classification. Furthermore, control may be performed to set at least one of the brightness and contrast of the formed component image for each classification.

[0195] As described above, according to this embodiment, while observing the shaped component images classified into each predetermined classification by the image photography using the streaming method, the selected image can be added as a sample to the sample image list. Therefore, erroneous operation can be suppressed.

[0196] The information processing device of the embodiment is exemplified and described above. The embodiment may also be in the form of a program for causing a computer to execute the functions of each unit of the information processing device. The embodiment may also be in the form of a computer-readable storage medium storing the program.

[0197] In addition, the structure of the information processing device described in the above embodiment is an example, and can be changed according to the situation without departing from the scope of the main purpose. The display of the tangible component image is not limited to the above embodiment, for example, it can also be displayed horizontally on the left and right. The display position of each button can also be appropriately changed.

[0198] Furthermore, the process flow of the program described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the process order may be changed without departing from the scope of the subject matter.

[0199] Furthermore, in the above-mentioned embodiments, the processing of the embodiments is implemented by a computer according to a software structure by executing a program, but the present invention is not limited thereto. For example, the embodiments may be implemented by a hardware structure or a combination of a hardware structure and a software structure.

Claims

1. An information processing device comprising: a classifying unit that cuts out a formed component image identified as a formed component from a plurality of images obtained by photographing a sample fluid including a plurality of formed components and flowing through a flow cell, and classifies the cut out formed component image into a detection component for each predetermined classification; and A control unit that performs the following display control: causing the display unit to display a formed component image list screen, the formed component image list screen including a first item button group, a first image list, and a second item button group, the first item button group consisting of a plurality of buttons set according to each type of the detection component, the first image list being a formed component image list selected by any button in the first item button group, the second item button group consisting of a plurality of buttons for selecting a moving destination of the formed component images of the first image list according to large items and small items obtained by subdividing the large items, and when the moving destination is selected by any button in the second item button group, causing the display unit to display a reclassification operation screen including the first image list and the second image list, the second image list being the formed component image list selected as the moving destination.

2. The information processing device according to claim 1, wherein: The control unit further performs control to highlight and display a tangible component image moved from the first image list to the second image list.

3. The information processing device according to claim 2, wherein: The control of the emphasized display is a control for displaying the shaped component image at the head of the second image list.

4. The information processing device according to claim 1, wherein: The classification is divided into at least one of a large project and a small project obtained by subdividing the large project. The control unit also performs the following control: when selecting the classification of the mobile destination, if the large item is selected, the shaped component image is displayed in an image list of shaped component images included in the large item, and if the small item is selected, the shaped component image is displayed in an image list of shaped component images included in the small item.

5. The information processing device according to claim 4, wherein: The small item can be selected after the large item is selected.

6. The information processing device according to claim 1, wherein: The control unit further performs control to switch and display a plurality of the formed component images having different focal positions in the depth direction of the flow cell, for each formed component image in the first image list.

7. The information processing device according to any one of claims 1 to 6, wherein: The control unit further performs control to display items corresponding to each of the categories in different colors.

8. The information processing device according to claim 1, wherein: The classification unit further calculates the fitness of the formed component image with respect to the classification result, The control unit further performs control to arrange and display the shaped component images of the first image list in a suitable order or in a non-suitable order according to the degree of suitability.

9. The information processing device according to claim 1, wherein: The control unit further performs control to display the measurement results in a list for each of the categories, and to add a mark indicating that the confirmation is completed to the category in which the first image list is displayed and the formed component image is confirmed among the categories displayed in the list.

10. The information processing device according to claim 1, wherein: The control unit further performs control to set a magnification ratio of the formed component image when the first image list is displayed.

11. The information processing device according to claim 1, wherein: The control unit further performs control to set at least one of brightness and contrast of the formed component image when the first image list is displayed.

12. The information processing device according to claim 1, wherein: The information processing device further includes a storage unit that stores the formed component images classified by the classification unit and sample images of the formed component images. The control unit also performs the following control: when a shaped component image classified as the detection component by the classification unit is added as the sample image of the same classification, while a shaped component image list of the shaped component images included in the classification of the detection component is displayed on the display unit, an instruction to display the sample image is accepted, and further, while the shaped component image list and the sample image list of the sample images are simultaneously displayed on the display unit, a shaped component image selected from the shaped component image list is copied to the sample image list.

13. An information processing device comprising: a classification unit that cuts out a formed component image identified as a formed component from a plurality of images obtained by photographing a sample fluid including a plurality of formed components and flowing through a flow cell, and classifies the cut out formed component image into a detection component for each predetermined classification; a storage unit that stores the formed component images classified by the classification unit and sample images of the formed component images; and A control unit that performs the following display control: causing the display unit to display a formed component image list screen, the formed component image list screen including a first item button group, a first image list, and a second item button group, the first item button group consisting of a plurality of buttons set according to each type of the detection component, the first image list being a formed component image list selected by any button in the first item button group, the second item button group consisting of a plurality of buttons for selecting a moving destination of the formed component images of the first image list according to large items and small items obtained by subdividing the large items, and when the moving destination is selected by any button in the second item button group, causing the display unit to display a reclassification operation screen including the first image list and the second image list, the second image list being the formed component image list selected as the moving destination.

14. The information processing device according to claim 13, wherein: The control unit further performs control to highlight and display a shaped component image copied from the shaped component image list to the list of sample images.

15. The information processing device according to claim 14, wherein: The control of the emphasized display is a control for displaying the formed component image at the head of the list of the sample images.

16. The information processing device according to claim 13, wherein: The classification is divided into at least one of a large project and a small project obtained by subdividing the large project. The control unit also performs the following control: when selecting the classification of the detection component, when the large item is selected, the formed component image is displayed in the image list of the formed component images included in the large item; when the small item is selected, the formed component image is displayed in the image list of the formed component images included in the small item.

17. The information processing device according to claim 13, wherein: The control unit further performs control to switch and display a plurality of the formed component images having different focal positions in the depth direction of the flow cell, for each of the formed component images in the formed component image list.

18. The information processing device according to claim 13, wherein: The control unit further performs control to display items corresponding to each of the categories in different colors.

19. The information processing device according to claim 13, wherein: The classification unit further calculates the fitness of the formed component image with respect to the classification result, The control unit further performs control to arrange and display the shaped component images in the shaped component image list in a suitable order or a non-suitable order according to the suitability.

20. The information processing device according to claim 13, wherein: The control unit further performs control to set a magnification ratio of the formed component image when the formed component image list is displayed.

21. The information processing device according to claim 13, wherein: The control unit further performs control to set at least one of brightness and contrast of the formed component images when the formed component image list is displayed.

22. A measurement system comprising: a flow cell in which a specimen fluid including a plurality of formed components and a sheath fluid flow; a photographing unit that photographs the sample fluid flowing through the flow cell; and The information processing device according to claim 1 controls a plurality of images obtained by photographing the photographing unit.

23. A non-transitory storage medium storing a program for causing a computer to execute the following processing: Cut out a formed component image identified as a formed component from a plurality of images obtained by photographing a sample fluid including a plurality of formed components and flowing through a flow cell, and classify the cut out formed component image into detection components for each predetermined classification; The following display control is performed: a display unit is caused to display a formed component image list screen, the formed component image list screen includes a first item button group, a first image list, and a second item button group, the first item button group is composed of a plurality of buttons set according to each type of the detection component, the first image list is a formed component image list selected by any button in the first item button group, the second item button group is composed of a plurality of buttons for selecting a moving destination of the formed component images in the first image list according to large items and small items obtained by subdividing the large items, and when the moving destination is selected by any button in the second item button group, the display unit is caused to display a reclassification operation screen including the first image list and the second image list, the second image list being the formed component image list selected as the moving destination.

Images