Cell image analysis system, cell image analysis device, and cell image analysis program

Abstract

To facilitate the management of data necessary for cell image analysis.SOLUTION: A cell image analysis method to be executed by a cell image analysis system includes: an acquisition step for acquiring a cell image group containing a plurality of cell images; a display step for displaying a screen which enables a user to add user metadata to the cell images; and a storage step for storing the cell images in association with the user metadata added by the user.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a cell image analyzing system, a cell image analyzing device, and a cell image analyzing program. [Background technology]

[0002] Conventionally, a system for analyzing cell images has been used. Cited Document 1 discloses a data analysis device that includes a control unit that receives an operation to select analysis data acquired by an analysis device, a control unit that receives an operation to select a plurality of scripts that perform an analysis on the selected analysis data, and a control unit that performs analysis in parallel using the selected plurality of scripts on the selected analysis data, and a display unit that displays an analysis result acquired by the analysis of the analysis data by the control unit on the same screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-69333 A Summary of the Invention [Problem to be solved by the invention]

[0004] In order to properly analyze cell images, information such as the photographer and the magnification of the cell image is essential. However, in the past, this information was often managed in notebooks, and unless the analyst properly sorted the cell images to be analyzed based on the notes, the cell images could not be properly analyzed. Such sorting work required the analyst to have the knowledge to sort cell images for each analysis method, and was time-consuming to manually sort a large number of images, which placed a heavy burden on the analyst.

[0005] The present invention has been made in consideration of the above problems, and has an object to facilitate the management of data necessary for analyzing cell images. [Means for solving the problem]

[0006] A cell image analysis method according to one embodiment is a cell image analysis method executed by a cell image analysis system, and includes an acquisition step of acquiring a cell image group including a plurality of cell images, a display step of displaying a screen for a user to add user metadata to the cell images, and a storage step of storing the cell images in association with the user metadata added by the user. Effect of the Invention

[0007] According to one embodiment, it is possible to facilitate management of data required for analysis of cell images. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a cell image analyzing system 1000. [Diagram 2] 1 is a diagram illustrating an example of a hardware configuration of a cell image analyzer 1. FIG. [Diagram 3] 2 is a diagram illustrating an example of a hardware configuration of a user terminal 2. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of the cell image analyzer 1. [Diagram 5] FIG. 2 is a diagram illustrating an example of a functional configuration of a user terminal 2. [Figure 6] 1 is a flowchart showing an example of processing executed by the cell image analyzing system 1000. [Figure 7] FIG. 13 illustrates an example of a job registration screen. [Figure 8] FIG. 13 is a diagram showing an example of an analysis result display screen. [Figure 9] FIG. 1 is a diagram showing an example of a metadata display screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. In the description of the specification and drawings of each embodiment, components having substantially the same functional configuration are designated by the same reference numerals, and redundant description will be omitted.

[0010] <Configuration of Cell Image Analysis System 1000> First, an overview of a cell image analysis system 1000 according to this embodiment will be described. The cell image analysis system 1000 is an information processing system for analyzing a cell image group including a plurality of cell images photographed by an operator. A cell image group is a collection of a plurality of cell images. A cell image is an image of a cell cultured in a culture experiment or the like photographed by an imaging device such as a microscope.

[0011] Fig. 1 is a diagram showing an example of the configuration of a cell image analysis system 1000. As shown in Fig. 1, the cell image analysis system 1000 includes a cell image analyzer 1 and a user terminal 2, which are communicably connected to each other via a network N. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination of these. In the example of Fig. 1, the cell image analysis system 1000 includes one cell image analyzer 1 and one user terminal 2, but may include multiple of each.

[0012] The cell image analyzer 1 is an information processing device that analyzes cell images. The cell image analyzer 1 is, for example, a personal computer (PC), a smartphone, a tablet terminal, a server device, or a microcomputer, but is not limited to these.

[0013] The user terminal 2 is an information processing device operated by a user of the cell image analysis system 1000. The user is, for example, but not limited to, the person who photographed the cell image. The user terminal 2 is, for example, but not limited to, a PC, a smartphone, or a tablet terminal. The user uploads cell images from the user terminal 2 to the cell image analysis device 1. The cell image analysis device 1 analyzes the cell images uploaded from the user terminal 2. The user terminal 2 displays the analysis results of the cell images by the cell image analysis device 1.

[0014] <Hardware configuration of cell image analyzer 1> Next, a description will be given of the hardware configuration of the cell image analyzer 1. Fig. 2 is a diagram showing an example of the hardware configuration of the cell image analyzer 1. As shown in Fig. 2, the cell image analyzer 1 includes a processor 101, a memory 102, a storage 103, a communication I / F 104, an input device 105, an output device 106, and a drive device 107, which are connected to each other via a bus B1.

[0015] The processor 101 controls each component of the cell image analyzer 1 and realizes the functions of the cell image analyzer 1 by expanding into the memory 102 various programs including an OS (Operating System) and a cell image analysis program stored in the storage 103 and executing them. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or a DSP (Digital Signal Processor), but is not limited to these.

[0016] The memory 102 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), or a combination thereof. The ROM is, for example, a Programmable ROM (PROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), or a combination thereof. The RAM is, for example, but is not limited to, a Dynamic RAM (DRAM) or a Static RAM (SRAM).

[0017] The storage 103 stores various programs and data including an OS and a cell image analysis program. The storage 103 is, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a storage class memory (SCM), but is not limited to these.

[0018] The communication I / F 104 is an interface for connecting the cell image analyzer 1 to an external device via the network N and controlling communication. The communication I / F 104 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0019] The input device 105 is a device for inputting information to the cell image analyzer 1. The input device 105 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, an imaging device (camera), various sensors, or an operation button, but is not limited to these.

[0020] The output device 106 is a device for outputting information from the cell image analyzer 1. The output device 106 is, for example, a display device, a projector, a printer, a speaker, or a vibrator, but is not limited to these.

[0021] The drive device 107 is a device that reads and writes data to the recording medium 108. The drive device 107 is, for example, but not limited to, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or an SD card reader. The recording medium 108 is, for example, but not limited to, a CD (Compact Disc), a DVD (Digital Versatile Disc), a FD (Floppy Disk), an MO (Magneto-Optical disk), a BD (Blu-ray (registered trademark) Disc), a USB (registered trademark) memory, or an SD card.

[0022] In this embodiment, the cell image analysis program may be written into memory 102 or storage 103 during the manufacturing stage of the cell image analysis apparatus 1, or may be provided to the cell image analysis apparatus 1 via network N, or may be provided to the cell image analysis apparatus 1 via a non-transitory computer-readable recording medium such as recording medium 108.

[0023] <Hardware configuration of user terminal 2> Next, a description will be given of the hardware configuration of the user terminal 2. Fig. 3 is a diagram showing an example of the hardware configuration of the user terminal 2. As shown in Fig. 3, the user terminal 2 includes a processor 201, a memory 202, a storage 203, a communication I / F 204, an input device 205, an output device 206, and a drive device 207, which are connected to each other via a bus B2.

[0024] The processor 201 controls each component of the user terminal 2 and realizes the functions of the user terminal 2 by expanding into the memory 202 and executing various programs including an OS and a cell image analysis program stored in the storage 203. The processor 201 is, for example, a CPU, an MPU, a GPU, an ASIC, or a DSP, but is not limited to these.

[0025] The memory 202 may be, for example, a ROM, a RAM, or a combination thereof. The ROM may be, for example, a PROM, an EPROM, an EEPROM, or a combination thereof. The RAM may be, for example, but is not limited to, a DRAM or an SRAM.

[0026] The storage 203 stores various programs including an OS and a cell image analysis program, and data. The storage 203 is, for example, a flash memory, a HDD, an SSD, or an SCM, but is not limited to these.

[0027] The communication I / F 204 is an interface for connecting the user terminal 2 to an external device via the network N and controlling communication. The communication I / F 204 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0028] The input device 205 is a device for inputting information to the user terminal 2. The input device 205 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, an imaging device (camera), various sensors, or an operation button, but is not limited to these.

[0029] The output device 206 is a device for outputting information from the user terminal 2. The output device 206 is, for example, but is not limited to, a display device (display), a projector, a printer, a speaker, or a vibrator. The user terminal 2 includes a display device 206D as the output device 206.

[0030] The drive device 207 is a device that reads and writes data to the recording medium 208. The drive device 207 is, for example, but not limited to, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or an SD card reader. The recording medium 208 is, for example, but not limited to, a CD, a DVD, a FD, an MO, a BD, a USB (registered trademark) memory, or an SD card.

[0031] In this embodiment, the cell image analysis program may be written into memory 202 or storage 203 during the manufacturing stage of the user terminal 2, or may be provided to the user terminal 2 via the network N, or may be provided to the user terminal 2 via a non-transitory computer-readable recording medium such as recording medium 208.

[0032] <Functional configuration of cell image analyzer 1> Next, a description will be given of the functional configuration of the cell image analyzer 1. Fig. 4 is a diagram showing an example of the functional configuration of the cell image analyzer 1. As shown in Fig. 4, the cell image analyzer 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0033] The communication unit 11 is realized by the communication I / F 104. The communication unit 11 transmits and receives information to and from the user terminal 2 via the network N. The communication unit 11 receives cell image group data 221 from the user terminal 2, and transmits analysis result data 126, etc. to the user terminal 2.

[0034] The storage unit 12 is realized by the memory 102 and the storage 103. The storage unit 12 stores cell image group data 121, user metadata 122, file metadata 123, image metadata 124, statistical metadata 125, analysis result data 126, and advice data 127.

[0035] The cell image group data 121 is data (folder) of a cell image group, and is a collection of multiple image files generated by an image capture device that captures cell images. Each image file includes image data of the captured cell image and data related to the image capture conditions provided by the image capture device. The data related to the image capture conditions includes, but is not limited to, data indicating magnification, number of fields of view, number of repetitions, image capture model name, camera information, resolution, image capture date and time, and type of optical system (phase contrast, bright field, fluorescence, differential interference, near infrared, Raman spectroscopy, etc.).

[0036] The user metadata 122 is data related to a cell image provided by a user. The user metadata 122 is stored in association with a cell image. The user metadata 122 includes, but is not limited to, data related to research (analysis purpose, project, number of people involved, etc.), data related to culture (cell type, culture purpose (proliferation, differentiation), etc.), data related to the culture environment (culture medium, reagent, drug, container, device, etc.), data related to the imaging conditions (magnification, number of fields of view, number of repetitions, imaging model name, camera information, resolution, imaging date and time, type of optical system (phase contrast, bright field, fluorescence, differential interference, near infrared, Raman spectroscopy), etc.), and data indicating user comments (whether the experiment was successful, what was noticed in the experiment, what to do in the future, reflections, issues, etc.).

[0037] The file metadata 123 is data obtained from the image data of the cell image without analyzing the cell image itself. The file metadata 123 is stored in association with the cell image. The file metadata 123 includes, for example, but is not limited to, data related to the imaging conditions given by the imaging device, and data obtained from the folder structure of the cell image group data 121 (research purpose, project name, number of people involved). The data related to the imaging conditions includes, for example, but is not limited to, data indicating the magnification, number of fields of view, number of repetitions, imaging model name, camera information, resolution, imaging date and time, and type of optical system (phase difference, bright field, fluorescence, differential interference, near infrared, Raman spectroscopy).

[0038] The image metadata 124 is data obtained by performing image analysis on the cell image. The image metadata 124 is stored in association with the cell image. The image metadata 124 includes, but is not limited to, data indicating brightness (maximum value, minimum value, variation), the state of each cell (morphology, texture), the state of the cell population (morphology, texture statistics, distribution of the cell population), and the quality of the cell population (presence or absence of histogram abnormalities, presence or absence of dust, presence or absence of brightness unevenness).

[0039] The statistical metadata 125 is data obtained by statistically processing at least one of the user metadata 122, the file metadata 123, and the image metadata 124. The statistical metadata 125 is stored in association with the cell image group data 121. The statistical metadata 125 is, for example, the number of cell types, the number of photographers, and the number of cell images in the cell image group data 121, but is not limited to these.

[0040] The analysis result data 126 is information indicating the analysis result of the cell image group. The analysis result data 126 is stored in correspondence with the cell image group data 121. The analysis result data 126 includes, but is not limited to, the growth rate and growth curve of the cells, the stability of the time-course curve, the variance of the replicate data, the consistency of the metadata, the deviation between the cell populations, the degree of normalization of the cell populations, the appropriate analysis method (machine learning, linear analysis, etc.), the success or failure of graphing, and the reliability of the analysis method (data amount, data quality, etc.). The analysis result data 126 may be included in the statistical metadata 125.

[0041] The advice data 127 is data indicating advice to a user, generated based on at least one of the user metadata 122, the file metadata 123, the image metadata 124, and the statistical metadata 125. The advice data 127 is stored in association with the cell image group data 121. The advice includes, for example, advice regarding excess or deficiency, bias, and quality of cell images for each metadata, but is not limited to this.

[0042] The control unit 13 is realized by the processor 101 reading and executing a program from the memory 102 and cooperating with other hardware configurations. The control unit 13 includes an acquisition unit 131, an assignment unit 132, an image analysis unit 133, an analysis unit 134, and an advice unit 135.

[0043] The acquisition unit 131 acquires the cell image group data 221 from the user terminal 2 and stores it in the storage unit 12 as the cell image group data 121 .

[0044] The attachment unit 132 attaches the file metadata 123 and the image metadata 124 to the cell images, and attaches the statistical metadata 125 to the cell image group data 121 , and stores them in the storage unit 12 .

[0045] The image analysis unit 133 performs image analysis on the cell images included in the cell image group data 121. That is, the image analysis unit 133 performs image processing on the cell images included in the cell image group data 121 and analyzes the obtained data. For example, the image analysis unit 133 binarizes the cell images and measures the binarized image to obtain the image metadata 124. Note that the image analysis unit 133 can perform image analysis on the cell images using any method.

[0046] The analysis unit 134 analyzes the cell image group data 121, and stores the analysis result as analysis result data 126 in the storage unit 12 in association with the cell image group data 121. The analysis result is, for example, but not limited to, the growth rate and growth curve of the cells. The analysis unit 134 can analyze the cell image group by any method, such as machine learning or linear analysis.

[0047] The advice unit 135 generates advice for the user based on at least one of the user metadata 122, the file metadata 123, the image metadata 124, the statistical metadata 125, and the analysis result data 126, and stores the advice in the memory unit 12 in association with the cell image group data 121 as advice data 127.

[0048] The functional configuration of the cell image analyzer 1 is not limited to the above example. For example, the cell image analyzer 1 may have some of the functional configurations described above, and the user terminal 2 may have the rest. The cell image analyzer 1 may also have functional configurations other than those described above. Each functional configuration of the cell image analyzer 1 may be realized by software as described above, or may be realized by hardware such as an IC chip, a SoC (System on Chip), an LSI (Large Scale Integration), or a microcomputer.

[0049] <Functional configuration of user terminal 2> Next, a description will be given of the functional configuration of the user terminal 2. Fig. 5 is a diagram showing an example of the functional configuration of the user terminal 2. As shown in Fig. 5, the user terminal 2 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0050] The communication unit 21 is realized by the communication I / F 204. The communication unit 21 transmits and receives information to and from the cell image analyzer 1 via the network N. The communication unit 21 transmits cell image group data 221 to the cell image analyzer 1, and receives analysis result data 126 and the like from the cell image analyzer 1.

[0051] The storage unit 22 is realized by the memory 202 and the storage 203. The storage unit 22 stores cell image group data 221 and user metadata 222.

[0052] The cell image group data 221 is data (folder) of a cell image group, and is a collection of multiple image files generated by an image capturing device that captured the cell images. Each image file includes image data of the captured cell image and data related to the image capturing conditions provided by the image capturing device. The data related to the image capturing conditions includes, but is not limited to, data indicating the magnification, the number of fields of view, the number of repetitions, the model name of the camera, camera information, resolution, the date and time of capture, and the type of optical system (phase contrast, bright field, fluorescence, differential interference, near infrared, Raman spectroscopy).

[0053] The user metadata 222 is data related to the cell image assigned by the user. The user metadata 222 is stored in association with the cell image. The user metadata 222 includes, but is not limited to, data related to research (research objectives, project, number of people involved, etc.), data related to culture (cell type, culture objectives (proliferation, differentiation), etc.), data related to the culture environment (culture medium, reagent, drug, container, device, etc.), data related to the imaging conditions (magnification, number of fields of view, number of repetitions, imaging model name, camera information, resolution, imaging date and time, type of optical system (phase contrast, bright field, fluorescence, differential interference, near infrared, Raman spectroscopy), etc.), and data indicating user comments (whether the experiment was successful, what was noticed in the experiment, what would be done in the future, reflections, issues, etc.).

[0054] The control unit 23 is realized by the processor 201 reading and executing a program from the memory 202 and working in cooperation with other hardware configurations. The control unit 23 controls the overall operation of the user terminal 2. The control unit 23 includes an acquisition unit 231 and a display unit 232.

[0055] The acquisition unit 231 acquires the cell image group data 221 from the recording medium 208 , the imaging device connected as the input device 205 , or an external terminal connected via the network N, and stores it in the storage unit 12 .

[0056] The display unit 232 displays various screens on the display device 206D.

[0057] The functional configuration of the user terminal 2 is not limited to the above example. For example, the user terminal 2 may have some of the above functional configurations, and the user terminal 2 may have the rest. The user terminal 2 may also have functional configurations other than those described above. As described above, each functional configuration of the user terminal 2 may be realized by software, or may be realized by hardware such as an IC chip, an SoC, an LSI, or a microcomputer.

[0058] <Processing Executed by Cell Image Analysis System 1000> Next, a description will be given of the processing executed by the cell image analyzing system 1000. Fig. 6 is a flowchart showing an example of the processing executed by the cell image analyzing system 1000.

[0059] (Step S101) First, the display unit 232 of the user terminal 2 displays a job registration screen sc1 on the display device 206D in response to a user operation (step S101). The job registration screen sc1 is a screen for a user to register a job. A job refers to an analysis of a group of cell images by the cell image analyzer 1. The cell image analyzer 1 analyzes a group of cell images on a job-by-job basis. In other words, a plurality of cell images registered as analysis targets in a job corresponds to a group of cell images.

[0060] (Step S102) Next, the acquisition unit 231 of the user terminal 2 acquires the cell image group data 221 selected by the user on the job registration screen sc1, and stores it in the storage unit 12 (Step S102).

[0061] (Step S103) Furthermore, the acquisition unit 231 of the user terminal 2 acquires the user metadata 222 assigned by the user on the job registration screen sc1, and stores the same in the storage unit 12 in association with each cell image included in the cell image group data 221 (step S103).

[0062] (Step S104) After that, the user terminal 2 transmits (uploads) the cell image group data 221 and the user metadata 222 to the cell image analyzer 1 (step S104).

[0063] Fig. 7 is a diagram showing an example of the job registration screen sc1. The job registration screen sc1 in Fig. 7 includes an image selection area sc11, an image selection button sc12, a user metadata attachment field sc13, and an upload button sc14.

[0064] The image selection area sc11 is an area for selecting a cell image group to be processed as an analysis target of the job. When the user drags and drops the image file of the cell image group into the image selection area sc11, the cell image group to be processed as an analysis target of the job is selected, and the image file of the cell image group is stored in the storage unit 12 as cell image group data 221.

[0065] The image selection button sc12 is an area for selecting a cell image group to be processed as an analysis target of the job. When the user selects an image file of the cell image group from the image selection button sc12, the cell image group to be processed as an analysis target of the job is selected, and the image file of the cell image group is stored in the storage unit 12 as cell image group data 221.

[0066] The user selects a cell image group by using either the image selection area sc11 or the image selection button sc12. The acquisition unit 231 acquires the image files of the cell image group selected here as the cell image group data 221 (step S102).

[0067] The user metadata assignment field sc13 is a list for a user to assign user metadata 222 to a group of cell images selected as the analysis target of a job. In the example of FIG. 7, the image file names of the group of cell images selected as the analysis target of a job are displayed as row names, and the items (types) of the user metadata 222 to be assigned to each cell image are displayed as column names. When the user selects a group of cell images, the image file names of the cell images included therein are extracted and set as row names in the user metadata assignment field sc13. Note that the matrix may be reversed.

[0068] When a user inputs a value into an item of user metadata 222 of a cell image (a cell in the user metadata assignment column sc13), user metadata 222 is assigned to that item of the cell image. For example, "MSC" is input into the cell type of cell image Img1.jpg. This means that user metadata 222 "MSC" is assigned as the cell type of cell image Img1.jpg. The item (type) of user metadata 222 assigned on the job registration screen sc1 may be set in advance, or may be arbitrarily set by the user.

[0069] The user assigns user metadata 222 to each cell image by inputting values ​​into each cell of the user metadata assignment column sc13 generated after the selection of the cell image group. The acquisition unit 231 acquires the user metadata 222 assigned here, and stores it in the storage unit 12 in association with each cell image included in the cell image group data 221 (step S103).

[0070] The upload button sc14 is a button for transmitting the cell image group selected as the analysis target of the job and the user metadata assigned by the user to the cell image analyzer 1. When the user selects the upload button sc14, the user terminal 2 transmits the cell image group data 221 and the user metadata 222 to the cell image analyzer 1 (step S104).

[0071] In this way, by requesting the user to assign user metadata 222 to each cell image at the same time as selecting a group of cell images, the user can be prompted to register data necessary for analyzing the cell images in the cell image analyzing system 1000. Furthermore, the data necessary for analyzing the cell images can be managed in a common format called user metadata 222 on the cell image analyzing system 1000. Furthermore, by setting the items of user metadata in advance, the user can register data necessary for analyzing the cell images without having to learn in advance what data is necessary for analyzing the cell images. As a result, it is possible to facilitate management of data necessary for analyzing the cell images and reduce the burden on the user for analyzing the cell images.

[0072] 7 includes the user metadata assignment field sc13, and thus corresponds to a screen on which the user assigns the user metadata 222. However, the selection of the cell image group and the assignment of the user metadata 222 may be performed on different screens. In this case, the screen on which the user metadata 222 is assigned corresponds to a screen on which the user assigns the user metadata 222. In addition, the assignment of the user metadata 222 may be performed in a format different from that of the user metadata assignment field sc13.

[0073] (Step S105) The acquisition unit 131 of the cell image analyzer 1 acquires the cell image group data 221 and user metadata 222 transmitted by the user terminal 2, and stores them in the storage unit 12 as the cell image group data 121 and user metadata 122 (step S105). The user metadata 122 is stored in association with each cell image included in the cell image group data 121. As a result, a new job is registered, and the cell image analyzer 1 executes this job. Specifically, the cell image analyzer 1 executes steps S105 to S113.

[0074] (Step S106) First, the attachment unit 132 attaches file metadata 123 to each cell image in the cell image group data 121 (step S106). Specifically, the attachment unit 132 extracts data related to the shooting conditions included in each image file of the cell image group data 121 and data obtained from the folder structure of the cell image group data 121, and stores them as file metadata 123 in the storage unit 12. The file metadata 123 is stored in association with each cell image.

[0075] In this way, by saving the data related to the shooting conditions included in the image file as file metadata 123, the data required for analyzing the cell images can be managed in a common format on the cell image analyzing system 1000. Furthermore, the data required for analyzing the cell images can be collected and managed without bothering the user. As a result, the management of the data required for analyzing the cell images can be facilitated, and the burden on the user for analyzing the cell images can be reduced.

[0076] (Step S107) Next, the image analysis unit 133 performs image analysis on the cell images included in the cell image group data 121, and acquires the image metadata 124 (step S107).

[0077] (Step S108) The assigning unit 132 assigns image metadata 124 to each cell image of the cell image group data 121 (step S108). Specifically, the assigning unit 132 stores the image metadata 124 acquired by the image analysis unit 133 in step S107 in the storage unit 12 in association with each cell image.

[0078] In this way, by storing the data obtained by image analysis of the cell image as image metadata 124, the data required for analyzing the cell image can be managed in a common format on the cell image analyzing system 1000. Furthermore, the data required for analyzing the cell image can be collected and managed without bothering the user. As a result, the management of the data required for analyzing the cell image can be facilitated, and the burden on the user for analyzing the cell image can be reduced.

[0079] (Step S109) Next, the attachment unit 132 performs statistical processing on at least one of the user metadata 122, the file metadata 123, and the image metadata 124 (step S109). The attachment unit 132 may perform statistical processing on the user metadata 122, the file metadata 123, and the image metadata 124 individually or in combination.

[0080] (Step S110) Next, the assignment unit 132 assigns the statistical metadata 125 to the cell image group data 121 (cell image group) (step S110). This corresponds to assigning the statistical metadata 125 to the job corresponding to the cell image group data 121. Specifically, the assignment unit 132 stores the data obtained by the statistical processing in step S109 in the storage unit 12 as the statistical metadata 125 in association with the cell image group data 121.

[0081] In this way, by storing data obtained by statistically processing at least one of the user metadata 122, the file metadata 123, and the image metadata 124 as statistical metadata 125, data required for analyzing cell images can be managed in a common format on the cell image analyzing system 1000. Furthermore, data required for analyzing cell images can be collected and managed without bothering the user. As a result, management of data required for analyzing cell images can be facilitated, and the burden on the user for analyzing cell images can be reduced.

[0082] (Step S111) Next, the analysis unit 134 analyzes the cell image group data 121, and stores the analysis result as analysis result data 126 in association with the cell image group data 121 in the storage unit 12 (step S111). The analysis unit 134 selects appropriate cell images for each analysis method based on the user metadata 122, file metadata 123, and image metadata 124, and analyzes the cell image group. For example, among the cell images included in the cell image group data 121, it is possible to analyze only cell images of the same photographer, analyze only cell images of the same magnification, analyze only cell images of the same cell type, analyze when the number of cell images to which metadata is added is a predetermined number or more, and the like. The selection method of the cell image for each analysis method based on the user metadata 122, file metadata 123, and image metadata 124 is registered in advance. The addition unit 132 may add the analysis result data 126 to the cell image group data 121 (cell image group) as metadata.

[0083] In this way, the analysis unit 134 selects appropriate cell images for each analysis method based on the user metadata 122, file metadata 123, and image metadata 124, and performs analysis, thereby allowing the cell images to be appropriately analyzed without bothering the user.

[0084] (Step S112) Next, the advice unit 135 generates advice for the user based on at least one of the user metadata 122, the file metadata 123, the image metadata 124, the statistical metadata 125, and the analysis result data 126, and stores the advice in the memory unit 12 in association with the cell image group data 121 as advice data 127 (step S112).

[0085] (Step S113) After that, the cell image analyzer 1 transmits the user metadata 122, the file metadata 123, the image metadata 124, the statistical metadata 125, the analysis result data 126, and the advice data 127 to the user terminal 2 (step S113).

[0086] (Step S114) When the display unit 232 of the user terminal 2 receives the analysis result data 126 etc., it displays the analysis result data 126 etc. on the display device 206D.

[0087] Fig. 8 is a diagram showing an example of the analysis result display screen sc2. The analysis result display screen sc2 is a screen that displays the analysis result data 126, etc. In the example of Fig. 8, a job name sc21, statistical data sc22, a filter image sc23, an analysis result sc24, and advice sc25 are displayed.

[0088] The job name sc21 is the name of the job set by the user. In the example of Fig. 8, the job name sc21 is "Project A".

[0089] The statistical data sc22 is a graphical representation of the statistical metadata 125. In the example of Fig. 8, the statistical data sc22 displays the percentage of cell type and the percentage of culture condition, which are assigned as user metadata, in a pie chart.

[0090] The filtered image sc23 is an image obtained by performing image analysis on the cell image included in the image metadata 124. In the example of Fig. 8, the filtered images sc23 of the cell images Img1.jpg, Img2.jpg, and Img3.jpg are displayed.

[0091] The analysis result sc24 is a graph of the analysis result data 126. In the example of Fig. 8, the analysis results displayed are the change in cell count for each culture day and the cell growth rate for each medium.

[0092] The advice sc25 is a text display of the advice data 127. In the example of Fig. 8, the advice "Please add a cell image of medium B" is displayed.

[0093] The user can easily understand the analysis results and advice for the cell image group by referring to the analysis result display screen sc2. Furthermore, the user can know what cell images are lacking for an appropriate analysis of the cell image group by referring to the advice, and can therefore prepare the cell images necessary for an appropriate analysis of the cell image group without hesitation.

[0094] Fig. 9 is a diagram showing an example of the metadata display screen sc3. The metadata display screen sc3 is a screen for displaying a list of at least one of the user metadata 122, the file metadata 123, and the image metadata 124. In the example of Fig. 9, the user metadata (cell type, photographer, and shooting location), file metadata (magnification), and image metadata (cell count) of the cell images Img1.jpg to Img10.jpg are displayed in a list.

[0095] By referring to the metadata display screen sc3, the user can easily understand the metadata assigned to each cell image.

[0096] The metadata attached to each cell image may be added, deleted, or modified by a user operation on the metadata display screen SC3. Also, the user metadata 122, file metadata 123, and image metadata 124 may be downloadable in a format such as a CSV file from the metadata display screen SC3. Also, the downloaded CSV file may be edited and re-registered in the job.

[0097] <Summary> As described above, according to this embodiment, a cell image analysis method is implemented by the cell image analysis system 1000, which includes step S101 of acquiring a cell image group including a plurality of cell images, step S102 of displaying a screen for the user to assign user metadata 222 to the cell images, and step S105 of storing the cell images in association with the user metadata 122 assigned by the user.

[0098] In this way, by requesting the user to assign user metadata 222 to each cell image at the same time as selecting a group of cell images, the user can be prompted to register data necessary for analyzing the cell images in the cell image analyzing system 1000. Furthermore, the data necessary for analyzing the cell images can be managed in a common format called user metadata 222 on the cell image analyzing system 1000. Furthermore, by setting the items of user metadata in advance, the user can register data necessary for analyzing the cell images without having to learn in advance what data is necessary for analyzing the cell images. As a result, it is possible to facilitate management of data necessary for analyzing the cell images and reduce the burden on the user for analyzing the cell images.

[0099] In this embodiment, part of the processing of the cell image analysis device 1 may be performed by the cell image analysis device 1. For example, if the cell image analysis device 1 is an edge AI camera, at least part of the detection processing of the subject information of the first image using a machine learning model may be performed by the cell image analysis device 1. In this case, the cell image analysis device 1 transmits the subject information of the first image to the cell image analysis device 1 instead of or together with the first image data. The cell image analysis device 1 performs the subsequent processing based on the subject information received from the cell image analysis device 1. This provides the same effects as the above embodiment.

[0100] <Additional Notes> The present embodiment includes the following disclosure.

[0101] (Appendix 1) A cell image analysis method executed by a cell image analysis system, comprising: An acquisition step of acquiring a cell image group including a plurality of cell images; a display step of displaying a screen for allowing a user to add user metadata to the cell image; a storage step of storing the cell image and the user metadata assigned by the user in association with each other; A method for analyzing a cell image comprising:

[0102] (Appendix 2) The user metadata is data related to the cell image that is assigned by the user. A cell image analysis method as described in appendix 1.

[0103] (Appendix 3) The user metadata includes a cell type. A cell image analysis method as described in appendix 1.

[0104] (Appendix 4) The method further includes a step of adding file metadata, which is data related to the imaging conditions of the cell image, to the cell image. A cell image analysis method as described in appendix 1.

[0105] (Appendix 5) The method further includes a step of adding image metadata, which is data obtained by performing image analysis on the cell image, to the cell image. A cell image analysis method as described in appendix 1.

[0106] (Appendix 6) The method further includes a step of assigning statistical metadata, which is data obtained by statistically processing at least one of the user metadata, the file metadata, and the image metadata, to the group of cell images. A cell image analysis method as described in appendix 1.

[0107] (Appendix 7) The method further includes a display step of analyzing the group of cell images based on at least one of the user metadata, the file metadata, the image metadata, and the statistical metadata, and displaying an analysis result. A cell image analysis method as described in appendix 1.

[0108] (Appendix 8) The method further includes a display step of displaying a metadata display screen that displays a list of at least one of the user metadata, the file metadata, and the image metadata. A cell image analysis method as described in appendix 1.

[0109] (Appendix 9) generating advice for the user based on at least one of the user metadata, the file metadata, the image metadata, the statistical metadata, and the analysis results of the group of cell images; A cell image analysis method as described in appendix 1.

[0110] (Appendix 10) an acquisition unit for acquiring a cell image group including a plurality of cell images; a display unit that displays a screen for a user to add user metadata to the cell image; a storage unit that stores the cell image and the user metadata assigned by the user in association with each other; A cell image analysis system comprising:

[0111] (Appendix 11) An acquisition step of acquiring a cell image group including a plurality of cell images; a display step of displaying a screen for allowing a user to add user metadata to the cell image; a storage step of storing the cell image and the user metadata assigned by the user in association with each other; A cell image analysis program for causing a cell image analysis system to execute a cell image analysis method comprising:

[0112] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is indicated by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. The present invention is not limited to the above-mentioned embodiments, and various modifications are possible within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0113] 1:Cell image analyzer 2: User terminal 11: Communications Department 12: Storage section 13: Control unit 121: Cell image data 122: User metadata 123: File metadata 124: Image metadata 125:Statistical Metadata 126: Analysis result data 127: Advice Data 131: Acquisition Department 132: Granting section 133: Image analysis unit 134: Analysis Department 135: Advice Department

Claims

1. A cell image analysis method executed by a cell image analysis system, comprising: An acquisition step of acquiring a cell image group including a plurality of cell images; a display step of displaying a screen for allowing a user to add user metadata to the cell image; a storage step of storing the cell image and the user metadata assigned by the user in association with each other; A cell image analysis method comprising:

2. The user metadata is data related to the cell image that is assigned by the user. The cell image analysis method according to claim 1 .

3. The user metadata includes a cell type. The cell image analysis method according to claim 1 .

4. The method further includes a step of adding file metadata obtained from a file of the cell image to the cell image. The cell image analysis method according to claim 1 .

5. The method further includes a step of adding image metadata, which is data obtained by performing image analysis on the cell image, to the cell image. The cell image analysis method according to claim 1 .

6. The method further includes a step of assigning statistical metadata, which is data obtained by statistically processing at least one of the user metadata, the file metadata, and the image metadata, to the group of cell images. The cell image analysis method according to claim 1 .

7. The method further includes a display step of analyzing the group of cell images based on at least one of the user metadata, the file metadata, the image metadata, and the statistical metadata, and displaying an analysis result. The cell image analysis method according to claim 1 .

8. The method further includes a display step of displaying a metadata display screen that displays a list of at least one of the user metadata, the file metadata, and the image metadata. The cell image analysis method according to claim 1 .

9. generating advice for the user based on at least one of the user metadata, the file metadata, the image metadata, the statistical metadata, and the analysis results of the group of cell images; The cell image analysis method according to claim 1 .

10. an acquisition unit for acquiring a cell image group including a plurality of cell images; a display unit that displays a screen for a user to add user metadata to the cell image; a storage unit that stores the cell image and the user metadata assigned by the user in association with each other; A cell image analysis system comprising:

11. An acquisition step of acquiring a cell image group including a plurality of cell images; a display step of displaying a screen for allowing a user to add user metadata to the cell image; a storage step of storing the cell image and the user metadata assigned by the user in association with each other; A cell image analysis program for causing a cell image analysis system to execute a cell image analysis method comprising:

Images