Image reproduction method and device
By automatically obtaining and processing single-channel images of samples to be observed using metadata information, the complexity problem of acquiring superimposed images in the prior art is solved, and the consistency of image quality and simplification of operation are achieved.
Patent Information
- Application Number
- PCT/CN2024/133346
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-21
- Filing Date
- 2024-11-20
- Publication Date
- 2025-05-30
AI Technical Summary
In the prior art, acquiring superimposed images requires the user to manually set and adjust the parameters of multiple single-channel images, and the process is complicated and not intuitive.
By obtaining metadata information of the initial superimposed image, multiple single-channel images corresponding to the sample to be observed are automatically acquired, and image processing is performed based on the metadata information to generate superimposed images with the same image quality.
The superimposed image of the sample to be observed is automatically generated based on the existing superimposed image, which simplifies user operations and ensures consistency of image quality and the expected effect of image processing.
Smart Images

Figure CN2024133346_30052025_PF_FP_ABST
Abstract
Description
Image reproduction method and device
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This disclosure is based on and claims the priority of Chinese patent application with application number 202311561773.2 and application date November 21, 2023. The entire content of the Chinese patent application is hereby incorporated into this disclosure by reference. Technical Field
[0003] The present disclosure relates to image processing technology, and in particular to an image reproduction method and device. Background Art
[0004] With the development of image processing and analysis technology, superimposed images composed of multiple single-channel images have become mainstream. For example, when observing a sample, multiple single-channel images of the sample are usually acquired and superimposed to form a superimposed image so that the operator can observe the sample from the superimposed image. Summary of the Invention
[0005] An embodiment of the first aspect of the present disclosure proposes an image reproduction method, which includes: obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image; for a sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtaining more than one single-channel images corresponding to the sample to be observed; superimposing the more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and performing image processing based on the second image and the image processing information corresponding to the first image.
[0006] Optionally, the first metadata information also includes image processing information corresponding to one or more single-channel images constituting the first image. Before synthesizing more than one single-channel images corresponding to the sample to be observed, the method also includes: performing image processing on the one or more single-channel images corresponding to the sample to be observed based on the image processing information corresponding to the one or more single-channel images constituting the first image.
[0007] Optionally, the image processing includes artificial intelligence (AI) analysis, the image processing information includes an AI analysis target and information about an AI analysis tool, and the image processing based on the image processing information includes: obtaining the AI analysis tool according to the information about the AI analysis tool; and using the AI analysis tool to perform image processing to achieve the AI analysis target.
[0008] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0009] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0010] Optionally, the AI analysis tool includes multiple AI analysis models; after obtaining the AI analysis tool based on the information about the AI analysis tool, the method further includes: determining a target AI analysis model from the multiple AI analysis models; using the AI analysis tool to perform image processing to achieve the AI analysis target includes: using the target AI analysis model to perform image processing to achieve the AI analysis target.
[0011] Optionally, determining the target AI analysis model from the multiple AI analysis models includes: receiving AI analysis requirements input by a user; and determining the target AI analysis model based on the AI analysis requirements and feature information of each AI analysis model.
[0012] Optionally, determining a target AI analysis model from the multiple AI analysis models includes: displaying information about the multiple AI analysis models; and determining a target AI analysis model from the multiple AI analysis models based on a user's selection input.
[0013] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0014] Optionally, before obtaining more than one single-channel images corresponding to the sample to be observed based on the parameter information respectively corresponding to the more than one single-channel images, it also includes: outputting a first prompt information, wherein the first prompt information is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and receiving a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0015] Optionally, for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtaining more than one single-channel images corresponding to the sample to be observed includes: for each single-channel image constituting the first image, based on the parameter information corresponding to the single-channel image, adjusting the parameter settings of the image generating device; and using the adjusted image generating device to obtain the single-channel image corresponding to the sample to be observed.
[0016] Optionally, before adjusting the parameter settings of the image generating device, the method further includes: determining whether the parameter settings of the image generating device can be adjusted based on parameter information corresponding to the single-channel image; and adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image includes: when the parameter settings of the image generating device can be adjusted, adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image.
[0017] Optionally, the method further comprises: when the parameter setting of the image generating device cannot be adjusted, outputting second prompt information, wherein the second prompt information is used to indicate to the user the parameter of the image generating device that cannot be automatically adjusted.
[0018] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0019] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; determining whether the parameter settings of the image generating device can be adjusted includes at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0020] Optionally, before using the adjusted image generating device to acquire a single-channel image corresponding to the sample to be observed, the method further includes: receiving a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0021] Optionally, before using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed, the method further includes: determining whether the parameter settings of the image generating device are effective; using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed includes: after the parameter settings of the image generating device are effective, using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed.
[0022] Optionally, the method further includes: storing parameter information corresponding to the more than one single-channel images and image processing information corresponding to the second image as second metadata information corresponding to the second image.
[0023] Optionally, the method also includes: storing parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image as second metadata information corresponding to the second image.
[0024] An embodiment of the second aspect of the present disclosure proposes an image reproduction method, which includes: obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to one or more single-channel images constituting the first image; for a sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtaining more than one single-channel images corresponding to the sample to be observed; performing image processing on one or more single-channel images corresponding to the sample to be observed based on the image processing information corresponding to the one or more single-channel images constituting the first image; and superimposing the more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0025] Optionally, the image processing includes artificial intelligence (AI) analysis, the image processing information includes an AI analysis target and information about an AI analysis tool, and the image processing based on the image processing information includes: obtaining the AI analysis tool according to the information about the AI analysis tool; and using the AI analysis tool to perform image processing to achieve the AI analysis target.
[0026] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0027] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0028] Optionally, the AI analysis tool includes multiple AI analysis models; after obtaining the AI analysis tool based on the information about the AI analysis tool, the method further includes: determining a target AI analysis model from the multiple AI analysis models; using the AI analysis tool to perform image processing to achieve the AI analysis target includes: using the target AI analysis model to perform image processing to achieve the AI analysis target.
[0029] Optionally, determining the target AI analysis model from the multiple AI analysis models includes: receiving AI analysis requirements input by a user; and determining the target AI analysis model based on the AI analysis requirements and feature information of each AI analysis model.
[0030] Optionally, determining a target AI analysis model from the multiple AI analysis models includes: displaying information about the multiple AI analysis models; and determining a target AI analysis model from the multiple AI analysis models based on a user's selection input.
[0031] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0032] Optionally, before obtaining more than one single-channel images corresponding to the sample to be observed based on the parameter information respectively corresponding to the more than one single-channel images, it also includes: outputting a first prompt information, wherein the first prompt information is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and receiving a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0033] Optionally, for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtaining more than one single-channel images corresponding to the sample to be observed includes: for each single-channel image constituting the first image, based on the parameter information corresponding to the single-channel image, adjusting the parameter settings of the image generating device; and using the adjusted image generating device to obtain the single-channel image corresponding to the sample to be observed.
[0034] Optionally, before adjusting the parameter settings of the image generating device, the method further includes: determining whether the parameter settings of the image generating device can be adjusted based on parameter information corresponding to the single-channel image; and adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image includes: when the parameter settings of the image generating device can be adjusted, adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image.
[0035] Optionally, the method further comprises: when the parameter setting of the image generating device cannot be adjusted, outputting second prompt information, wherein the second prompt information is used to indicate to the user the parameter of the image generating device that cannot be automatically adjusted.
[0036] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0037] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; determining whether the parameter settings of the image generating device can be adjusted includes at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0038] Optionally, before using the adjusted image generating device to acquire a single-channel image corresponding to the sample to be observed, the method further includes: receiving a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0039] Optionally, before using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed, the method further includes: determining whether the parameter settings of the image generating device are effective; using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed includes: after the parameter settings of the image generating device are effective, using the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed.
[0040] Optionally, the method also includes: storing parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image as second metadata information corresponding to the second image.
[0041] A third aspect embodiment of the present disclosure provides an image reproduction device, comprising: a first acquisition module for obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image; a second acquisition module for acquiring, for a sample to be observed, more than one single-channel images corresponding to the sample to be observed based on the parameter information corresponding to the more than one single-channel images; a generation module for superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and a processing module for performing image processing on the second image based on the image processing information corresponding to the first image.
[0042] Optionally, the first metadata information also includes image processing information corresponding to one or more single-channel images constituting the first image, and the processing module is further used to perform image processing on one or more single-channel images corresponding to the sample to be observed based on the image processing information corresponding to one or more single-channel images constituting the first image.
[0043] Optionally, the image processing includes artificial intelligence (AI) analysis, the image processing information includes AI analysis targets and information about the AI analysis tool, and the processing module is used to: obtain the AI analysis tool based on the information about the AI analysis tool; and use the AI analysis tool to perform image processing to achieve the AI analysis target.
[0044] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0045] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0046] Optionally, the AI analysis tool includes multiple AI analysis models; the device also includes: a determination module for determining a target AI analysis model from the multiple AI analysis models; the processing module is used to: use the target AI analysis model to perform image processing to achieve the AI analysis target.
[0047] Optionally, the determination module is used to: receive AI analysis requirements input by a user; and determine the target AI analysis model based on the AI analysis requirements and feature information of each AI analysis model.
[0048] Optionally, the determination module is used to: display information about the multiple AI analysis models; and determine a target AI analysis model from the multiple AI analysis models based on user selection input.
[0049] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0050] Optionally, the device also includes: a transceiver module: used to output a first prompt message, wherein the first prompt message is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and used to receive a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0051] Optionally, the second acquisition module includes: an adjustment unit for adjusting parameter settings of an image generating device for each single-channel image constituting the first image based on parameter information corresponding to the single-channel image; and an acquisition unit for using the adjusted image generating device to acquire a single-channel image corresponding to the sample to be observed.
[0052] Optionally, the second acquisition module also includes: a first determination unit, used to determine whether the parameter settings of the image generating device can be adjusted based on the parameter information corresponding to the single-channel image; and the adjustment unit, used to adjust the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image when the parameter settings of the image generating device can be adjusted.
[0053] Optionally, the second acquisition module further includes: an output unit, configured to output second prompt information when the parameter settings of the image generating device cannot be adjusted, wherein the second prompt information is used to indicate to the user the parameters of the image generating device that cannot be automatically adjusted.
[0054] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0055] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; the first determination unit is used to perform at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0056] Optionally, the second acquisition module further includes: a receiving unit, configured to receive a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0057] Optionally, the second acquisition module further includes: a second determination unit, used to determine whether the parameter setting of the image generating device is effective; the second acquisition module is used to use the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed after the parameter setting of the image generating device is effective.
[0058] Optionally, the apparatus further includes: a storage module configured to store parameter information corresponding to the more than one single-channel images and image processing information corresponding to the second image as second metadata information corresponding to the second image.
[0059] Optionally, the device also includes: a storage module for storing parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image as second metadata information corresponding to the second image.
[0060] The fourth aspect embodiment of the present disclosure provides an image reproduction device, which includes: a first acquisition module for obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to one or more single-channel images constituting the first image; a second acquisition module for acquiring, for the sample to be observed, more than one single-channel images corresponding to the sample to be observed based on the parameter information corresponding to the more than one single-channel images; a processing module for performing image processing on the one or more single-channel images corresponding to the sample to be observed based on the image processing information corresponding to the one or more single-channel images constituting the first image; and a generation module for superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0061] Optionally, the image processing includes artificial intelligence (AI) analysis, the image processing information includes AI analysis targets and information about the AI analysis tool, and the processing module is used to: obtain the AI analysis tool based on the information about the AI analysis tool; and use the AI analysis tool to perform image processing to achieve the AI analysis target.
[0062] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0063] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0064] Optionally, the AI analysis tool includes multiple AI analysis models; the device also includes: a determination module for determining a target AI analysis model from the multiple AI analysis models; the processing module is used to: use the target AI analysis model to perform image processing to achieve the AI analysis target.
[0065] Optionally, the determination module is used to: receive AI analysis requirements input by a user; and determine the target AI analysis model based on the AI analysis requirements and feature information of each AI analysis model.
[0066] Optionally, the determination module is used to: display information about the multiple AI analysis models; and determine a target AI analysis model from the multiple AI analysis models based on user selection input.
[0067] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0068] Optionally, the device also includes: a transceiver module: used to output a first prompt message, wherein the first prompt message is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and used to receive a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0069] Optionally, the second acquisition module includes: an adjustment unit for adjusting parameter settings of an image generating device for each single-channel image constituting the first image based on parameter information corresponding to the single-channel image; and an acquisition unit for using the adjusted image generating device to acquire a single-channel image corresponding to the sample to be observed.
[0070] Optionally, the second acquisition module also includes: a first determination unit, used to determine whether the parameter settings of the image generating device can be adjusted based on the parameter information corresponding to the single-channel image; and the adjustment unit, used to adjust the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image when the parameter settings of the image generating device can be adjusted.
[0071] Optionally, the second acquisition module further includes: an output unit, configured to output second prompt information when the parameter settings of the image generating device cannot be adjusted, wherein the second prompt information is used to indicate to the user the parameters of the image generating device that cannot be automatically adjusted.
[0072] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0073] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; the first determination unit is used to perform at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0074] Optionally, the second acquisition module further includes: a receiving unit, configured to receive a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0075] Optionally, the second acquisition module further includes: a second determination unit, used to determine whether the parameter setting of the image generating device is effective; the second acquisition module is used to use the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed after the parameter setting of the image generating device is effective.
[0076] Optionally, the device also includes: a storage module for storing parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image as second metadata information corresponding to the second image.
[0077] The fifth aspect embodiment of the present disclosure provides an image reproduction device, comprising: a processor; a memory for storing instructions executable by the processor; wherein, when the instructions are executed by the processor, the processor is used to execute the image reproduction method described in the first or second aspect embodiment above.
[0078] The sixth embodiment of the present disclosure proposes a computer-readable storage medium having instructions stored thereon. When the instructions are executed by a processor, the image reproduction method described in the first or second embodiment can be implemented.
[0079] The embodiment of the present disclosure provides an image reproduction method and device, which obtains first metadata information corresponding to a first image, obtains more than one single-channel image corresponding to the sample to be observed based on parameter information included in the first metadata information and corresponding to more than one single-channel image constituting the first image, and superimposes the more than one single-channel image corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed. The second image is processed based on the image processing information included in the first metadata information, and can automatically obtain a corresponding superimposed image (i.e., the second image) for the sample to be observed based on the current superimposed image (i.e., the first image). Since the multiple single-channel images constituting the newly generated superimposed image are obtained in the same manner as the multiple single-channel images constituting the current superimposed image and are processed in the same image processing manner as the newly generated superimposed image, the newly generated superimposed image has the same image quality as the current superimposed image and is expected to have similar image processing effects. Therefore, the present disclosure provides a technical solution that enables a user to reproduce a superimposed image with the same image quality for the sample to be observed based on an existing superimposed image and obtain a desired image processing result.
[0080] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0081] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0082] FIG1 is a schematic flow chart of an image reproduction method according to an embodiment of the present disclosure;
[0083] FIG2 is a schematic flow chart of another image reproduction method according to an embodiment of the present disclosure;
[0084] FIG3 is a schematic flow chart of another image reproduction method according to an embodiment of the present disclosure;
[0085] FIG4 is a schematic flow chart of another image reproduction method according to an embodiment of the present disclosure;
[0086] FIG5 is a schematic flow chart of another image reproduction method according to an embodiment of the present disclosure;
[0087] FIG6 is a schematic structural diagram of an image reproduction device provided by an embodiment of the present disclosure;
[0088] FIG7 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0089] FIG8 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0090] FIG9 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0091] FIG10 is a schematic structural diagram of an image reproduction device provided by an embodiment of the present disclosure;
[0092] FIG11 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0093] FIG12 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0094] FIG13 is a schematic structural diagram of another image reproduction device provided by an embodiment of the present disclosure;
[0095] FIG14 is a schematic structural diagram of a system for implementing an image reproduction method provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0096] The following describes in detail embodiments of the present disclosure, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.
[0097] It should be noted that the terms "first," "second," and the like in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the numbers used in this manner are interchangeable where appropriate so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure as detailed in the appended claims.
[0098] With the advancement of image processing and analysis technologies, overlay images composed of multiple single-channel images have become mainstream. For example, when observing a sample, multiple single-channel images of the sample are typically acquired and then overlaid to create a superimposed image, allowing the operator to obtain sufficient information from the overlaid image. In existing technologies, to obtain a superimposed image, the user must first acquire each single-channel image and then overlay them to create the overlaid image. This requires the user to understand the various parameters used by the image generation device to acquire each single-channel image and perform various complex settings to obtain each single-channel image.
[0099] To this end, the present application provides an image reproduction method, device and computer-readable storage medium for simply and automatically generating an overlay image with the same image quality for a sample to be observed based on an existing overlay image and obtaining a desired image processing result, so that the user does not need to understand the various parameters used by the image generation device when acquiring each single-channel image and perform complex setting operations to obtain the desired image processing result.
[0100] The image reproduction method and device provided by the present application are described in detail below with reference to the accompanying drawings.
[0101] FIG1 is a flow chart of an image reproduction method according to an embodiment of the present disclosure. As shown in FIG1 , the method may be performed by an image reproduction device, and the method may include but is not limited to the following steps:
[0102] Step S101: Obtain first metadata information corresponding to a first image.
[0103] In some embodiments, the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image.
[0104] The first image may be a superimposed image stored in a gallery of the image reproduction device, or may be a superimposed image received from another external device. The image processing information is information related to image processing.
[0105] Among them, the superimposed image refers to an image composed of multiple single-channel images superimposed, where the single-channel image can be an image of various styles, such as a color image captured by a conventional optical camera, an infrared image captured by an infrared camera, or a fluorescence image generated with the help of a fluorescence microscope.
[0106] The first metadata information corresponding to the first image may be stored in an image library in association with the first image, or may be stored within the first image. The first metadata information includes parameter information corresponding to each of the multiple single-channel images constituting the first image, and image processing information corresponding to the first image.
[0107] The parameter information corresponding to a single-channel image may include parameters used to acquire the single-channel image. For example, when the single-channel image is captured by a conventional optical camera, the parameter information corresponding to the single-channel image may include the shooting parameters of the optical camera when capturing the single-channel image, where the shooting parameters may include exposure time, focus mode, etc. For another example, when the single-channel image is a fluorescent image generated by a fluorescence microscope, the parameter information corresponding to the single-channel image may include the imaging mode of the fluorescence microscope and microscope parameters, where the microscope parameters may include objective lens magnification, working distance, etc.
[0108] Step S102 : for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtain more than one single-channel images corresponding to the sample to be observed.
[0109] After obtaining the first metadata information, more than one single-channel image corresponding to the sample to be observed may be respectively obtained based on the parameter information corresponding to each single-channel image constituting the first image and included in the first metadata information.
[0110] That is, according to the number of single-channel images constituting the first image, the same number of single-channel images corresponding to the samples to be observed are acquired, and the single-channel images corresponding to the samples to be observed are acquired respectively in the same manner as the single-channel images of the first image are acquired.
[0111] For example, the first image is composed of three single-channel images, namely, the first single-channel image Image1, the second single-channel image Image2, and the third single-channel image Image3; the obtained first metadata information includes parameter information Parameter1 corresponding to the first single-channel image Image1, parameter information Parameter2 corresponding to the second single-channel image Image2, and parameter information Parameter3 corresponding to the third single-channel image Image3. For the sample to be observed, the first single-channel image Image1' corresponding to the sample to be observed can be obtained based on parameter information Parameter1, the second single-channel image Image2' corresponding to the sample to be observed can be obtained based on parameter information Parameter2, and the third single-channel image Image3' corresponding to the sample to be observed can be obtained based on parameter information Parameter3.
[0112] In some embodiments, for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtaining more than one single-channel image corresponding to the sample to be observed includes: for each single-channel image constituting the first image, based on the parameter information corresponding to the single-channel image, adjusting the parameter setting of the image generating device; and using the adjusted image generating device to obtain the single-channel image corresponding to the sample to be observed.
[0113] Specifically, to obtain each single-channel image corresponding to the sample to be observed, it is necessary to adjust the parameter settings of the image generation device based on the obtained parameter information corresponding to each single-channel image of the first image, and use the adjusted image generation device to obtain each single-channel image of the sample to be observed. The image generation device can be part of or connected to the image reproduction device that performs the image reproduction method.
[0114] For example, the obtained parameter information is Parameter1, Parameter2, and Parameter3, wherein Parameter1 includes the exposure time and focus mode of the camera, Parameter2 includes the exposure time and focus mode of the camera, the imaging mode of the fluorescence microscope, and the microscope parameters, and Parameter3 includes the exposure time and focus mode of the camera, the imaging mode of the fluorescence microscope, and the microscope parameters (the parameters included in Parameter3 may be the same as or different from the parameters included in Parameter2); then the parameter settings of the image generating device (here the camera) can be adjusted based on Parameter1, and the adjusted camera can be used to obtain a first single-channel image corresponding to the sample to be observed; the parameter settings of the image generating device (here the camera and the fluorescence microscope) can be adjusted based on Parameter2, and the second single-channel image corresponding to the sample to be observed can be obtained using the adjusted camera and the fluorescence microscope; and the parameter settings of the image generating device (here the camera and the fluorescence microscope) can be adjusted based on Parameter3, and the adjusted camera and the fluorescence microscope can be used to obtain a third single-channel image corresponding to the sample to be observed.
[0115] In some embodiments, before adjusting the parameter settings of the image generating device, the method further includes: determining whether the parameter settings of the image generating device can be adjusted based on the parameter information corresponding to the single-channel image. Adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image includes: when the parameter settings of the image generating device can be adjusted, adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image.
[0116] In some embodiments, the method further includes: when the parameter setting of the image generating device cannot be adjusted, outputting second prompt information, wherein the second prompt information is used to indicate to the user the parameter of the image generating device that cannot be automatically adjusted.
[0117] Since some parameter settings of the image generating device may not be automatically adjusted in some cases and need to be adjusted manually by the user, for example, the objective lens magnification of a fluorescence microscope requires the user to manually rotate the knob to adjust it. In order to avoid problems caused by the inability to automatically adjust the parameter settings of the image generating device (such as the inability to obtain a single-channel image with the desired parameter settings), before adjusting the parameter settings of the image generating device, it is necessary to determine whether the parameter settings of the image generating device can be adjusted based on the parameter information. If the parameter settings of the image generating device can be adjusted based on the parameter information, the parameter settings of the image generating device are adjusted accordingly; if the parameter settings of the image generating device cannot be adjusted based on the parameter information, a second prompt information can be output to prompt the user that the parameter settings of the image generating device cannot be adjusted accordingly. The second prompt information can indicate to the user which parameters of the image generating device cannot be automatically adjusted. For example, when the output second prompt information indicates the objective lens magnification, the user can be informed by the prompt information that the objective lens magnification needs to be manually adjusted.
[0118] In some embodiments, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0119] Since some parameter settings of the image generating device are usually complicated, the user may not understand how to set the parameters of the image generating device. Therefore, in order to help the user appropriately adjust the parameter settings of the image generating device, the second prompt information can also include guidance information, which can guide the user to manually adjust the parameters that cannot be automatically adjusted.
[0120] For example, the second prompt information indicates that the objective lens magnification cannot be adjusted automatically. At the same time, the second prompt information may include guidance information, which is used to indicate to the user the specific operating instructions for adjusting the objective lens magnification, so that the user can easily manually adjust the objective lens magnification according to the guidance information.
[0121] In some embodiments, the second prompt information may be provided in the form of audio output, text output, or any other output.
[0122] In some embodiments, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; determining whether the parameter settings of the image generating device can be adjusted includes at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0123] To obtain an overlay image corresponding to the sample to be observed, an image generation device is required to capture the multiple single-channel images that make up the overlay image. These single-channel images can be color images, infrared images, fluorescence images, and so on. When the single-channel image is a color image or an infrared image, the image generation device includes a camera; when the single-channel image is a fluorescence image, the image generation device includes both a microscope and a camera.
[0124] Accordingly, the parameter information may include at least one of an imaging mode of the microscope, microscope parameters, and shooting parameters of the camera.
[0125] When determining whether parameter settings of an image generating device are adjustable, a determination is made based on the parameter information as to whether parameter settings of a microscope and / or camera of the image generating device are adjustable. For example, if the parameter information includes camera shooting parameters, a determination is made as to whether the camera can be adjusted according to the shooting parameters. For another example, if the parameter information includes an imaging mode of the microscope, microscope parameters, and camera shooting parameters, a determination is made as to whether the microscope can be adjusted according to the microscope parameters, whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information, and whether the camera can be adjusted according to the shooting parameters.
[0126] In some embodiments, before using the adjusted image generating device to acquire a single-channel image corresponding to the sample to be observed, the method further includes: receiving a second instruction, wherein the second instruction indicates that the parameter settings of the image generating device have been successfully adjusted.
[0127] When adjusting the parameter settings of the image generating device based on the parameter information, it may happen that the parameter settings of the image generating device are not successfully adjusted. If the image generating device is used to acquire a single-channel image when the parameter settings of the image generating device are not successfully adjusted, the acquired single-channel image may not be consistent with the expected single-channel image, that is, it may not meet the user's needs.
[0128] To avoid the aforementioned issues, the present application provides a user interaction function. Before using the adjusted image generation device to acquire a single-channel image corresponding to the sample to be observed, user confirmation is required. Upon receiving a confirmation instruction indicating that the parameter settings of the image generation device have been successfully adjusted, the adjusted image generation device is used to acquire a single-channel image corresponding to the sample to be observed.
[0129] In some embodiments, in order to prompt the user to confirm the adjustment of the parameter settings of the image generating device, the method further includes: outputting prompt information for instructing the user to confirm the adjustment of the parameter settings of the image generating device.
[0130] For example, after adjusting the parameter settings of the image generating device based on the parameter information, a prompt message "Please confirm whether the XX parameter of the image generating device has been successfully adjusted to XX" is output. After receiving the prompt message, the user confirms whether the corresponding parameters of the image generating device have been successfully adjusted to the expected values. If the corresponding parameters of the image generating device have been successfully adjusted to the expected values, a confirmation instruction can be entered; otherwise, the user needs to manually adjust the parameters that have not been successfully adjusted, and enter a confirmation instruction after adjusting the corresponding parameters of the image generating device to the expected values.
[0131] In some embodiments, before using the adjusted image generation device to acquire a single-channel image corresponding to the sample to be observed, the method further includes: determining whether parameter settings for the image generation device are effective. Acquiring a single-channel image corresponding to the sample to be observed using the adjusted image generation device includes: acquiring a single-channel image corresponding to the sample to be observed using the adjusted image generation device after the parameter settings for the image generation device are effective.
[0132] After adjustments are made to certain parameter settings on the image generation device, they take some time to take effect. In particular, to obtain a stacked image corresponding to the sample under observation, the image generation device must acquire multiple single-channel images that comprise the stacked image. However, the parameter information corresponding to each single-channel image may vary significantly, requiring significant adjustments to the image generation device's parameter settings. Consequently, these adjustments take some time to take effect.
[0133] For example, the camera shooting parameter exposure time corresponding to the first single-channel image is 10s, while the camera shooting parameter exposure time corresponding to the second single-channel image is 100s. After using the camera to acquire the first single-channel image, it is necessary to reset the camera exposure time and wait for a period of time for the adjusted exposure time to take effect before using the camera again to acquire the second single-channel image. If the second single-channel image is acquired immediately after the exposure time is adjusted (that is, before the adjusted exposure time takes effect), the exposure time used at this time is still the original exposure time (10s) instead of the adjusted exposure time (100s). In this case, the second single-channel image acquired may be inconsistent with the expected single-channel image, which means that it cannot meet user needs.
[0134] To avoid the aforementioned problem, before using the adjusted image generation device to acquire a single-channel image corresponding to the sample to be observed, it is further determined whether the parameter settings of the image generation device are effective. After determining that the parameter settings of the image generation device are effective, the adjusted image generation device is used to acquire a single-channel image corresponding to the sample to be observed.
[0135] Step S103 : superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0136] After acquiring each single-channel image corresponding to the sample to be observed, the acquired multiple single-channel images are superimposed to obtain a superimposed image corresponding to the sample to be observed.
[0137] For example, after obtaining the first single-channel image Image1', the second single-channel image Image2', and the third single-channel image Image3' corresponding to the sample to be observed, the first single-channel image Image1', the second single-channel image Image2', and the third single-channel image Image3' are superimposed to generate a superimposed image corresponding to the sample to be observed.
[0138] After generating the second image, the image generation and reproduction device may present the generated second image to the user.
[0139] Step S104: performing image processing on the second image based on the image processing information.
[0140] The first metadata information also includes image processing information corresponding to the first image. Therefore, after the second image is generated, image processing can be performed on the second image according to the image processing information.
[0141] In some embodiments, the image processing may include artificial intelligence (AI) analysis, and the image processing information may include an AI analysis target and information about an AI analysis tool. Based on the image processing information, performing image processing includes: obtaining the AI analysis tool based on the information about the AI analysis tool; and performing image processing using the AI analysis tool to achieve the AI analysis target.
[0142] In some embodiments, the AI analysis tool includes one or more AI analysis models, and the information about the AI analysis tool includes at least one of the following: relevant information for obtaining the AI analysis model; or the AI analysis model.
[0143] When performing AI analysis on an image, an AI analysis model is typically used to achieve the AI analysis goal. To obtain the AI analysis model used for AI analysis, relevant information for obtaining the AI analysis model can be included in the image processing information, and the corresponding AI analysis model can be obtained based on the relevant information.
[0144] Among them, the relevant information used to obtain the AI analysis model can be, for example, the storage address of the AI analysis model, the name of the AI analysis model, the name of the cell to which the AI analysis model is applied, the index of the AI analysis model, etc.
[0145] However, an AI analysis model is typically generated through training. For example, an initial AI analysis model can typically be continuously trained to obtain an updated AI analysis model. In other words, the AI analysis model is not always constant. After the first image is processed using the initial AI analysis model, the storage address of the initial AI analysis model can be used to obtain relevant information about the AI analysis model. However, if the AI analysis model is subsequently updated, the updated AI analysis model may replace the initial AI analysis model and be stored at the corresponding storage address. In this case, if the AI analysis model is still obtained based on the storage address of the AI analysis model, the obtained AI analysis model is the updated AI analysis model, rather than the initial AI analysis model used to perform AI analysis on the first image.
[0146] To ensure that the AI analysis model obtained based on the image processing information corresponding to the first image is the AI analysis model used for AI analysis of the first image, the AI analysis model itself can be directly included in the image processing information corresponding to the first image. The AI analysis model can be stored in a document format.
[0147] In some embodiments, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0148] As described above, the initial AI analysis model can be continuously trained to obtain an updated AI analysis model. Therefore, in addition to the initial AI analysis model, multiple updated AI analysis models can be obtained through different training processes. The updated AI analysis models obtained through different training processes are different.
[0149] For example, after using the initial AI analysis model to analyze an image, the user finds that the initial AI analysis model fails to successfully identify some separated cells in the image (for example, identifies multiple separated cells as a single cell) or fails to identify some cells in the image (for example, identification errors occur). Therefore, the initial AI analysis model cannot meet the user's needs. In this case, the user usually annotates the image (for example, annotates the separated cells, annotates the missed cells), and uses the annotated images to update the initial AI analysis model through training to obtain an updated AI analysis model.
[0150] For example, after using the initial AI analysis model to analyze an image, the user finds that the initial AI analysis model fails to successfully distinguish between the image background and the cells in the image. Therefore, the initial AI analysis model cannot meet the user's needs. In this case, the user usually annotates the image (for example, annotates the background and cells with different labels) and uses the annotated image to update the initial AI analysis model through training to obtain an updated AI analysis model.
[0151] To distinguish between different AI analysis models, information about AI analysis tools also includes feature information for each AI analysis model. For example, feature information can identify the problems that the AI analysis model excels at handling and the training objectives for the AI analysis model. For example, some AI analysis models are better at distinguishing between background and cells, while others are better at identifying isolated cells.
[0152] In some embodiments, when the AI analysis tool includes multiple AI analysis models, after obtaining the AI analysis tool based on information about the AI analysis tool, the method further includes: determining a target AI analysis model from the multiple AI analysis models. Using the AI analysis tool to perform image processing to achieve the AI analysis goal includes: using the target AI analysis model to perform image processing to achieve the AI analysis goal.
[0153] When multiple AI analysis models are acquired based on information about the AI analysis tool, a target AI analysis model can be determined from the multiple AI analysis models, and the target AI analysis model can be used to perform image processing to achieve the AI analysis goal.
[0154] In some embodiments, determining a target AI analysis model from the multiple AI analysis models includes: receiving an AI analysis requirement input by a user; and determining the target AI analysis model based on the AI analysis requirement and feature information of each AI analysis model.
[0155] According to an embodiment of the present disclosure, a target AI analysis model can be recommended to a user. Specifically, an AI analysis requirement can be received from the user, such as the AI analysis goal the user hopes to achieve, the problem the user hopes to solve, etc. Based on the AI analysis requirement and the feature information of each AI analysis model, the image reproduction device determines an AI analysis model whose feature information matches the AI analysis requirement as the target AI analysis model.
[0156] The user may determine the AI analysis requirement based on the second image. For example, the user may observe the second image based on experience and thereby determine the AI analysis requirement for performing AI analysis on the second image.
[0157] In some embodiments, determining a target AI analysis model from the plurality of AI analysis models includes: displaying information about the plurality of AI analysis models; and determining a target AI analysis model from the plurality of AI analysis models based on a user's selection input.
[0158] According to an embodiment of the present disclosure, a user may select a target AI analysis model from a plurality of AI analysis models. Specifically, information about the plurality of AI analysis models (such as the name and storage address of each AI analysis model) may be displayed on a display interface, for example, in the form of a list, and the AI analysis model selected by the user may be determined as the target AI analysis model based on the user's selection input.
[0159] In some embodiments, the AI analysis objectives include at least one of: determining cell confluence; determining cell count; or determining cell transfection efficiency.
[0160] For example, if the image processing information indicates that the first AI analysis model is used to determine the cell transfection rate in the first image, the first analysis model may also be used to determine the cell transfection rate in the second image.
[0161] In some embodiments, the image generation and reproduction device itself may not have an image processing function. In this case, the image generation and reproduction device can send the image processing information and the second image to an external image processing device. After the external image processing device performs image processing on the second image based on the image processing information, the image processing device returns the processed second image to the image generation and reproduction device. The image generation and reproduction device can present the processed second image to the user.
[0162] According to the image reproduction method provided by the embodiment of the present disclosure, by obtaining first metadata information corresponding to a first image; for a sample to be observed, based on parameter information corresponding to more than one single-channel images constituting the first image included in the first metadata information, respectively obtaining more than one single-channel image corresponding to the sample to be observed; superimposing the more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and for the second image, performing image processing based on the image processing information included in the first metadata information, it is possible to automatically obtain a corresponding superimposed image (i.e., the second image) for the sample to be observed based on the current superimposed image (i.e., the first image). Since the multiple single-channel images constituting the newly generated superimposed image are obtained in the same manner as the multiple single-channel images constituting the current superimposed image and are processed in the same image processing manner as the newly generated superimposed image, the newly generated superimposed image has the same image quality as the current superimposed image and is expected to have a similar image processing effect. Therefore, the user can reproduce a superimposed image with the same image quality for the sample to be observed based on the existing superimposed image and is expected to have a similar image processing effect.
[0163] The information processing method involved in the embodiment of the present disclosure may include at least one of steps S101 to S104. For example, steps S101 to S103 may be implemented as independent embodiments, but are not limited thereto.
[0164] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or may be arbitrarily combined with the optional implementations of other embodiments.
[0165] FIG2 is a flow chart of another image reproduction method according to an embodiment of the present disclosure. As shown in FIG2 , the method can be performed by an image reproduction device, and the method may include but is not limited to the following steps:
[0166] Step S201: Obtain first metadata information corresponding to a first image.
[0167] In some embodiments, the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image.
[0168] For a detailed description of step S201 , reference may be made to the description of step S101 in the above embodiment, which will not be repeated here.
[0169] Step S202: outputting a first prompt message, wherein the first prompt message is used to prompt the user to confirm whether to generate a second image for the sample to be observed.
[0170] In some cases, obtaining a corresponding superimposed image of the sample requires preprocessing the sample. For example, obtaining a fluorescent image of the sample requires staining the sample beforehand. Alternatively, capturing an image of a specific portion of the sample requires positioning the sample appropriately.
[0171] Therefore, in order to obtain an overlay image corresponding to the sample to be observed, according to this embodiment, after obtaining the first metadata information corresponding to the first image, a first prompt message can be output to prompt the user to confirm whether to generate an overlay image for the sample to be observed. After receiving this first prompt message, if the user confirms to generate an overlay image for the sample to be observed, it is necessary to complete preprocessing of the sample to be observed to ensure that an overlay image corresponding to the sample to be observed can be obtained.
[0172] In some embodiments, the first prompt information may include parameter information corresponding to each single-channel image of the first image, so that the user can judge whether to obtain each single-channel image of the sample to be observed based on the corresponding parameter information according to the parameter information corresponding to each single-channel image of the first image.
[0173] Step S203: Receive a first instruction, wherein the first instruction instructs the user to confirm generating a second image for the sample to be observed.
[0174] If the user confirms to generate a superimposed image for the sample to be observed, a first instruction may be provided.
[0175] After receiving the first instruction, the image reproduction device confirms to generate a superimposed image for the sample to be observed based on the first instruction.
[0176] Step S204 : for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtain more than one single-channel images corresponding to the sample to be observed.
[0177] Step S205 : superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0178] Step S206: performing image processing on the second image based on the image processing information.
[0179] For a detailed description of steps S204-S206, reference may be made to the description of steps S102-S104 in the above embodiment, which will not be repeated here.
[0180] According to an embodiment of the present disclosure, an image reproduction method is provided, which obtains first metadata information corresponding to a first image; outputs prompt information for prompting a user to confirm whether to generate a superimposed image for a sample to be observed; receives a second instruction instructing the user to confirm generating a superimposed image for the sample to be observed; for the sample to be observed, based on parameter information included in the first metadata information and corresponding to the more than one single-channel images constituting the first image, respectively obtains more than one single-channel image corresponding to the sample to be observed; superimposes the more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and performs image processing on the second image based on the image processing information included in the first metadata information. Based on the current superimposed image (i.e., the first image), a corresponding superimposed image (i.e., the second image) can be automatically obtained for the sample to be observed. Since the multiple single-channel images constituting the newly generated superimposed image are obtained in the same manner as the multiple single-channel images constituting the current superimposed image and are processed in the same image processing manner as the current superimposed image, the newly generated superimposed image has the same image quality as the current superimposed image and is expected to have a similar image processing effect. Thus, the user can reproduce a superimposed image with the same image quality for the sample to be observed based on the existing superimposed image and obtain a desired image processing result.
[0181] The information processing method involved in the embodiments of the present disclosure may include at least one of steps S201 to S206. For example, steps S201 to S205 may be implemented as independent embodiments, or steps S201 and S203 to S205 may be implemented as independent embodiments, but are not limited thereto.
[0182] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or may be arbitrarily combined with the optional implementations of other embodiments.
[0183] FIG3 is a flow chart of another image reproduction method according to an embodiment of the present disclosure. As shown in FIG3 , the method can be performed by an image reproduction device, and the method may include but is not limited to the following steps:
[0184] Step S301: Obtain first metadata information corresponding to a first image.
[0185] In some embodiments, the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image.
[0186] For a detailed description of step S301 , reference may be made to the description of step S101 in the above embodiment, which will not be repeated here.
[0187] Step S302 : for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtain more than one single-channel images corresponding to the sample to be observed.
[0188] Step S303 : superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0189] Step S304: performing image processing on the second image based on the image processing information.
[0190] For a detailed description of steps S302 - S304 , reference may be made to the description of steps S102 - S104 in the above embodiment, which will not be repeated here.
[0191] Step S305 : storing parameter information corresponding to the more than one single-channel images and image processing information corresponding to the second image as second metadata information corresponding to the second image.
[0192] After the second image is generated, the parameter information corresponding to each single-channel image constituting the second image and the image processing information corresponding to the second image are stored as second metadata information corresponding to the second image, so that the parameter information corresponding to each single-channel image and the image processing information corresponding to the second image can be subsequently obtained based on the second image, thereby realizing image reproduction based on the second image.
[0193] According to the image reproduction method provided by the embodiment of the present disclosure, first metadata information corresponding to a first image is obtained; for a sample to be observed, based on parameter information included in the first metadata information and corresponding to more than one single-channel images constituting the first image, more than one single-channel images corresponding to the sample to be observed are respectively obtained; the more than one single-channel images corresponding to the sample to be observed are superimposed to generate a second image corresponding to the sample to be observed; for the second image, image processing is performed based on the image processing information included in the first metadata information; and the parameter information corresponding to the more than one single-channel images and the image processing information corresponding to the second image are stored as second metadata information corresponding to the second image. Based on the current superimposed image (i.e., the first image), a corresponding superimposed image (i.e., the second image) can be automatically obtained for the sample to be observed. In addition, the parameter information corresponding to each single-channel image and the image processing information corresponding to the second image can be obtained from the corresponding second metadata information of the second image. Because the multiple single-channel images that make up the newly generated overlay image are obtained in the same manner as the multiple single-channel images that make up the current overlay image and are processed using the same image processing method as the current overlay image, the newly generated overlay image has the same image quality as the current overlay image and is expected to have similar image processing effects. As a result, the user can reproduce an overlay image with the same image quality for the sample to be observed based on the existing overlay images and obtain the desired image processing results. In addition, because the second metadata information corresponding to the second image stores parameter information corresponding to each single-channel image and image processing information corresponding to the second image, the user can subsequently reproduce the image based on the second image.
[0194] The information processing method involved in the embodiment of the present disclosure may include at least one of steps S301 to S305. For example, steps S301-S303 may be implemented as an independent embodiment, or steps S301-S304 may be implemented as an independent embodiment, but are not limited thereto.
[0195] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or with the optional implementations in other embodiments. For example, steps S301-S305 may be combined with steps S202-S203, but the present invention is not limited thereto.
[0196] FIG4 is a flow chart showing another method for reproducing an image according to an embodiment of the present disclosure. As shown in FIG4 , the method may be performed by an image reproducing device, and the method may include but is not limited to the following steps:
[0197] Step S401: Obtain first metadata information corresponding to a first image.
[0198] In some embodiments, the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image.
[0199] For a detailed description of step S401 , please refer to the description of step S101 in the above embodiment, which will not be repeated here.
[0200] Furthermore, in some embodiments, the first metadata information further includes image processing information corresponding to one or more single-channel images constituting the first image.
[0201] According to an embodiment of the present disclosure, since the first image is a superimposed image composed of multiple single-channel images, in addition to the first image being subjected to image processing, the single-channel images that constitute the first image may also be subjected to image processing. Therefore, the first metadata information may also include image processing information corresponding to one or more single-channel images. Specifically, each single-channel image that constitutes the first image may be subjected to image processing, or only some of the single-channel images that constitute the first image may be subjected to image processing.
[0202] In some embodiments, the first image may not have been image processed, but only one or more single-channel images constituting the first image have been image processed. In this case, the first metadata information does not include image processing information corresponding to the first image, but includes image processing information corresponding to the one or more single-channel images.
[0203] Step S402 : for the sample to be observed, based on the parameter information corresponding to the more than one single-channel images, respectively obtain more than one single-channel images corresponding to the sample to be observed.
[0204] For a detailed description of step S402, reference may be made to the description of step S102 in the above embodiment, which will not be repeated here.
[0205] Step S403 , performing image processing on each of more than one single-channel images corresponding to the sample to be observed based on the image processing information; or sending the second image and the image processing information to an external image processing device, and receiving the processed second image from the external image processing device.
[0206] When the first metadata information also includes image processing information corresponding to one or more single-channel images, after obtaining one or more single channels of the second image, image processing can be performed on the one or more single-channel images of the second image according to the image processing information.
[0207] The specific process of performing image processing on each single-channel image according to the image processing information may refer to the process of performing image processing on the second image according to the image processing information, such as the description of step S104, which will not be repeated here.
[0208] For example, if the image processing information corresponding to the first single-channel image of the first image indicates the use of the first AI analysis model to determine the cell transfection rate in the first single-channel image, the first analysis model can also be used to determine the cell transfection rate of the first single-channel image of the second image (wherein the first single-channel image of the second image is a single-channel image obtained using the parameter information corresponding to the first single-channel image of the first image); if the image processing information corresponding to the second single-channel image of the first image indicates cropping of the second single-channel image, the second single-channel image of the second image (wherein the second single-channel image of the second image is a single-channel image obtained using the parameter information corresponding to the second single-channel image of the first image) can also be cropped.
[0209] In some embodiments, the image generation and reproduction device itself may not have an image processing function. In this case, the image generation and reproduction device can send the image processing information and the second image to an external image processing device. After the external image processing device performs image processing on each single-channel image of the second image based on the image processing information, the image processing device returns the processed second image to the image generation and reproduction device. The image generation and reproduction device can present the processed second image to the user.
[0210] In some embodiments, parameter information corresponding to more than one single-channel images constituting the second image, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image are stored as second metadata information corresponding to the second image.
[0211] Step S404 : superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0212] Among them, one or more single-channel images in more than one single channel corresponding to the sample to be observed have been image processed. The one or more single-channel images that have been image processed can be superimposed with other single-channel images that have not been image processed to obtain a second image, or all more than one single-channel images that have not been image processed can be superimposed to obtain a second image, depending on specific needs.
[0213] Step S405: performing image processing on the second image based on the image processing information.
[0214] For a detailed description of steps S404-S405, reference may be made to the description of steps S103-S104 in the above embodiment, which will not be repeated here.
[0215] According to the image reproduction method provided by the embodiment of the present disclosure, first metadata information corresponding to a first image is obtained; for the sample to be observed, based on parameter information included in the first metadata information and corresponding to the more than one single-channel images constituting the first image, more than one single-channel images corresponding to the sample to be observed are respectively obtained; the more than one single-channel images corresponding to the sample to be observed are superimposed to generate a second image corresponding to the sample to be observed; and image processing is performed on the second image and / or its respective single-channel images based on the image processing information included in the first metadata information. Based on the current superimposed image (i.e., the first image), a corresponding superimposed image (i.e., the second image) can be automatically obtained for the sample to be observed. In addition, based on the current superimposed image, image processing can also be automatically performed on the superimposed image corresponding to the sample to be observed.
[0216] The information processing method involved in the embodiment of the present disclosure may include at least one of steps S401 to S405. For example, steps S401 to S404 may be implemented as independent embodiments, and steps S401 to S403 may be implemented as independent embodiments, but are not limited thereto.
[0217] In the embodiments of the present disclosure, some or all of the steps and their optional implementations may be arbitrarily combined with some or all of the steps in other embodiments, or with the optional implementations in other embodiments. For example, steps S401-S404 may be combined with steps S202-S203, and steps S401-S404 may be combined with step S305, but the present invention is not limited thereto.
[0218] FIG5 shows a flow chart of another image reproduction method according to an embodiment of the present disclosure. As shown in FIG5 , the method may include but is not limited to the following steps:
[0219] Step S501: Obtain a first image from a gallery.
[0220] Step S502: open the first image.
[0221] Step S503: The user clicks the image reproduction button.
[0222] Step S504: Adjust various parameter settings of the image generation device.
[0223] Step S505 , determining whether the objective lens of the microscope meets the parameter setting. If the objective lens does not meet the parameter setting, executing step S506 , otherwise executing step S507 .
[0224] Step S506: instructing the user to adjust the objective lens.
[0225] Step S507 : The user confirms that the various parameter settings of the image generation device have been adjusted.
[0226] Step S508: Return to the home page and prompt the user that the image reproduction is ready.
[0227] Step S509 , in response to the user confirming to perform image reproduction, obtaining each single-channel image corresponding to the sample to be observed and generating a superimposed image corresponding to the sample to be observed based on each single-channel image for display.
[0228] Step S510 , performing AI analysis on the superimposed image corresponding to the sample to be observed using the same AI analysis model as that for the first image.
[0229] Step S511: display the image processed by AI analysis.
[0230] The embodiments of the present disclosure further provide a device for implementing any of the above methods. For example, a device is provided, which includes units or modules for implementing each step in any of the above methods.
[0231] It should be understood that the division of the various units or modules in the device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. In addition, the units or modules in the device may be implemented in the form of a processor calling software: for example, the device includes a processor, the processor is connected to a memory, and the memory stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or implement the functions of the various units or modules of the above-mentioned device, where the processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor, and the memory is a memory within the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units or modules can be realized by designing the hardware circuits. The above-mentioned hardware circuits can be understood as one or more processors; for example, in one implementation, the above-mentioned hardware circuit is an application-specific integrated circuit (ASIC), which realizes the functions of some or all of the above units or modules by designing the logical relationship of the components in the circuit; for example, in another implementation, the above-mentioned hardware circuit can be realized by a programmable logic device (PLD). Taking a field programmable gate array (FPGA) as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by configuring the configuration file, thereby realizing the functions of some or all of the above units or modules. All units or modules of the above devices can be realized in the form of software called by the processor, or in the form of hardware circuits, or in part by the form of software called by the processor, and the rest by hardware circuits.
[0232] In the embodiments of the present disclosure, the processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of the hardware circuit. The logical relationship of the above-mentioned hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and implementing the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.
[0233] FIG6 is a schematic structural diagram of an image reproduction device provided by an embodiment of the present disclosure. As shown in FIG6 , the image reproduction device 500 may include a first acquisition module 501 , a second acquisition module 502 , a generation module 503 and a processing module 504 .
[0234] The first acquisition module 501 is used to obtain first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the first image.
[0235] The second acquisition module 502 is configured to respectively acquire, for the sample to be observed, more than one single-channel images corresponding to the sample to be observed based on parameter information respectively corresponding to the more than one single-channel images.
[0236] The generating module 503 is configured to superimpose more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0237] The processing module 504 is configured to perform image processing on the second image based on the image processing information.
[0238] Optionally, the first metadata information also includes image processing information corresponding to the more than one single-channel images respectively, and the processing module 504 is further used to: perform image processing on the more than one single-channel images corresponding to the sample to be observed based on the image processing information.
[0239] Optionally, the image processing includes artificial intelligence (AI) analysis, and the image processing information includes an AI analysis target and information about the AI analysis tool. The processing module 504 is used to: obtain the AI analysis tool based on the information about the AI analysis tool; and use the AI analysis tool to perform image processing to achieve the AI analysis target.
[0240] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0241] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0242] Optionally, the AI analysis tool includes multiple AI analysis models; see Figure 7, optionally, the device also includes: a determination module 505, used to determine a target AI analysis model from the multiple AI analysis models; the processing module 504 is used to: use the target AI analysis model to perform image processing to achieve the AI analysis target.
[0243] Optionally, the determination module 505 is configured to: receive an AI analysis requirement input by a user; and determine the target AI analysis model based on the AI analysis requirement and feature information of each AI analysis model.
[0244] Optionally, the determination module 505 is used to: display information about the multiple AI analysis models; and determine a target AI analysis model from the multiple AI analysis models based on a user's selection input.
[0245] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0246] Referring to Figure 8, optionally, the device also includes: a transceiver module 506: used to output a first prompt message, wherein the first prompt message is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and used to receive a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0247] Optionally, the second acquisition module 502 includes: an adjustment unit for adjusting the parameter settings of the image generating device for each single-channel image constituting the first image based on parameter information corresponding to the single-channel image; and an acquisition unit for using the adjusted image generating device to acquire the single-channel image corresponding to the sample to be observed.
[0248] Optionally, the second acquisition module 502 also includes: a first determination unit, used to determine whether the parameter settings of the image generating device can be adjusted based on the parameter information corresponding to the single-channel image; and the adjustment unit, used to adjust the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image when the parameter settings of the image generating device can be adjusted.
[0249] Optionally, the second acquisition module 502 further includes: an output unit, configured to output second prompt information when the parameter settings of the image generating device cannot be adjusted, wherein the second prompt information is used to indicate to the user the parameters of the image generating device that cannot be automatically adjusted.
[0250] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0251] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; the first determination unit is used to perform at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0252] Optionally, the second acquisition module 502 further includes: a receiving unit, configured to receive a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0253] Optionally, the second acquisition module 502 also includes: a second determination unit, used to determine whether the parameter setting of the image generating device is effective; the second acquisition module 502 is used to use the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed after the parameter setting of the image generating device is effective.
[0254] 9 , optionally, the image reproduction device 500 further includes: a storage module 507 for storing parameter information corresponding to the more than one single-channel images and image processing information corresponding to the second image as second metadata information corresponding to the second image.
[0255] Optionally, the image reproduction device 500 also includes: a storage module 507, which is used to store parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to the more than one single-channel images as second metadata information corresponding to the second image.
[0256] FIG10 is a schematic structural diagram of an image reproduction device provided by an embodiment of the present disclosure. As shown in FIG10 , the image reproduction device 600 may include a first acquisition module 601 , a second acquisition module 602 , a processing module 603 and a generation module 604 .
[0257] The first acquisition module 601 is used to obtain first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to one or more single-channel images constituting the first image.
[0258] The second acquisition module 602 is configured to respectively acquire, for the sample to be observed, more than one single-channel images corresponding to the sample to be observed based on parameter information respectively corresponding to the more than one single-channel images.
[0259] The processing module 603 is configured to perform image processing on one or more single-channel images corresponding to the sample to be observed based on image processing information corresponding to one or more single-channel images constituting the first image.
[0260] The generating module 604 is configured to superimpose more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
[0261] Optionally, the image processing includes artificial intelligence (AI) analysis, and the image processing information includes an AI analysis target and information about the AI analysis tool. The processing module 603 is used to: obtain the AI analysis tool based on the information about the AI analysis tool; and use the AI analysis tool to perform image processing to achieve the AI analysis target.
[0262] Optionally, the AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: information used to obtain relevant information for each AI analysis model; each AI analysis model.
[0263] Optionally, the information about the AI analysis tool also includes feature information of each AI analysis model.
[0264] Optionally, the AI analysis tool includes multiple AI analysis models; referring to FIG11 , optionally, the device further includes: a determination module 605 for determining a target AI analysis model from the multiple AI analysis models; the processing module 603 is used to: use the target AI analysis model to perform image processing to achieve the AI analysis target.
[0265] Optionally, the determination module 605 is configured to: receive an AI analysis requirement input by a user; and determine the target AI analysis model based on the AI analysis requirement and feature information of each AI analysis model.
[0266] Optionally, the determination module 605 is used to: display information about the multiple AI analysis models; and determine a target AI analysis model from the multiple AI analysis models based on a user's selection input.
[0267] Optionally, the AI analysis objectives include at least one of the following: determining cell confluence; determining cell count; or determining cell transfection rate.
[0268] Referring to Figure 12, optionally, the device also includes: a transceiver module 606: used to output a first prompt message, wherein the first prompt message is used to prompt the user to confirm whether to generate the second image for the sample to be observed; and used to receive a first instruction, wherein the first instruction instructs the user to confirm the generation of the second image for the sample to be observed.
[0269] Optionally, the second acquisition module 602 includes: an adjustment unit for adjusting the parameter settings of the image generating device for each single-channel image constituting the first image based on parameter information corresponding to the single-channel image; and an acquisition unit for using the adjusted image generating device to acquire the single-channel image corresponding to the sample to be observed.
[0270] Optionally, the second acquisition module 602 also includes: a first determination unit, used to determine whether the parameter settings of the image generating device can be adjusted based on the parameter information corresponding to the single-channel image; and the adjustment unit, used to adjust the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image when the parameter settings of the image generating device can be adjusted.
[0271] Optionally, the second acquisition module 602 further includes: an output unit, configured to output a second prompt message when the parameter setting of the image generating device cannot be adjusted, wherein the second prompt message is configured to indicate to the user the parameters of the image generating device that cannot be automatically adjusted.
[0272] Optionally, the second prompt information further includes guidance information for guiding the user to manually adjust the parameters that cannot be automatically adjusted.
[0273] Optionally, the image generating device includes a microscope and a camera, and the parameter information includes at least one of an imaging mode, microscope parameters, and shooting parameters; the first determination unit is used to perform at least one of the following: determining whether the microscope can be adjusted according to the microscope parameters included in the parameter information; determining whether the imaging mode of the microscope can be adjusted according to the imaging mode included in the parameter information; determining whether the camera can be adjusted according to the shooting parameters included in the parameter information.
[0274] Optionally, the second acquisition module 602 further includes: a receiving unit, configured to receive a second instruction, wherein the second instruction indicates that the parameter setting of the image generating device has been successfully adjusted.
[0275] Optionally, the second acquisition module 602 also includes: a second determination unit, used to determine whether the parameter setting of the image generating device is effective; the second acquisition module 602 is used to use the adjusted image generating device to obtain a single-channel image corresponding to the sample to be observed after the parameter setting of the image generating device is effective.
[0276] Referring to Figure 13, optionally, the device 600 also includes: a storage module 607, which is used to store parameter information corresponding to the more than one single-channel images, image processing information corresponding to the second image, and image processing information corresponding to one or more single-channel images constituting the second image as second metadata information corresponding to the second image.
[0277] Some embodiments relate to microscopes. FIG14 shows a schematic diagram of a system 900 configured to perform the methods described herein. System 900 includes a microscope 910, a camera 920, and a computer system 930. The camera is configured to capture non-fluorescent images, the microscope 910 is configured to capture fluorescent images, and is connected to the computer system 930. The computer system 930 is configured to perform at least a portion of the methods described herein. The computer system 930 can be configured to execute a machine learning algorithm. The computer system 930 and the microscope 910 and camera 920 can be separate entities, but can also be integrated into a common housing. The computer system 930 can be part of the central processing system of the microscope 910 and / or the computer system 930 and camera 920 can be part of a subassembly of the microscope 910, such as a sensor, actuator, camera, or lighting unit of the microscope 910.
[0278] The computer system 930 may be a local computer device (e.g., a personal computer, laptop, tablet computer, or mobile phone) having one or more processors and one or more storage devices, or it may be a distributed computer system (e.g., having one or more processors and one or more storage devices distributed across various locations, such as a local client and / or one or more remote server locations and / or data centers). The computer system 930 may include any circuit or combination of circuits. In one embodiment, the computer system 930 may include one or more processors that may be of any type. As used herein, a processor may refer to any type of computing circuit, such as, but not limited to, a microprocessor, a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA) such as a microscope or microscope component (e.g., a camera), or any other type of processor or processing circuit. Other types of circuits that may be included in the computer system 930 may be custom circuits, application specific integrated circuits (ASICs), and the like, such as one or more circuits (e.g., communication circuits) used in wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. The computer system 930 may include one or more storage devices, which may include one or more storage elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard disk drives, and / or one or more drives for handling removable media such as compact disks (CDs), flash memory cards, digital video disks (DVDs), etc. The computer system 930 may also include a display device, one or more speakers, and a keyboard and / or controller, which may include a mouse, trackball, touch screen, voice recognition device, or any other device that allows a system user to input information to or receive information from the computer system 930.
[0279] Some or all of the method steps may be performed by (or using) a hardware device (e.g., a processor, a microprocessor, a programmable computer or an electronic circuit). In some embodiments, such a device may perform one or more of the most important method steps.
[0280] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation may be performed using a non-transitory storage medium (such as a digital storage medium, e.g., a floppy disk, DVD, Blu-ray, CD, ROM, PROM, and EPROM, EEPROM, or FLASH) having stored thereon electronically readable control signals that cooperate (or are capable of cooperating) with a programmable computer system to perform the corresponding method. Thus, the digital storage medium may be computer-readable.
[0281] Some embodiments of the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.
[0282] Generally, embodiments of the present invention can be implemented as a computer program product having a program code, which is operable to perform one of the methods when the computer program product runs on a computer. The program code can, for example, be stored on a machine-readable carrier.
[0283] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.
[0284] In other words, an exemplary embodiment of the present invention is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.
[0285] Therefore, a further embodiment of the present invention is a storage medium (or data carrier or computer-readable medium) comprising a computer program stored thereon, the computer program being operable to perform one of the methods described herein when the computer program is executed by a processor. The data carrier, digital storage medium or recorded medium is generally tangible and / or non-transitory. A further embodiment of the present invention is an apparatus as described herein, comprising a processor and a storage medium.
[0286] Therefore, a further embodiment of the present invention is a data stream or a signal sequence representing the computer program for performing one of the methods described herein. The data stream or signal sequence can be configured to be transmitted via a data communication connection, such as the Internet.
[0287] A further embodiment comprises a processing means, for example a computer or a programmable logic device, configured to or adapted to perform one of the methods described herein.
[0288] A further embodiment comprises a computer on which is installed the computer program for performing one of the methods described herein.
[0289] Yet another embodiment of the present invention includes an apparatus or system configured to transmit (e.g., electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, or the like. The apparatus or system may, for example, include a file server for transmitting the computer program to the receiver.
[0290] In some embodiments, a programmable logic device (e.g., a field programmable gate array) can be used to perform some or all of the functions of the method described herein. In some embodiments, the field programmable gate array can cooperate with a microprocessor to perform one of the methods described herein. Generally, the method is preferably performed by any hardware device.
[0291] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".
[0292] Although some aspects have been described in the context of an apparatus, it is apparent that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Similarly, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of the corresponding apparatus.
Claims
1. An image reproduction method, comprising: Obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images respectively and image processing information corresponding to the first image; For the sample to be observed, based on the parameter information respectively corresponding to the more than one single-channel images, respectively acquire more than one single-channel images corresponding to the sample to be observed; superimposing more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and Image processing is performed on the second image based on image processing information corresponding to the first image.
2. The method of claim 1, wherein: The first metadata information further includes image processing information respectively corresponding to one or more single-channel images constituting the first image. Before synthesizing more than one single-channel images corresponding to the sample to be observed, the method further includes: Image processing is performed on one or more single-channel images corresponding to the sample to be observed based on image processing information corresponding to one or more single-channel images constituting the first image.
3. The method according to claim 1 or 2, wherein the image processing comprises artificial intelligence (AI) analysis, the image processing information comprises an AI analysis target and information about an AI analysis tool, and performing image processing based on the image processing information comprises: Acquire the AI analysis tool according to the information about the AI analysis tool; as well as Using the AI analysis tool, image processing is performed to achieve the AI analysis goal.
4. The method of claim 3, wherein: The AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: Used to obtain relevant information of each AI analysis model; Each AI analysis model.
5. The method of claim 4, wherein: The information about the AI analysis tool also includes feature information of each AI analysis model.
6. The method of claim 5, wherein: The AI analysis tool includes a plurality of AI analysis models; after acquiring the AI analysis tool according to the information about the AI analysis tool, the method further includes: Determining a target AI analysis model from the multiple AI analysis models; The use of the AI analysis tool to perform image processing to achieve the AI analysis goal includes: Using the target AI analysis model, image processing is performed to achieve the AI analysis target.
7. The method of claim 6, wherein: Determining a target AI analysis model from the multiple AI analysis models includes: Receive AI analysis requirements input by users; and The target AI analysis model is determined according to the AI analysis requirements and the characteristic information of each AI analysis model.
8. The method of claim 6, wherein: Determining a target AI analysis model from the multiple AI analysis models includes: displaying information about the plurality of AI analysis models; and Based on the user's selection input, a target AI analysis model is determined from the multiple AI analysis models.
9. The method of claim 3, wherein the AI analysis target comprises at least one of the following: Determine cell confluence; Determine the cell count; or Determine the cell transfection efficiency.
10. The method of claim 1, wherein: Before respectively acquiring more than one single-channel images corresponding to the sample to be observed based on the parameter information respectively corresponding to the more than one single-channel images for the sample to be observed, the method further includes: outputting first prompt information, wherein the first prompt information is used to prompt a user to confirm whether to generate the second image for the sample to be observed; and A first instruction is received, wherein the first instruction instructs a user to confirm generating the second image for the sample to be observed.
11. The method of claim 1, wherein: For the sample to be observed, based on the parameter information respectively corresponding to the more than one single-channel images, respectively acquiring the more than one single-channel images corresponding to the sample to be observed includes: For each single-channel image constituting the first image, adjusting parameter settings of an image generating device based on parameter information corresponding to the single-channel image; and Using the adjusted image generation device, a single-channel image corresponding to the sample to be observed is acquired.
12. The method of claim 11, wherein: Before adjusting the parameter settings of the image generation device, it also includes: determining, based on parameter information corresponding to the single-channel image, whether parameter settings of the image generating device can be adjusted; and The adjusting the parameter settings of the image generating device based on the parameter information corresponding to the single-channel image includes: When the parameter setting of the image generating device can be adjusted, the parameter setting of the image generating device is adjusted based on the parameter information corresponding to the single-channel image.
13. The method of claim 11, wherein: Before using the adjusted image generation device to obtain a single-channel image corresponding to the sample to be observed, the method further includes: Determining whether parameter settings for the image generating device are effective; The step of using the adjusted image generation device to obtain a single-channel image corresponding to the sample to be observed includes: After the parameter setting of the image generating device takes effect, the adjusted image generating device is used to acquire a single-channel image corresponding to the sample to be observed.
14. A method for reproducing an image, comprising: Obtaining first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information respectively corresponding to the more than one single-channel images and image processing information respectively corresponding to one or more single-channel images constituting the first image; For the sample to be observed, based on the parameter information respectively corresponding to the more than one single-channel images, respectively acquire more than one single-channel images corresponding to the sample to be observed; performing image processing on one or more single-channel images corresponding to the sample to be observed based on image processing information corresponding to one or more single-channel images constituting the first image; and More than one single-channel images corresponding to the sample to be observed are superimposed to generate a second image corresponding to the sample to be observed.
15. The method of claim 14, wherein the image processing comprises artificial intelligence (AI) analysis, the image processing information comprises an AI analysis target and information about an AI analysis tool, and performing image processing based on the image processing information comprises: Acquire the AI analysis tool according to the information about the AI analysis tool; as well as Using the AI analysis tool, image processing is performed to achieve the AI analysis goal.
16. The method of claim 15, wherein: The AI analysis tool includes one or more AI analysis models; the information about the AI analysis tool includes at least one of the following: Used to obtain relevant information of each AI analysis model; Each AI analysis model.
17. The method of claim 16, wherein: The information about the AI analysis tool also includes feature information of each AI analysis model.
18. The method of claim 17, wherein: The AI analysis tool includes a plurality of AI analysis models; after acquiring the AI analysis tool according to the information about the AI analysis tool, the method further includes: Determining a target AI analysis model from the multiple AI analysis models; The use of the AI analysis tool to perform image processing to achieve the AI analysis goal includes: Using the target AI analysis model, image processing is performed to achieve the AI analysis target.
19. The method of claim 18, wherein: Determining a target AI analysis model from the multiple AI analysis models includes: Receive AI analysis requirements input by users; and The target AI analysis model is determined according to the AI analysis requirements and the characteristic information of each AI analysis model.
20. The method of claim 18, wherein: Determining a target AI analysis model from the multiple AI analysis models includes: displaying information about the plurality of AI analysis models; and Based on the user's selection input, a target AI analysis model is determined from the multiple AI analysis models.
21. An image reproduction device, comprising: A first acquisition module is used to obtain first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel image, and the first metadata information includes parameter information corresponding to the more than one single-channel images respectively and image processing information corresponding to the first image; A second acquisition module is used to acquire, for the sample to be observed, more than one single-channel images corresponding to the sample to be observed based on the parameter information respectively corresponding to the more than one single-channel images; a generating module, configured to superimpose more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed; and A processing module is used to perform image processing on the second image based on the image processing information.
22. An image reproduction device, comprising: A first acquisition module is used to obtain first metadata information corresponding to a first image, wherein the first image is composed of more than one single-channel images, and the first metadata information includes parameter information corresponding to the more than one single-channel images and image processing information corresponding to the one or more single-channel images constituting the first image; A second acquisition module is used to acquire, for the sample to be observed, more than one single-channel images corresponding to the sample to be observed based on the parameter information respectively corresponding to the more than one single-channel images; a processing module, configured to perform image processing on one or more single-channel images corresponding to the sample to be observed, based on image processing information corresponding to one or more single-channel images constituting the first image; and A generating module is used to superimpose more than one single-channel images corresponding to the sample to be observed to generate a second image corresponding to the sample to be observed.
23. An image reproduction device, comprising: processor; a memory for storing instructions executable by the processor; Wherein, when the instruction is executed by the processor, the processor is used to execute the method as described in any one of claims 1-13 or any one of claims 14-20.
24. A computer-readable storage medium having instructions stored thereon, and when the instructions are executed by a processor, the processor is configured to perform the method according to any one of claims 1 to 13 or any one of claims 14 to 20.
Citation Information
Patent Citations
Image reproduction method and device
CN117456035A
Verfahren zur ansteuerung einer bildaufnahmeeinrichtung und bildaufnahmeeinrichtung
CN103211653A
Mobile terminal, photographing method thereof and computer storage medium
CN111083348A
Image processing method, device and equipment
CN116614701A
Method and apparatus for an image editor
EP3144793A1