Image processing method and device, electronic equipment, storage medium and computer program product
By establishing a mapping relationship between cell imaging systems and cell cutting systems, the problem of cell cutting systems being unable to accurately cut cells was solved, enabling efficient cell cutting and biological tissue analysis.
Patent Information
- Application Number
- CN202510125187.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-26
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2045-01-26
AI Technical Summary
In the prior art, there is a large deviation between the mask image output by the cell imaging system and the display interface of the cell cutting system, which makes it impossible for the cell cutting system to accurately cut the cells in the imaging image, thereby reducing the analysis efficiency of biological tissues.
By acquiring the scanned image and mask image output by the cell imaging system, a mapping relationship is established between the output image of the cell imaging system and the display interface of the cell cutting system, generating a first file, and outputting it to the cell cutting system to achieve accurate image cutting.
This improves the efficiency of cell cutting systems in cutting cells in biological tissue imaging images, thereby enhancing the efficiency of biological tissue analysis.
Smart Images

Figure CN120088274B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of computer, and particularly relates to an image processing method and device, electronic equipment, storage medium and computer program product. BACKGROUND
[0002] With the development of image processing technology, researchers can analyze biological tissues based on the processing of imaging images of biological tissues, so as to further carry out life science research and clinical diagnosis.
[0003] In the process of analyzing biological tissues, the target region where the cells in the imaging image are located can be first circled based on manual annotation, and then the cells in the imaging image are cut out by a cell cutting system based on the target region, and then the cut-out cells are analyzed. However, the manual annotation operation is relatively cumbersome, and the imaging image often contains a large number of cells, resulting in low efficiency of cell cutting, and thus low efficiency of analyzing biological tissues.
[0004] In the related art, a cell imaging system can automatically mark the target region where the cells in the imaging image are located. Specifically, the cell imaging system can not only image the biological tissues to obtain the imaging image, but also automatically identify the target region containing the cells in the imaging image, and output the identified target region as a mask image, thereby reducing the manual cost of marking the target region. However, if the mask image output by the cell imaging system and the imaging image are directly input to the cell cutting system for display, the image displayed on the display interface of the cell cutting system will have a large deviation from the image actually output by the cell imaging system, for example, there are inconsistencies in the image direction and scaling phenomena, thereby causing the cell cutting system to be unable to accurately cut out the cells in the imaging image based on the image output by the cell imaging system. Therefore, the cell imaging system and the cell cutting system cannot be combined for cell cutting, and the efficiency of cell cutting is still low.
[0005] In summary, the related art has low efficiency of cutting cells in the imaging image of biological tissues, thereby reducing the efficiency of analyzing biological tissues. SUMMARY
[0006] To solve the problems in the related art, the embodiments of the present application provide an image processing method and device, electronic equipment, storage medium and computer program product.
[0007] The technical scheme of the embodiments of the present application is implemented as follows:
[0008] The embodiments of the present application provide an image processing method, which comprises the following steps:
[0009] acquire a first image and a second image, wherein the first image is determined based on a scanning image output by a cell imaging system after cell imaging processing of a target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue;
[0010] convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on cell contours in the second image;
[0011] output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
[0012] In the above scheme, the method further comprises:
[0013] determining a first position of the positioning pattern in an output image of the cell imaging system;
[0014] determining a second position of the positioning pattern in a display interface of the cell cutting system based on a second file, wherein the second file represents a positioning reference file output by the cell cutting system;
[0015] determining the first mapping relationship based on the first position and the second position.
[0016] In the above scheme, the determination of the first position of the positioning pattern in the output image of the cell imaging system comprises:
[0017] determining the first position of the positioning pattern in the first image.
[0018] In the above scheme, the conversion of the second image into the first file based on the first mapping relationship comprises:
[0019] mapping each pixel corresponding to a cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface based on the first mapping relationship;
[0020] determining a plurality of cutting points based on the mapped second coordinates, and generating the first file based on the plurality of cutting points.
[0021] In the above scheme, the method further comprises:
[0022] In response to a drawing operation input by a user, the positioning figure is drawn in an output image of the cell imaging system;
[0023] Correspondingly, the determining the first position of the positioning figure in the output image of the cell imaging system comprises:
[0024] Based on a gradient of color intensity change in the output image, the positioning figure drawn in the output image is identified;
[0025] Based on the identified positioning figure, the first position of the positioning figure in the output image is determined.
[0026] In the above scheme, the second file contains the second position of the positioning figure.
[0027] In the above scheme, the first image is obtained by:
[0028] The scanning image is transformed to obtain the first image; and,
[0029] The second image is obtained by:
[0030] The mask image is transformed to obtain the second image.
[0031] In the above scheme, the scanning image is transformed by:
[0032] In response to a first transformation operation input by a user, the scanning image is transformed; and,
[0033] The mask image is transformed by:
[0034] In response to a second transformation operation input by a user, the mask image is transformed.
[0035] In the above scheme, the second image is obtained by:
[0036] The cell contour in the mask image is expanded by a set number of pixels to obtain the second image.
[0037] Embodiments of the present application also provide an image processing device, comprising:
[0038] An obtaining unit is configured to obtain a first image and a second image, wherein the first image is determined based on a scanning image output by a cell imaging system after cell imaging processing of a target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour identification of the target tissue;
[0039] a conversion unit, configured to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on positions of a preset positioning pattern in the output image and on the display interface, and the first file describes points determined based on cell contours in the second image;
[0040] an output unit, configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
[0041] Embodiments of the present application further provide an electronic device, comprising a communication interface and a processor,
[0042] the communication interface is configured to receive a scanning image and a mask image output by a cell imaging system, the scanning image is obtained by performing cell imaging processing on a target tissue by the cell imaging system, and the mask image is obtained by performing cell contour identification on the target tissue by the cell imaging system;
[0043] the processor is configured to obtain a first image and a second image, wherein the first image is determined based on the scanning image, and the second image is determined based on the mask image, and to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on positions of a preset positioning pattern in the output image and on the display interface, and the first file describes points determined based on cell contours in the second image;
[0044] the communication interface is further configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
[0045] Embodiments of the present application further provide an electronic device, comprising a processor and a memory for storing a computer program capable of running on the processor,
[0046] wherein the processor is configured to execute steps of any of the above methods when running the computer program.
[0047] Embodiments of the present application further provide a storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement steps of any of the above methods.
[0048] The embodiment of the present application further provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of any of the above methods.
[0049] In the embodiment of the present application, the first image and the second image are acquired, wherein the first image is determined based on a scanning image output by the cell imaging system after cell imaging processing of the target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue; then, the second image is converted into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a pre-set positioning pattern in the output image and a position of the pre-set positioning pattern on the display interface, and the first file describes points determined based on cell contours in the second image; and then, the first image and the first file are output to the cell cutting system, so that the cell cutting system cuts the imaged cells in the first image based on the first file. In the above scheme, the first mapping relationship is determined based on the pre-set positioning pattern, and then the second image is converted into the first file supported by the cell cutting system based on the first mapping relationship, which is equivalent to adapting the cell imaging system to the cell cutting system, so that the cell cutting system can cut cells based on the image output by the cell imaging system. Compared with the related art, the scheme provided in the embodiment of the present application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of the biological tissue, and further improving the analysis efficiency of the biological tissue. BRIEF DESCRIPTION OF DRAWINGS
[0050] Figure 1 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0051] Figure 2 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0052] Figure 3 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0053] Figure 4 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0054] Figure 5 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0055] Figure 6 An implementation flowchart of an image processing method provided in the embodiment of the present application is shown in the figure;
[0056] Figure 7 A schematic diagram of a first interface provided for an embodiment of the present application;
[0057] Figure 8 A structural schematic diagram of an image processing device provided for an embodiment of the present application;
[0058] Figure 9 A structural schematic diagram of a hardware composition of an electronic device provided for an embodiment of the present application. DETAILED DESCRIPTION
[0059] With the development of image processing technology, researchers can analyze biological tissues based on the processing of imaging images of biological tissues, so as to further carry out life science research and clinical diagnosis.
[0060] In the process of analyzing biological tissues, the target region where the cells in the imaging image are located can be first circled based on manual annotation, and then the cells in the imaging image are cut out by the cell cutting system based on the target region, and the cut-out cells are analyzed, however, the manual annotation operation is relatively cumbersome, and the imaging image often contains a large number of cells, resulting in low efficiency of cell cutting, and thus low efficiency of analyzing biological tissues.
[0061] In the related art, the target region where the cells in the imaging image are located can be automatically marked by the cell imaging system. Specifically, the cell imaging system can not only image the biological tissue to obtain the imaging image, but also automatically identify the target region containing the cells in the imaging image, and output the identified target region as a mask image, thereby reducing the manual cost of marking the target region. However, if the mask image output by the cell imaging system and the imaging image are directly input to the cell cutting system for display, the image presented by the display interface of the cell cutting system will have a large deviation from the image actually output by the cell imaging system, for example, there are inconsistencies in image direction and scaling phenomena, etc., thereby causing the cell cutting system to be unable to accurately cut out the cells in the imaging image through the image output by the cell imaging system, and thus the cell imaging system and the cell cutting system cannot be combined for cell cutting, and the efficiency of cell cutting is still low.
[0062] In summary, the cutting efficiency of the cells in the imaging image of the biological tissue in the related art is low, thereby reducing the analysis efficiency of the biological tissue.
[0063] Based on this, in the embodiment of the application, the first image and the second image are acquired, wherein the first image is determined based on a scanning image output by the cell imaging system after cell imaging processing of the target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue; then, the second image is converted into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a pre-set positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on the cell contour in the second image; then, the first image and the first file are output to the cell cutting system, so that the cell cutting system cuts the imaged cells in the first image based on the first file. In the above scheme, the first mapping relationship is determined based on the pre-set positioning pattern, and then the second image is converted into the first file supported by the cell cutting system based on the first mapping relationship, which is equivalent to adapting the cell imaging system to the cell cutting system, so that the cell cutting system can cut cells based on the image output by the cell imaging system. Compared with the related art, the scheme provided in the embodiment of the application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of the biological tissue, and further improving the analysis efficiency of the biological tissue.
[0064] The application will be described in further detail below with reference to the drawings and embodiments.
[0065] The embodiment of the application provides an image processing method, referring to Figure 1 The method comprises the following steps.
[0066] Step 101: acquiring a first image and a second image.
[0067] The first image is determined based on a scanning image output by the cell imaging system after cell imaging processing of the target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue.
[0068] Here, the target tissue can be understood as a biological tissue that needs to be analyzed by a user. For example, the user can be a researcher, and the biological tissue can be a pathological tissue. The user can perform spatial proteomics analysis based on the target tissue.
[0069] In actual application, the cell imaging system can perform microscopic imaging on the cells in the target tissue, output a scanning image, and the scanning image can be understood as an imaging image of the target tissue, and the scanning image contains one or more imaged cells.
[0070] In actual applications, the cell imaging system can also identify the contours of the cells in the target tissue, and then output a mask image based on the identified contours of the cells. The cell imaging system can identify the contours of the cells in the target tissue by identifying the contours of the imaged cells in the scanned image.
[0071] Here, the mask image can be represented as a binary image, that is, each pixel in the mask image has only two values, and each pixel can be used to operate the pixel at the same position in the scanned image to indicate the target region in the scanned image where the cell is located, and the contour of the region can be regarded as the contour of the cell.
[0072] For example, the value of each pixel in the mask image can include 0 or 1; wherein the pixel with a value of 0 represents a black pixel, which can be used to convert the pixel at the same position in the scanned image to black, which is equivalent to eliminating the image content at the same pixel position in the scanned image; the pixel with a value of 1 represents a white pixel, which can be used to maintain the color of the pixel at the same position in the scanned image, which is equivalent to retaining the content at the same pixel position in the scanned image. The white region in the mask image can represent the region where the cell is located, and if the mask image is superimposed with the scanned image to obtain a superimposed image, the superimposed image can only include the imaged cell.
[0073] It should be noted that the mask image can include a plurality of target regions that do not overlap with each other, and each target region can include one or more cells according to business needs, and the contour of each target region can coincide with the overall contour of the cells in the target region, or can be expanded outward by a certain number of pixels compared to the overall contour. Here, for ease of understanding, the contour of each target region is described as the cell contour of the cells in the region.
[0074] In actual applications, after the cell imaging system outputs the scanned image, the scanned image output by the cell imaging system can be received, and the scanned image can be preprocessed to obtain a first image. For example, the preprocessing of the scanned image can include one or more of the following: transforming the scanned image, converting the background of the scanned image; wherein the transformation can include one or more of the following: mirror transformation, rotation transformation, and the background conversion can include converting the fluorescence field background to the bright field background.
[0075] In actual applications, after the cell imaging system outputs the mask image, the mask image output by the cell imaging system can be received, and the mask image can be preprocessed to obtain a second image. For example, the preprocessing of the mask image can include expanding the cell contour in the mask image outward by a certain number of pixels.
[0076] In practical applications, the first image can be regarded as a pre-processed scanning image, and the second image can be regarded as a pre-processed mask image. Each pixel in the second image can be used to operate a pixel in the first image at the same position, that is, each pixel in the first image can correspond to a pixel in the second image at the same position, and based on this, the second image can be used to indicate a target region where the imaged cell in the first image is located, that is, to indicate the contour of the imaged cell in the first image.
[0077] Here, the first image, the second image, the scanning image, and the mask image can all be regarded as output images of the cell imaging system.
[0078] Step 102: converting the second image into a first file based on a first mapping relationship.
[0079] The first mapping relationship represents the coordinate mapping relationship between the corresponding pixels of the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the position of the pre-set positioning pattern in the output image and the position on the display interface. The first file describes the points determined based on the cell contour in the second image.
[0080] In practical applications, the first mapping relationship can represent the coordinate mapping relationship between the actual position of each pixel in the first image in the first image and the position of the pixel in the display interface of the cell cutting system when the cell cutting system displays the first image.
[0081] In practical applications, based on the first mapping relationship, a pixel in the second image can be mapped from the coordinate in the second image to the coordinate in the display interface, that is, the pixel can be mapped to the corresponding pixel in the display interface. In the case where the pixel in the second image is used to operate a pixel in the first image, the position of the corresponding pixel of the pixel in the second image in the display interface can be the same as the position of the operated pixel in the first image in the display interface, thereby ensuring that the first image can be accurately operated in the cell cutting system based on the indication of the second image.
[0082] Exemplarily, assuming that the coordinate of pixel 1 in the first image in the first image is (1, 1), the coordinate of pixel 2 in the second image in the second image is (1, 1), and the value of pixel 2 is 0, that is, pixel 2 in the second image can be used to perform the elimination operation on pixel 1; and further assuming that the coordinate of pixel 1 in the display interface of the cell cutting system is (2, 2), on this basis, pixel 2 can be mapped to pixel 3 in the display interface based on the first mapping relationship, and the coordinate of pixel 3 is (2, 2); obviously, in the cell cutting system, pixel 3 can be used to perform the elimination operation corresponding to pixel 2 on pixel 1 in the first image, that is, the first image can be accurately operated in the cell cutting system based on the indication of the second image.
[0083] In actual application, if the second image is directly displayed by using the cell cutting system, the second image presented in the display interface will have a large deviation from the second image itself, and it is extremely likely that the first image imaged in the display interface cannot be accurately operated based on the indication of the second image.
[0084] Exemplarily, assuming that the coordinate of pixel 1 in the first image in the first image is (1, 1), the coordinate of pixel 2 in the second image in the second image is (1, 1), and the value of pixel 2 is 0, that is, pixel 2 in the second image can be used to perform the elimination operation on pixel 1; and further assuming that the coordinate of pixel 1 in the display interface of the cell cutting system is (2, 2). On this basis, if the second image is directly displayed by using the cell cutting system, pixel 2 will be mapped to pixel 4 in the display interface, and in actual application, due to display deviation, the coordinate of pixel 4 is no longer (2, 2), so that pixel 4 cannot be used to perform the elimination operation corresponding to pixel 2 on pixel 1 in the first image, that is, the first image cannot be accurately operated in the cell cutting system based on the indication of the second image.
[0085] In actual application, the coordinates of the pixels on the cell contour in the second image in the second image can be mapped to the coordinates in the display interface based on the first mapping relationship, and the coordinates in the display interface are equivalent to the coordinates of the corresponding pixels in the display interface. Then, a plurality of cutting points can be determined based on a plurality of mapped coordinates in the display interface, and the determined cutting points are also points determined based on the cell contour in the second image. After that, the first file can be generated based on the plurality of cutting points, and the first file can be used for the cell cutting system to accurately cut out the corresponding cells in the first image.
[0086] In actual application, the first mapping relationship can be determined based on a position of the positioning pattern in the output image and a position of the positioning pattern pre-set on the display interface. The position of the positioning pattern pre-set on the display interface can be understood as a position of the positioning pattern in the output image on the display interface in the case that the cell cutting system displays the output image. Exemplarily, the positioning pattern can be a rectangular frame.
[0087] Step 103: outputting the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0088] Here, the outputting of the first image and the first file to the cell cutting system can be understood as inputting the obtained first image and the converted first file to the cell cutting system.
[0089] In actual application, the image processing system can output the first image and the first file, that is, the image processing system can obtain the first image and convert the first file. The output first image and the first file can be input to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file. The image processing system can perform image processing based on the image processing method provided in the embodiments of the present application.
[0090] Here, the first file can be understood as a file supported by the cell cutting system for indicating a cutting path, and the cutting path is a closed curve composed of a plurality of cutting points. The area in the closed curve can be regarded as a target area corresponding to the cells in the first image. In actual application, the first file can be an Extensible Markup Language (XML) file.
[0091] In actual application, after the cell cutting system loads the first file, the cell cutting system can present the cutting path in the display interface. The area corresponding to the cutting path presented by the display interface can be the same as the position and size of the area corresponding to the cutting path indicated by the first file. Then, the cell cutting system can superimpose the cutting path and the input first image, so as to cut the cells imaged in the first image according to the superimposed image.
[0092] In the embodiment of the present application, the first mapping relationship is determined through the pre-set positioning pattern, and then the second image is converted into the first file supported by the cell cutting system based on the first mapping relationship, which is equivalent to adapting the cell imaging system to the cell cutting system, so that the cell cutting system can cut cells based on the image output by the cell imaging system. Compared with the related art, the scheme provided in the embodiment of the present application can combine the cell imaging system with the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of the biological tissue, and further improving the analysis efficiency of the biological tissue.
[0093] The first mapping relationship is further described below.
[0094] In an embodiment, the image processing method provided in the embodiment of the present application further includes:
[0095] determining a first position of the positioning pattern in the output image of the cell imaging system;
[0096] determining a second position of the positioning pattern in the display interface of the cell cutting system based on the second file, the second file representing a positioning reference file output by the cell cutting system;
[0097] determining the first mapping relationship based on the first position and the second position.
[0098] In actual application, the first position can represent the coordinates of a pixel on the positioning pattern in the output image. The second position can represent the coordinates of the pixel on the positioning pattern in the display interface of the cell cutting system. For example, in the case where the positioning pattern is a rectangular frame, the first position can represent the coordinates of the top-left corner pixel of the positioning pattern in the output image, and the second position can represent the coordinates of the top-left corner pixel of the positioning pattern in the display interface.
[0099] In an embodiment, the first position of the positioning pattern in the output image of the cell imaging system is determined by:
[0100] determining the first position of the positioning pattern in the first image.
[0101] Here, the first position can represent the position of the positioning pattern in the first image.
[0102] In actual application, the positioning pattern can be pre-set in the output image. It should be noted that when the positioning pattern is set in the output image, the coordinates corresponding to the position of the positioning pattern in the output image can not be determined, that is, the first position is not determined. For example, the positioning pattern can be drawn at a position in the first image without determining the position coordinates in response to the drawing operation of the user. At this time, the first position of the positioning pattern in the first image is not determined.
[0103] In practical applications, the first position can be determined based on the recognition of the positioning pattern in the output image.
[0104] In one embodiment, the image processing method provided in this application further includes:
[0105] In response to user-input drawing operations, a positioning graphic is drawn in the output image of the cell imaging system;
[0106] Correspondingly, determining the first position of the localization pattern in the output image of the cell imaging system includes:
[0107] Based on the gradient of color intensity changes in the output image, the localized pattern drawn in the output image is identified;
[0108] Based on the identified positioning pattern, determine the first position of the positioning pattern in the output image.
[0109] In practical applications, the first position of the positioning graphic in the output image can be identified based on the following steps:
[0110] Step 1: Superimpose and calculate the fluorescence multi-channel brightness in the output image to obtain the color intensity calculation result.
[0111] Step 2: Based on the color intensity calculation results, obtain the gradient in each direction of the output image.
[0112] In practical applications, the calculated gradient can be understood as the gradient of color intensity changes in the output image. The calculated gradient can be used to detect multiple regions in the output image. The contour of each region can be similar to a localization pattern and can be considered as candidate patterns. The positions of these candidate patterns in the output image can be directly read during the detection process and stored in memory.
[0113] In practical applications, the positioning graphic can be one of these candidate graphics, and the positioning graphic can be selected from multiple detected candidate graphics.
[0114] Step 3: Remove areas in the output image that do not conform to the set rules.
[0115] In practical applications, alternative graphics that do not conform to the set rules can be removed from multiple alternative graphics. The removed alternative graphics can be regarded as being judged as not being the positioning graphics. The alternative graphics that are finally retained among multiple alternative graphics are the positioning graphics.
[0116] For example, the rules may include one or more of the following: the area of the region is greater than a set area threshold, and the length-to-width ratio of the region is equal to a set ratio.
[0117] Step 4: determining the first position of the recognized positioning pattern in the output image.
[0118] In practical applications, the first position of the recognized positioning pattern in the output image can be directly read from the memory. In this way, the first position can be determined.
[0119] In practical applications, the second file can be used to determine the second position of the positioning pattern in the display interface of the cell cutting system.
[0120] In an embodiment, the second file contains the second position of the positioning pattern.
[0121] Here, based on the second file, the second position can be directly determined.
[0122] In practical applications, the second file can also contain position information used to determine the second position. Specifically, the position information contained in the second file can represent the position of a positioning reference pattern in the display interface, the size of the positioning reference pattern can be consistent with the size of the positioning pattern, and the position of the positioning reference pattern in the display interface of the cell cutting system can correspond to the position of the positioning pattern in the display interface, i.e., correspond to the second position. Based on the position information contained in the second file, the second position can be determined. Illustratively, the coordinates of the pixel on the positioning reference pattern corresponding to the first position in the display interface of the cell cutting system can be determined as the second position.
[0123] In practical applications, in response to the drawing operation of the user, the positioning reference pattern can be drawn in the display interface of the cell cutting system, and the position of the positioning reference pattern can be made to correspond to the second position, and then the cell cutting system can be called to export the positioning reference pattern in the display interface as the second file. The second file can be an XML file.
[0124] Illustratively, when the cell cutting system performs real-time imaging on the membrane attached with the tissue, a positioning reference pattern can be drawn in the position where the field of view is clear in the tissue image presented in the display interface, and then the positioning reference pattern can be exported as the second file. Alternatively, when the cell cutting system displays the first image, a positioning reference pattern can be drawn in the display interface, and the positioning reference pattern can be made to coincide with the positioning pattern pre-set in the first image, and then the positioning reference pattern can be exported as the second file.
[0125] Here, based on the first position and the second position, the coordinate mapping relationship between the coordinates of a pixel on the positioning pattern in the output image and the coordinates of the pixel on the positioning pattern in the display interface of the cell cutting system can be determined. The coordinate mapping relationship can be used to determine the first mapping relationship.
[0126] In practical applications, the coordinate mapping relationship between the first position and the second position can be taken as the first mapping relationship.
[0127] In an embodiment, the second image is converted into the first file based on the first mapping relationship, including:
[0128] Each pixel corresponding to a cell contour in the second image is mapped from a first coordinate in the second image to a second coordinate in the display interface based on the first mapping relationship.
[0129] Based on the mapped second coordinates, a plurality of cutting points are determined, and the first file is generated based on the plurality of cutting points.
[0130] Here, each first coordinate can be understood as the coordinate of a pixel on the cell contour in the second image. Each second coordinate can be understood as the coordinate of a pixel in the display interface, which corresponds to a pixel on the cell contour in the second image. Each second coordinate can also be understood as the mapping of a pixel on the cell contour in the second image to a coordinate in the display interface.
[0131] In practical applications, the determined plurality of cutting points can form one or more cutting paths, and each cutting path can be used to indicate a region in the first image, which can represent the same region as the target region indicated by the second image.
[0132] In practical applications, the determined plurality of cutting points can be converted into list-form data connected to each other, then a table header can be created based on the second file, and the list-form data can be combined into the table header to obtain combined data, and then the first file can be generated based on the combined data.
[0133] In practical applications, based on the first file, the cell cutting system can determine one or more cutting paths, and cut out the region corresponding to each cutting path from the first image. In this way, the cells in the target region indicated by the second image are cut out, thereby realizing the combination of the cell imaging system and the cell cutting system for cell cutting, and improving the efficiency of cell cutting.
[0134] The acquisition methods of the first image and the second image are further described below.
[0135] In an embodiment, the first image is acquired, including:
[0136] The scanning image is transformed to obtain the first image; and
[0137] The second image is acquired, including:
[0138] The mask image is transformed to obtain the second image.
[0139] In practical applications, the transformation processing can at least include one or more of the following: mirror transformation, rotation transformation.
[0140] In practical applications, the imaging modes of the cell imaging system and the cell cutting system can be different, resulting in different image directions between the image presented by the cell cutting system in the display interface and the image output by the cell imaging system. For example, the cell imaging system can be based on upright microscope imaging, and the cell cutting system can be based on inverted microscope imaging. On this basis, if the image output by the cell imaging system is directly input into the cell cutting system for display, the image presented by the cell cutting system in the display interface and the image output by the cell imaging system are in a mirror relationship.
[0141] In practical applications, the transformation processing on the mask image can be the same as the transformation processing on the scan image.
[0142] Here, the transformation processing on the scan image can make the first image displayed by the cell cutting system consistent with the image direction of the scan image. In addition, the transformation processing on the mask image can make the image direction corresponding to the cutting path consistent with the image direction corresponding to the mask image when the cell cutting system displays the cutting path based on the first file generated according to the second image. In this way, the operation difficulty of the user when observing the image using the cell imaging system and the cell cutting system is reduced, thereby improving the efficiency of cell cutting.
[0143] In an embodiment, the transformation processing on the scan image includes:
[0144] In response to a first transformation operation input by the user, the transformation processing on the scan image is performed; and
[0145] The transformation processing on the mask image includes:
[0146] In response to a second transformation operation input by the user, the transformation processing on the mask image is performed.
[0147] In practical applications, the first transformation operation and the second transformation operation can both be understood as a transformation operation input by the user. The first transformation operation and the second transformation operation can be the same user input or different user inputs.
[0148] In practical applications, the scan image and the mask image can be simultaneously transformed in response to a transformation operation input by the user, or the scan image and the mask image can be transformed respectively in response to two transformation operations input by the user.
[0149] In actual application, the user can store the image to be processed in the first setting path in advance, the first setting path can be a folder path, and the first setting path can store a plurality of images to be processed. Then the user can input the transformation operation in the display interface for processing the transformation, the display interface can be an interface in the image processing system, and the image processing system can process the image based on the image processing method provided in the embodiments of the present application.
[0150] Exemplarily, the transformation operation input by the user can at least include the following operation contents:
[0151] Operation content 1: the user inputs the first setting path in the display interface for processing the transformation by selecting a folder or inputting by a keyboard, etc.
[0152] Operation content 2: the user clicks the button for triggering the transformation processing in the display interface.
[0153] The operation content 2 needs to be the last operation content in a transformation operation, that is, when the user inputs a transformation operation, the operation content 2 needs to be the last operation content input by the user.
[0154] In actual application, the first setting path can be determined in response to the transformation operation input by the user, then one or more images corresponding to the first setting path are read, and each image read is processed.
[0155] In actual application, the image can be processed based on the first setting function instruction, exemplarily, the first setting function instruction can include “fliplr”.
[0156] Here, Figure 2 An example of a scanning image is given, Figure 3 An example of a first image is given, wherein, Figure 3 The first image in the above formula is obtained by processing the scanning image in the above formula. Figure 2
[0157] In an embodiment, the second image is obtained, including:
[0158] The cell contour in the mask image is expanded by a set number of pixels to obtain the second image.
[0159] In actual application, expanding the cell contour in the mask image by a set number of pixels can be regarded as performing mask dilation processing on the mask image, and the mask dilation can make the target region indicated by the second image contain a complete morphological cell, thereby ensuring the integrity of the cut-out cell.
[0160] In actual applications, in response to a mask dilation operation input by a user, a number of pixels can be expanded outward from the cell contours in the mask image to obtain a second image. After the second image is obtained, the second image can be superimposed on the first image in a semi-transparent manner to obtain a superimposed image, so that the user can verify whether the target region indicated by the second image contains a cell with a complete morphology based on the superimposed image.
[0161] In actual applications, the user can store the mask image in the second setting path in advance, and then the user can input the mask dilation operation in a display interface for performing the mask dilation processing. The display interface can be an interface in an image processing system, and the image processing system can perform image processing based on the image processing method provided in the embodiments of the present application.
[0162] For example, referring to Figure 4 The display interface provided for performing the mask dilation processing can include at least the following operation contents input by the user:
[0163] Operation content 1: The user operates a file selector corresponding to "Mask Image" to input a storage path of the mask image.
[0164] Operation content 2: The user operates a file selector corresponding to "Save Folder" to input an output path of the second image. In actual applications, the second image obtained after the mask dilation processing can be output to the output path.
[0165] Operation content 3: The user inputs a plurality of numerical values in an input box corresponding to "Dilation Radius". In actual applications, the plurality of numerical values input by the user can be separated by ",". For example, the user can input "10, 20, 30", so that three cell contours in the mask image can be expanded outward by 10, 20 and 30 pixels, respectively.
[0166] Operation content 4: The user clicks a "Run" button in the display interface to trigger the mask dilation processing.
[0167] The order of operation content 1, operation content 2 and operation content 3 in one mask dilation processing can have no limitation, and operation content 4 needs to be the last operation content in one mask dilation processing.
[0168] In actual applications, the mask dilation processing can be performed on the mask image based on the second setting function instruction. For example, the second setting function instruction can include "cv2.distanceTransform" and "cv2.addWeighted".
[0169] Here, Figure 5 An example of a mask image is given, Figure 6 An example of a second image is given, wherein, Figure 6 The second image in is obtained by Figure 5 The scanning image in is obtained by mask dilation processing.
[0170] Based on the above method embodiments, the embodiments of the present application further provide an image processing system, comprising:
[0171] An image processing module is configured to execute the method in any of the above embodiments, so that the cell cutting system cuts the cells imaged in each of the one or more first images.
[0172] In actual application, the image processing module can be configured to: acquire the one or more first images and the one or more second images; convert each second image into a first file based on the first mapping relationship; and output the one or more first images and the one or more first files to the cell cutting system, so that the cell cutting system cuts the cells imaged in each of the one or more first images.
[0173] In actual application, the cell imaging system can output one or more scanning images and one or more mask images. Each first image acquired by the image processing module can be determined based on a scanning image, and each second image acquired by the image processing module can be determined based on a mask image.
[0174] In actual application, the image processing system can convert the second image into the first file in response to a conversion operation input by a user. On this basis, the image processing system can perform conversion processing based on two conversion modes to convert the second image into the first file. The two conversion modes include:
[0175] The first mode: converting one second image into one first file in response to one conversion operation input by a user.
[0176] The second mode: converting multiple second images into first files respectively in response to one conversion operation input by a user.
[0177] In actual application, the first mode can be referred to as a single image (Single) mode, and the second mode can be referred to as a multi-image (Multi) mode.
[0178] In actual application, the image processing system can further include a display module, which can be configured to display a first interface. The first interface can be configured to receive a conversion operation input by a user.
[0179] Exemplarily, Figure 7A schematic diagram of a first interface is provided, wherein the mode of the image conversion system is in Single mode. Referring to Figure 7 The one-time conversion operation input by the user can at least include the following operation contents:
[0180] Operation content 1: The user operates the file selector corresponding to "Image Folder" to input the storage path of the scan image and the mask image. In actual application, the scan image and the mask image can be stored in the same storage path, and the image processing module can obtain the scan image and the mask image based on the storage path, and then determine the first image and the second image.
[0181] Operation content 2: The user operates the file selector corresponding to "Save Folder" to input the output path of the first file. In actual application, the first file converted by the image processing module can be output to the output path.
[0182] Operation content 3: The user operates the file selector corresponding to "Reference XML" to input the storage path of the second file. In actual application, the image processing module can obtain the second file based on the storage path, and then determine the first mapping relationship based on the second file.
[0183] Operation content 4: The user clicks the "Run" button in the first interface, thereby triggering the conversion processing.
[0184] The order of operation content 1, operation content 2 and operation content 3 in one-time conversion processing can have no limitation, and operation content 4 needs to be the last operation content in one-time conversion processing.
[0185] In the embodiment of the present application, the image processing system determines the first mapping relationship through the pre-set positioning pattern, and then converts the second image into the first file supported by the cell cutting system based on the first mapping relationship, which is equivalent to adapting the cell imaging system and the cell cutting system. The cell cutting system can cut cells based on the image output by the cell imaging system. Compared with related technologies, the scheme provided in the embodiment of the present application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of the biological tissue, and further improving the analysis efficiency of the biological tissue.
[0186] Further, the image processing system provided by the embodiment of the present application can receive a conversion operation input by a user based on the first interface, and then convert the second image into the first file based on a response of the image processing module to the conversion operation, which is equivalent to simplifying the user operation through the first interface, thereby further improving the efficiency of cell cutting. Further, the image processing system provided by the embodiment of the present application also supports a multi-image mode, so that the user only needs to input the conversion operation once, and the plurality of second images can be converted into the first file respectively, thereby further simplifying the user operation and improving the efficiency of cell cutting.
[0187] Based on the above embodiment, the present application further provides an image processing device, which is shown in Figure 8 The image processing device comprises:
[0188] An acquisition unit 81 is configured to acquire a first image and a second image, wherein the first image is determined based on a scanning image output by a cell imaging system after cell imaging processing of a target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue;
[0189] A conversion unit 82 is configured to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on a cell contour in the second image;
[0190] An output unit 83 is configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the imaged cells in the first image based on the first file.
[0191] In an embodiment, the image processing device further comprises a determination unit configured to:
[0192] determine a first position of the positioning pattern in the output image of the cell imaging system;
[0193] determine a second position of the positioning pattern in the display interface of the cell cutting system based on a second file, wherein the second file represents a positioning reference file output by the cell cutting system;
[0194] determine the first mapping relationship based on the first position and the second position.
[0195] In an embodiment, the determining unit determines the first position of the positioning figure in the output image of the cell imaging system, comprising:
[0196] determining the first position of the positioning figure in the first image.
[0197] In an embodiment, the converting unit 82 converts the second image into the first file based on the first mapping relationship, comprising:
[0198] mapping each pixel corresponding to a cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface based on the first mapping relationship;
[0199] determining a plurality of cutting points based on the mapped second coordinates, and generating the first file based on the plurality of cutting points.
[0200] In an embodiment, the determining unit is further configured to:
[0201] in response to a drawing operation input by a user, drawing the positioning figure in the output image of the cell imaging system;
[0202] Correspondingly, the determining unit determines the first position of the positioning figure in the output image of the cell imaging system, comprising:
[0203] based on the gradient of color intensity change in the output image, identifying the positioning figure drawn in the output image;
[0204] based on the identified positioning figure, determining the first position of the positioning figure in the output image.
[0205] In an embodiment, the second file contains the second position of the positioning figure.
[0206] In an embodiment, the obtaining unit 81 obtains the first image, comprising:
[0207] transforming the scanning image to obtain the first image; and,
[0208] obtaining the second image, comprising:
[0209] transforming the mask image to obtain the second image.
[0210] In an embodiment, the obtaining unit 81 transforms the scanning image, comprising:
[0211] in response to a first transformation operation input by a user, transforming the scanning image; and,
[0212] The acquisition unit 81 performs transformation processing on the mask image, including:
[0213] In response to a second transformation operation input by a user, the mask image is transformed.
[0214] In an embodiment, the acquisition unit 81 acquires the second image, including:
[0215] The second image is obtained by expanding the cell contour in the mask image by a set number of pixels.
[0216] In actual applications, the acquisition unit 81, the transformation unit 82, the output unit 83, and the determination unit can be implemented by a processor in an image processing device.
[0217] It should be noted that the image processing device provided in the above embodiments is only used as an example to illustrate the division of the above program modules, and in actual applications, the above processing can be completed by different program modules according to needs, that is, the internal structure of the device is divided into different program modules to complete all or part of the above-described processing. In addition, the image processing device and the image processing method provided in the above embodiments belong to the same concept, and the specific implementation process is described in detail in the method embodiments, which will not be repeated here.
[0218] Based on the hardware implementation of the above program modules, and in order to implement the method of the present application, the present application further provides an electronic device, which is described in detail with reference to Figure 9 The electronic device includes:
[0219] The communication interface 1 can interact with other devices to exchange information;
[0220] The processor 2 is connected with the communication interface 1 to realize information interaction with other devices, and is used to run a computer program to execute the method provided in one or more technical solutions in the above embodiments. The computer program is stored on the memory 3.
[0221] Specifically, the communication interface 1 is used to receive a scanning image and a mask image output by a cell imaging system, the scanning image is obtained by the cell imaging system after cell imaging processing of a target tissue, and the mask image is obtained by the cell imaging system after cell contour recognition of the target tissue.
[0222] The processor 2 is configured to acquire a first image and a second image, wherein the first image is determined based on the scanning image, the second image is determined based on the mask image, and the processor 2 is configured to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on a cell contour in the second image.
[0223] The communication interface 1 is further configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0224] In an embodiment, the processor 2 is further configured to:
[0225] determine a first position of the positioning pattern in an output image of the cell imaging system;
[0226] determine a second position of the positioning pattern in a display interface of the cell cutting system based on a second file, wherein the second file represents a positioning reference file output by the cell cutting system;
[0227] determine the first mapping relationship based on the first position and the second position.
[0228] In an embodiment, the processor 2 determines the first position of the positioning pattern in the output image of the cell imaging system, including:
[0229] determining the first position of the positioning pattern in the first image.
[0230] In an embodiment, the processor 2 converts the second image into the first file based on the first mapping relationship, including:
[0231] mapping each pixel corresponding to a cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface based on the first mapping relationship;
[0232] determining a plurality of cutting points based on the mapped second coordinates, and generating the first file based on the plurality of cutting points.
[0233] In an embodiment, the processor 2 is further configured to draw the positioning pattern in the output image of the cell imaging system in response to a drawing operation input by a user.
[0234] Correspondingly, the processor 2 determines a first position of the positioning pattern in an output image of the cell imaging system, comprising:
[0235] Identifying the positioning pattern drawn in the output image based on a gradient of color intensity change in the output image;
[0236] Determining the first position of the positioning pattern in the output image based on the identified positioning pattern.
[0237] In an embodiment, the second file contains the second position of the positioning pattern.
[0238] In an embodiment, the processor 2 acquires the first image, comprising:
[0239] Transforming the scanning image to obtain the first image; and,
[0240] Acquiring the second image, comprising:
[0241] Transforming the mask image to obtain the second image.
[0242] In an embodiment, the processor 2 transforms the scanning image, comprising:
[0243] Transforming the scanning image in response to a first transformation operation input by a user; and,
[0244] The processor 2 transforms the mask image, comprising:
[0245] Transforming the mask image in response to a second transformation operation input by a user.
[0246] In an embodiment, the processor 2 acquires the second image, comprising:
[0247] Expanding the cell contour in the mask image by a set number of pixels outward to obtain the second image.
[0248] It should be noted that the specific processing process of the communication interface 1 can be understood with reference to the above method.
[0249] Of course, in actual application, various components in the electronic device are coupled together through the bus system 4. It can be understood that the bus system 4 is used to realize the connection communication between these components. In addition to including a data bus, the bus system 4 also includes a power bus, a control bus and a status signal bus. However, in order to clearly illustrate, all kinds of buses are marked as the bus system 4 in the Figure 9 .
[0250] The memory 3 in the embodiments of the present application is configured to store various types of data to support operations in the electronic device. Examples of the data include any computer programs used to operate on the electronic device.
[0251] The method disclosed in the embodiments of the present application can be applied to or implemented by the processor 2. The processor 2 can be an integrated circuit chip with processing capability. In the implementation process, the steps of the above method can be completed by the integrated logic circuit or the software form of instructions in the processor 2. The processor 2 can be a general processor, a DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The processor 2 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiments of the present application, the hardware decoding processor can be directly embodied to execute the steps, or the hardware and software modules in the decoding processor can be combined to execute the steps. The software module can be located in the storage medium, and the storage medium can be located in the memory 3. The processor 2 reads the information in the memory 3 and combines the hardware to complete the steps of the foregoing method.
[0252] In the exemplary embodiments, the electronic device can be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, Microprocessors, or other electronic elements to execute the foregoing method.
[0253] It can be understood that the memory 3 of the embodiments of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM). The magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), sync link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM).The memory described in the embodiments of the present application is intended to include, but not limited to, these and any other suitable types of memory.
[0254] In the example embodiments, the embodiments of the present application also provide a storage medium, i.e., a computer storage medium, specifically a computer readable storage medium, such as an electronic device including a computer program stored therein, which can be executed by the processor 2 of the electronic device to complete the steps of the foregoing method. The computer readable storage medium can be FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM, etc.
[0255] In the example embodiments, the embodiments of the present application also provide a computer program product including a computer program, which can be executed by the processor 2 of the electronic device to complete the steps of any of the foregoing methods.
[0256] It should be noted that "first", "second", etc. are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.
[0257] The term "and / or" herein is only a description of the association relationship between the associated objects, which means that there can be three relationships, for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone. In addition, the term "one or more" herein means any combination of at least two of any one or more of a plurality, for example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.
[0258] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.
Claims
1. An image processing method, characterized by, The method comprises: obtaining a first image and a second image, wherein the first image is determined based on a scanning image output by a cell imaging system after cell imaging processing of a target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour identification of the target tissue; converting the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of a cell cutting system, and the first mapping relationship is determined based on a position of a positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on cell contours in the second image; outputting the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
2. The method of claim 1, wherein, The method further comprises: determining a first position of the positioning pattern in an output image of the cell imaging system; determining a second position of the positioning pattern in a display interface of the cell cutting system based on a second file, wherein the second file represents a positioning reference file output by the cell cutting system; determining the first mapping relationship based on the first position and the second position.
3. The method of claim 2, wherein, The determination of the first position of the positioning pattern in the output image of the cell imaging system comprises: determining the first position of the positioning pattern in the first image.
4. The method of claim 1, wherein, The conversion of the second image into the first file based on the first mapping relationship comprises: mapping each pixel corresponding to a cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface based on the first mapping relationship; determining a plurality of cutting points based on the mapped second coordinates, and generating the first file based on the plurality of cutting points.
5. The method of claim 2, wherein, The method further comprises: drawing the positioning pattern in the output image of the cell imaging system in response to a drawing operation input by a user; correspondingly, the determination of the first position of the positioning pattern in the output image of the cell imaging system comprises: identifying the drawn positioning pattern in the output image based on a gradient of color intensity change in the output image; determining the first position of the positioning pattern in the output image based on the identified positioning pattern.
6. The method of claim 2, wherein, The second file contains the second position of the positioning pattern.
7. The method of claim 1, wherein, The obtaining of the first image comprises: transforming the scanning image to obtain the first image; and The obtaining of the second image comprises: transforming the mask image to obtain the second image.
8. The method of claim 7, wherein, The transformation of the scanning image comprises: transforming the scanning image in response to a first transformation operation input by a user; and The transformation of the mask image comprises: transforming the mask image in response to a second transformation operation input by a user.
9. The method of claim 1, wherein, The obtaining of the second image comprises: The second image is obtained by expanding the cell contour in the mask image by a number of pixels.
10. An image processing apparatus characterized by comprising: The method comprises the steps of: acquiring a first image and a second image, wherein the first image is determined based on a scanning image output by a cell imaging system after cell imaging processing of a target tissue, and the second image is determined based on a mask image output by the cell imaging system after cell contour recognition of the target tissue; converting the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of a cell cutting system, and the first mapping relationship is determined based on a position of a pre-set positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on the cell contour in the second image; outputting the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
11. An electronic device, comprising: The method comprises the steps of: a communication interface and a processor, wherein the communication interface is configured to receive a scanning image and a mask image output by a cell imaging system, the scanning image being obtained by the cell imaging system after cell imaging processing of a target tissue, and the mask image being obtained by the cell imaging system after cell contour recognition of the target tissue; the processor is configured to acquire a first image and a second image, wherein the first image is determined based on the scanning image, and the second image is determined based on the mask image, and to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of a cell cutting system, and the first mapping relationship is determined based on a position of a pre-set positioning pattern in the output image and a position of the positioning pattern on the display interface, and the first file describes points determined based on the cell contour in the second image; the communication interface is further configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
12. An electronic device, comprising: a processor and a memory for storing a computer program capable of running on the processor, wherein the processor is configured to execute the computer program to perform the steps of the method according to any one of claims 1 to 9.
13. A storage medium having stored thereon a computer program, characterized in that The computer program is executed by the processor to implement the steps of the method according to any one of claims 1 to 9.
14. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method according to any one of claims 1 to 9.
Citation Information
Patent Citations
Microscope slide coordinate system registration
CN103430077A
Cutting system and method for determining cell boundary
CN116004377A