Image processing method and device, electronic equipment, storage medium and computer program product
By establishing a mapping relationship between the cell imaging system and the cell cleavage system, the mask image is converted into a file supporting the cell cleavage system, the problem of low cell cleavage efficiency in biological tissue imaging images is solved, and more efficient biological tissue analysis is achieved.
Patent Information
- Application Number
- CN202510125187.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-26
- Publication Date
- 2025-06-03
- Estimated Expiration
- 2045-01-26
AI Technical Summary
In the prior art, the cleavage efficiency of cells in imaging images of biological tissues is low, resulting in a lower analysis efficiency of biological tissues.
By acquiring the scanned images and mask images output by the cell imaging system, the mapping relationship is determined based on the preset positioning pattern, and the mask image is converted into a file supporting the cell cleavage system, so that the cell cleavage system can accurately cut the cells in the image.
The cleavage efficiency of cells in biological tissue imaging images is improved, and the analysis efficiency of biological tissue is improved.
Smart Images

Figure CN120088274A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular, to an image processing method, apparatus, electronic device, storage medium, and computer program product. Background Art
[0002] With the development of image processing technology, researchers can analyze biological tissues based on the processing of imaging images of biological tissues, so as to conduct further life science research and clinical diagnosis.
[0003] In the process of analyzing biological tissues, the target area where cells are located in the imaging image can be outlined based on manual annotation first, and then the cell cutting system cuts out the cells in the imaging image based on the target area, and then analyzes the cut-out cells. However, the operation of manual annotation is relatively cumbersome, and the imaging image often contains a large number of cells, resulting in low efficiency of cell cutting, and thus low efficiency of analyzing biological tissues.
[0004] In related technologies, the cell imaging system can automatically mark the target area where cells are located in the imaging image. Specifically, the cell imaging system can not only image biological tissues to obtain an imaging image, but also automatically identify the target area containing cells in the imaging image and output the identified target area as a mask image, thereby reducing the labor cost of marking the target area. However, if the mask image and the imaging image output by the cell imaging system are directly input to the cell cutting system for display, there will be a large deviation between the image presented on the display interface of the cell cutting system and the image actually output by the cell imaging system. For example, there are problems such as inconsistent image directions and scaling phenomena, resulting in the cell cutting system being unable to accurately cut out the cells in the imaging image through the image output by the cell imaging system. Therefore, the cell imaging system and the cell cutting system cannot be combined for cell cutting, and the efficiency of cell cutting is still low.
[0005] In summary, the cutting efficiency of cells in the imaging image of biological tissues in related technologies is low, thus reducing the analysis efficiency of biological tissues. Summary of the Invention
[0006] To solve the problems in related technologies, embodiments of this application provide an image processing method, apparatus, electronic device, storage medium, and computer program product.
[0007] The technical solution of the embodiments of this application is implemented as follows:
[0008] Embodiments of this application provide an image processing method, and the method includes:
[0009] Obtain a first image and a second image, where the first image is determined based on a scanned image output after the cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image output after the cell imaging system performs cell contour recognition on the target tissue;
[0010] Based on a first mapping relationship, convert the second image into a first file, where the first mapping relationship represents the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the position of a pre-set positioning pattern in the output image and the position on the display interface. Points determined based on the cell contours in the second image are described in the first file;
[0011] Output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0012] In the above solution, the method further includes:
[0013] Determine a first position of the positioning pattern in the output image of the cell imaging system;
[0014] Based on a second file, determine a second position of the positioning pattern in the display interface of the cell cutting system; the second file represents a positioning reference file output by the cell cutting system;
[0015] Based on the first position and the second position, determine the first mapping relationship.
[0016] In the above solution, the determining the first position of the positioning pattern in the output image of the cell imaging system includes:
[0017] Determine the first position of the positioning pattern in the first image.
[0018] In the above solution, the converting the second image into a first file based on the first mapping relationship includes:
[0019] Based on the first mapping relationship, map each pixel corresponding to the cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface;
[0020] Based on the mapped second coordinates, determine a plurality of cutting points, and generate the first file based on the plurality of cutting points.
[0021] In the above solution, the method further includes:
[0022] In response to a drawing operation input by a user, draw the positioning pattern in the output image of the cell imaging system;
[0023] Correspondingly, determining the first position of the positioning pattern in the output image of the cell imaging system includes:
[0024] Based on the gradient of the change in color intensity in the output image, identify the positioning pattern drawn in the output image;
[0025] Based on the identified positioning pattern, determine the first position of the positioning pattern in the output image.
[0026] In the above solution, the second file contains the second position of the positioning pattern.
[0027] In the above solution, obtaining the first image includes:
[0028] Perform a transformation process on the scanned image to obtain the first image; and,
[0029] Obtaining the second image includes:
[0030] Perform a transformation process on the mask image to obtain the second image.
[0031] In the above solution, performing the transformation process on the scanned image includes:
[0032] In response to a first transformation operation input by a user, perform a transformation process on the scanned image; and,
[0033] Performing the transformation process on the mask image includes:
[0034] In response to a second transformation operation input by a user, perform a transformation process on the mask image.
[0035] In the above solution, obtaining the second image includes:
[0036] Expand the cell contour in the mask image outward by a set number of pixels to obtain the second image.
[0037] An embodiment of the present application further provides an image processing apparatus, including:
[0038] An acquisition unit, configured to acquire a first image and a second image, where the first image is determined based on a scanned image output after the cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image output after the cell imaging system performs cell contour recognition on the target tissue;
[0039] A conversion unit, configured to convert the second image into a first file based on a first mapping relationship, where the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on positions of a preset positioning pattern in the output image and on the display interface, and points determined based on cell outlines in the second image are described in the first file;
[0040] An output unit, configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
[0041] An embodiment of the present application further provides an electronic device, including: a communication interface and a processor, where,
[0042] The communication interface is configured to receive a scanned image and a mask image output by the cell imaging system, where the scanned image is obtained after the cell imaging system performs cell imaging processing on a target tissue, and the mask image is obtained after the cell imaging system performs cell outline recognition on the target tissue;
[0043] The processor is configured to obtain a first image and a second image, where the first image is determined based on the scanned image, the second image is determined based on the mask image, and is further configured to convert the second image into a first file based on a first mapping relationship, where the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on positions of a preset positioning pattern in the output image and on the display interface, and points determined based on cell outlines in the second image are described in the first file;
[0044] The communication interface is further configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts cells imaged in the first image based on the first file.
[0045] An embodiment of the present application further provides an electronic device, including: a processor and a memory for storing a computer program that can run on the processor,
[0046] where when the processor is configured to run the computer program, the steps of any of the above methods are executed.
[0047] An embodiment of the present application further provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the above methods are implemented.
[0048] The embodiment of the present application also provides a computer program product, including a computer program, which implements the steps of any of the above methods when executed by a processor.
[0049] In the embodiment of the present application, a first image and a second image are obtained. Among them, the first image is determined based on the scanned image output after the cell imaging system performs cell imaging processing on the target tissue, and the second image is determined based on the mask image output after the cell imaging system performs cell contour recognition on the target tissue. Then, based on the first mapping relationship, the second image is converted into a first file. The first mapping relationship represents the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the positions of the pre-set positioning patterns in the output image and on the display interface. The first file describes the points determined based on the cell contours in the second image. After that, the first image and the first file are output to the cell cutting system, so that the cell cutting system cuts the imaged cells in the first image based on the first file. In the above solution, the first mapping relationship is determined through the pre-set positioning pattern, and then based on the first mapping relationship, the second image is converted into the first file supported by the cell cutting system, which is equivalent to adapting the cell imaging system and the cell cutting system, enabling the cell cutting system to cut cells based on the image output by the cell imaging system. Compared with the related art, the solution provided by the embodiment of the present application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of biological tissue, and further improving the analysis efficiency of biological tissue. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 It is a schematic flowchart of the implementation of an image processing method provided by an embodiment of the present application;
[0051] Figure 2 It is a schematic diagram of a scanned image provided by an embodiment of the present application;
[0052] Figure 3 It is a schematic diagram of a first image provided by an embodiment of the present application;
[0053] Figure 4 It is a schematic diagram of a display interface provided by an embodiment of the present application;
[0054] Figure 5 It is a schematic diagram of a mask image provided by an embodiment of the present application;
[0055] Figure 6 It is a schematic diagram of a second image provided by an embodiment of the present application;
[0056] Figure 7 A schematic diagram of a first interface provided by an embodiment of the present application;
[0057] Figure 8 A schematic structural diagram of an image processing device provided by an embodiment of the present application;
[0058] Figure 9 A schematic structural diagram of the hardware composition of an electronic device provided by an embodiment of the present application. Detailed implementation manners
[0059] With the development of image processing technology, researchers can analyze biological tissues based on the processing of imaging images of biological tissues, so as to further conduct life science research and clinical diagnosis.
[0060] In the process of analyzing biological tissues, the target area where cells are located in the imaging image can be outlined first based on manual annotation, and then the cell cutting system cuts out the cells in the imaging image based on the target area, and then analyzes the cut-out cells. However, the operation of manual annotation is relatively cumbersome, and the imaging image often contains a large number of cells, resulting in low cell cutting efficiency, and thus low analysis efficiency of biological tissues.
[0061] In the related art, the cell imaging system can automatically mark the target area where cells are located in the imaging image. Specifically, the cell imaging system can not only image biological tissues to obtain an imaging image, but also automatically identify the target area containing cells in the imaging image, and output the identified target area as a mask image, thereby reducing the labor cost of marking the target area. However, if the mask image and the imaging image output by the cell imaging system are directly input to the cell cutting system for display, there will be a large deviation between the image presented on the display interface of the cell cutting system and the image actually output by the cell imaging system. For example, there are problems such as inconsistent image orientation and scaling phenomenon, resulting in the cell cutting system being unable to accurately cut out the cells in the imaging image through the image output by the cell imaging system. Therefore, the cell imaging system and the cell cutting system cannot be combined for cell cutting, and the cell cutting efficiency is still low.
[0062] In summary, the cutting efficiency of cells in the imaging image of biological tissues in the related art is low, thereby reducing the analysis efficiency of biological tissues.
[0063] Based on this, in the embodiments of the present application, a first image and a second image are obtained, where the first image is determined based on a scanned image output after the cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image output after the cell imaging system performs cell contour recognition on the target tissue; then, based on a first mapping relationship, the second image is converted into a first file, where the first mapping relationship represents the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the position of a pre-set positioning pattern in the output image and the position on the display interface. Points determined based on the cell contours in the second image are described in the first file; afterwards, the first image and the first file are output to the cell cutting system, so that the cell cutting system cuts the imaged cells in the first image based on the first file. In the above solution, the first mapping relationship is determined through the pre-set positioning pattern, and then, based on the first mapping relationship, the second image is converted into the first file supported by the cell cutting system, which is equivalent to adapting the cell imaging system and the cell cutting system, enabling the cell cutting system to perform cell cutting based on the image output by the cell imaging system. Compared with the related art, the solution provided by the embodiments of the present application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of biological tissue, and further improving the analysis efficiency of biological tissue.
[0064] The following further describes the present application in detail with reference to the drawings and embodiments.
[0065] Embodiments of the present application provide an image processing method. Refer to Figure 1 , the method includes:
[0066] Step 101: Obtain a first image and a second image.
[0067] Among them, the first image is determined based on a scanned image output after the cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image output after the cell imaging system performs cell contour recognition on the target tissue.
[0068] Here, the target tissue can be understood as the biological tissue that the user needs to analyze. Exemplarily, the user can be a researcher, the biological tissue can be a pathological tissue, and the user can perform spatial proteomics analysis based on the target tissue.
[0069] In practical applications, the cell imaging system can perform microscopic imaging on the cells in the target tissue and output a scanned image. The scanned image can be understood as the imaging image of the target tissue, and the scanned image contains one or more imaged cells.
[0070] In practical applications, the cell imaging system can also identify the contours of cells in the target tissue and then output a mask image based on the identified cell contours. The cell imaging system can identify the contours of cells in the target tissue by identifying the contours of the imaged cells in the scanned image.
[0071] Here, the mask image can be characterized as a binary image, that is, each pixel in the mask image has only two values, and each pixel can be used to operate on the pixel at the same position in the scanned image to indicate the target area where the cells in the scanned image are located, and the contour of this area can be regarded as the cell contour.
[0072] Exemplarily, the value of each pixel in the mask image can include: 0 or 1; among them, the pixel with the value of 0 represents a black pixel, which can be used to convert the pixel at the same position in the scanned image to black, equivalent to eliminating the image content at the same pixel position in the scanned image; the pixel with the value of 1 represents a white pixel, which can be used to maintain the color of the pixel at the same position in the scanned image, equivalent to retaining the content at the same pixel position in the scanned image. The white area in the mask image can represent the area where the cells are located. If the mask image is superimposed on the scanned image to obtain a superimposed image, the superimposed image can only include the imaged cells.
[0073] It should be noted that the mask image can include multiple non-overlapping target areas. Each target area can include one or more cells according to business requirements. The contour of each target area can coincide with the overall contour formed by the cells in the target area, or can extend outward by a certain number of pixels compared to the overall contour. Here, for the sake of understanding, the contour of each target area is expressed as the cell contour of the cells in this area.
[0074] In practical applications, after the cell imaging system outputs the scanned image, it can receive the scanned image output by the cell imaging system and preprocess the scanned image to obtain a first image. Exemplarily, the preprocessing of the scanned image can include one or more of the following: performing a transformation process on the scanned image, performing a background conversion on the scanned image; where the transformation process can at least include one or more of the following: mirror transformation, rotation transformation, and the background conversion can include converting the fluorescence field background to a bright field background.
[0075] In practical applications, after the cell imaging system outputs the mask image, it can receive the mask image output by the cell imaging system and preprocess the mask image to obtain a second image. Exemplarily, the preprocessing of the mask image can include: expanding the cell contour in the mask image outward by a set number of pixels.
[0076] In practical applications, the first image can be regarded as a preprocessed scanned image, and the second image can be regarded as a preprocessed mask image. Each pixel in the second image can be used to operate on the pixel at the same position in the first image. That is, each pixel in the first image can correspond to the pixel at the same position in the second image. Based on this, the second image can be used to indicate the target area where the imaged cells in the first image are located, that is, to indicate the outline of the imaged cells in the first image.
[0077] Here, the first image, the second image, the scanned image, and the mask image can all be regarded as the output images of the cell imaging system.
[0078] Step 102: Convert the second image into a first file based on the first mapping relationship.
[0079] Among them, the first mapping relationship characterizes the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the positions of the preset positioning patterns in the output image and on the display interface. The first file describes the points determined based on the cell outline in the second image.
[0080] In practical applications, the first mapping relationship can characterize: when the cell cutting system displays the first image, the coordinate mapping relationship between the actual position of each pixel in the first image in the first image and the position of the pixel in the display interface of the cell cutting system.
[0081] In practical applications, based on the first mapping relationship, the coordinate of a pixel in the second image in the second image can be mapped to the coordinate in the display interface, that is, the pixel can be mapped to the corresponding pixel in the display interface. When the pixel in the second image is used to operate on a pixel in the first image, the position of the corresponding pixel of the pixel in the second image in the display interface can be the same as the position of the pixel in the first image being operated on in the display interface, thus ensuring that accurate operations on the first image can be performed in the cell cutting system based on the indication of the second image.
[0082] Exemplarily, assume that the coordinate of pixel 1 in the first image is (1, 1), the coordinate of pixel 2 in the second image is (1, 1), and the value of pixel 2 is 0. That is, pixel 2 in the second image can be used to perform an elimination operation on pixel 1. Also, assume that the coordinate of pixel 1 in the first image in the display interface of the cell cutting system is (2, 2). On this basis, based on the first mapping relationship, pixel 2 can be mapped to pixel 3 in the display interface, and the coordinate of pixel 3 is (2, 2). Obviously, in the cell cutting system, pixel 1 in the first image can be operated on by pixel 3 corresponding to pixel 2, that is, the first image can be accurately operated on in the cell cutting system based on the indication of the second image.
[0083] In practical applications, if the cell cutting system is directly used to display the second image, there will be a large deviation between the second image presented in the display interface and the second image itself, and it is very likely that the first image imaged in the display interface cannot be accurately operated on based on the indication of the second image.
[0084] Exemplarily, assume that the coordinate of pixel 1 in the first image is (1, 1), the coordinate of pixel 2 in the second image is (1, 1), and the value of pixel 2 is 0. That is, pixel 2 in the second image can be used to perform an elimination operation on pixel 1. Also, assume that the coordinate of pixel 1 in the first image in the display interface of the cell cutting system is (2, 2). On this basis, if the cell cutting system is directly used to display the second image, pixel 2 will be mapped to pixel 4 in the display interface. In practical applications, due to the display deviation, the coordinate of pixel 4 is no longer (2, 2). Therefore, pixel 1 in the first image cannot be operated on by pixel 4 corresponding to pixel 2, that is, the first image cannot be accurately operated on in the cell cutting system based on the indication of the second image.
[0085] In practical applications, based on the first mapping relationship, the coordinates of the pixels on the cell contour in the second image can be mapped to the coordinates in the display interface, and the coordinates in the display interface are equivalent to the coordinates of the corresponding pixels in the display interface. Then, multiple cutting points can be determined based on the multiple mapped coordinates in the display interface, and the determined cutting points are also the points determined based on the cell contour in the second image. After that, a first file can be generated based on the multiple cutting points, and the first file can be used for the cell cutting system to accurately cut out the corresponding cells in the first image.
[0086] In practical applications, the first mapping relationship can be determined based on the position of the positioning pattern preset in the output image in the output image and the position of the preset positioning pattern on the display interface. The position of the preset positioning pattern on the display interface can be understood as: when the cell cutting system displays the output image, the position of the positioning pattern in the output image on the display interface. Exemplarily, the positioning pattern can be a rectangular box.
[0087] Step 103: Output the first image and the first file to the cell cutting system so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0088] Here, outputting the first image and the first file to the cell cutting system can be understood as inputting the obtained first image and the converted first file into the cell cutting system.
[0089] In practical applications, the first image and the first file can be output through the image processing system, that is, the first image and the first file are obtained through the image processing system. The output first image and first file can be input into the cell cutting system so that the cell cutting system cuts the cells imaged in the first image based on the first file. The image processing system can perform image processing based on the image processing method provided in the embodiments of the present application.
[0090] Here, the first file can be understood as a file supported by the cell cutting system for indicating the cutting path. The cutting path is a closed curve composed of multiple cutting points connected. The area within the closed curve can be regarded as the target area corresponding to the cells in the first image. In practical applications, the first file can be an Extensible Markup Language (XML) file.
[0091] In practical applications, after the cell cutting system loads the first file, the cutting path can be presented in the display interface. The area corresponding to the cutting path presented in the display interface can be the same as the position and size of the area corresponding to the cutting path indicated by the first file. Then, the cell cutting system can superimpose the cutting path on the input first image, and thus cut out the cells imaged in the first image according to the superimposed image.
[0092] In the embodiments of the present application, a first mapping relationship is determined through a pre-set positioning pattern. Then, based on the first mapping relationship, a second image is converted into a first file supported by the cell cutting system, which is equivalent to adapting the cell imaging system to the cell cutting system, enabling the cell cutting system to perform cell cutting based on the image output by the cell imaging system. Compared with the related art, the solution provided by the embodiments of the present application can combine the cell imaging system and the cell cutting system for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of biological tissue and further improving the analysis efficiency of biological tissue.
[0093] The following further describes the first mapping relationship.
[0094] In one embodiment, the image processing method provided by the embodiments of the present application further includes:
[0095] Determine the first position of the positioning pattern in the output image of the cell imaging system;
[0096] Based on the second file, determine the second position of the positioning pattern in the display interface of the cell cutting system; the second file represents a positioning reference file output by the cell cutting system;
[0097] Based on the first position and the second position, determine the first mapping relationship.
[0098] In practical applications, the first position can be represented as the coordinates of a pixel on the positioning pattern in the output image. The second position can be represented as the coordinates of the pixel on the positioning pattern in the display interface of the cell cutting system. Exemplarily, when the positioning pattern is a rectangular frame, the first position can be represented as the coordinates of the upper left corner pixel of the positioning pattern in the output image, and the second position can be represented as the coordinates of the upper left corner pixel of the positioning pattern in the display interface.
[0099] In one embodiment, determining the first position of the positioning pattern in the output image of the cell imaging system includes:
[0100] Determine the first position of the positioning pattern in the first image.
[0101] Here, the first position can represent the position of the positioning pattern in the first image.
[0102] In practical applications, a positioning pattern can be pre-set in the output image. It should be noted that when setting the positioning pattern in the output image, the coordinates corresponding to the position of the positioning pattern in the output image may not be determined, that is, the first position is not determined. For example, in response to the user's drawing operation, a positioning pattern can be drawn at a position in the first image without determining the position coordinates, and at this time, the first position of the positioning pattern in the first image is not determined.
[0103] In practical applications, the first position can be determined based on the recognition of the positioning pattern in the output image.
[0104] In one embodiment, the image processing method provided by the embodiments of the present application further includes:
[0105] In response to a drawing operation input by the user, draw a positioning pattern in the output image of the cell imaging system;
[0106] Correspondingly, determining the first position of the positioning pattern in the output image of the cell imaging system includes:
[0107] Based on the gradient of the color intensity change in the output image, identify the positioning pattern drawn in the output image;
[0108] Based on the identified positioning pattern, determine the first position of the positioning pattern in the output image.
[0109] In practical applications, the first position of the positioning pattern in the output image can be identified based on the following steps:
[0110] Step 1: Superimpose and calculate the fluorescence multi-channel brightness in the output image to obtain the color intensity calculation result.
[0111] Step 2: Based on the color intensity calculation result, calculate the gradients in all directions of the output image.
[0112] In practical applications, the calculated gradients can be understood as the gradients of the color intensity change in the output image. The calculated gradients can be used to detect multiple regions in the output image. The contour of each region can be similar to the positioning pattern and can be regarded as an alternative pattern. The positions of these alternative patterns in the output image can be directly read during the detection process and stored in the memory.
[0113] In practical applications, the positioning pattern can be one of these alternative patterns, and the positioning pattern can be selected from the detected multiple alternative patterns.
[0114] Step 3: Remove the regions in the output image that do not meet the set rules.
[0115] In practical applications, among the multiple alternative patterns, the alternative patterns corresponding to the regions that do not meet the set rules can be removed. The removed alternative patterns can be regarded as being judged not to be the positioning pattern. The alternative patterns finally retained among the multiple alternative patterns are the positioning patterns.
[0116] Exemplarily, the set rules may include one or more of the following: the area of the region is greater than the set area threshold, and the aspect ratio of the region is equal to the set ratio.
[0117] Step 4: Determine the first position of the identified positioning pattern in the output image.
[0118] In practical applications, the first position of the identified positioning pattern in the output image can be directly read from the memory. In this way, the first position can be determined.
[0119] In practical applications, the second file can be used to determine the second position of the positioning pattern in the display interface of the cell cutting system.
[0120] In one embodiment, the second file contains the second position of the positioning pattern.
[0121] Here, based on the second file, the second position can be directly determined.
[0122] In practical applications, the second file can also contain position information for determining the second position. Specifically, the position information contained in the second file can characterize the position of the positioning reference pattern in the display interface. The size of the positioning reference pattern can be the same as that of the positioning pattern. The position of the positioning reference pattern in the display interface of the cell cutting system can correspond to the position of the positioning pattern in the display interface, that is, correspond to the second position. Based on the position information contained in the second file, the second position can be determined. Exemplarily, the coordinates of the pixel corresponding to the first position on the positioning reference pattern in the display interface of the cell cutting system can be determined as the second position.
[0123] In practical applications, in response to the user's drawing operation, a positioning reference pattern can be drawn in the display interface of the cell cutting system, and the position of the positioning reference pattern can be made to correspond to the second position. Then, the cell cutting system is called to export the positioning reference pattern in the display interface as the second file. The second file can be an XML file.
[0124] Exemplarily, when the cell cutting system performs real-time imaging on the membrane with attached tissue, a positioning reference pattern can be drawn at a position with clear vision in the tissue image presented in the display interface, and then the positioning reference pattern is exported as the second file. Alternatively, when the cell cutting system displays the first image, a positioning reference pattern can be drawn in the display interface and made to coincide with the pre-set positioning pattern in the first image, and then the positioning reference pattern is exported as the second file.
[0125] Here, based on the first position and the second position, the coordinate mapping relationship between the coordinates of a pixel on the positioning pattern in the output image and the coordinates of the pixel on the positioning pattern in the display interface of the cell cutting system can be determined. This coordinate mapping relationship can be used to determine the first mapping relationship.
[0126] In practical applications, the coordinate mapping relationship between the first position and the second position can be used as the first mapping relationship.
[0127] In one embodiment, converting the second image into the first file based on the first mapping relationship includes:
[0128] Based on the first mapping relationship, each pixel corresponding to the cell contour in the second image is mapped from the first coordinate in the second image to the second coordinate in the display interface;
[0129] Based on the mapped second coordinates, a plurality of cutting points are determined, and the first file is generated based on the plurality of cutting points.
[0130] Here, each first coordinate can be understood as the coordinate of a pixel on the cell contour in the second image in the second image. Each second coordinate can be understood as the coordinate of a pixel in the display interface, and this pixel corresponds to a pixel on the cell contour in the second image. Each second coordinate can also be understood as the coordinate to which a pixel on the cell contour in the second image is mapped in the display interface.
[0131] In practical applications, the determined plurality of cutting points can form one or more cutting paths, and each cutting path can be used to indicate a region in the first image, and this region and the target region indicated by the second image can represent the same region in the first image.
[0132] In practical applications, the determined plurality of cutting points can be converted into data in the form of a list connected to each other, and then a table header is created based on the second file, and the data in the list form is combined into the table header to obtain the combined data, and then the first file is generated based on the combined data.
[0133] In practical applications, based on the first file, the cell cutting system can determine one or more cutting paths and cut out the region corresponding to each cutting path from the first image. In this way, it is equivalent to cutting out the cells in the target region indicated by the second image, thereby realizing the combination of the cell imaging system and the cell cutting system for cell cutting and improving the efficiency of cell cutting.
[0134] Next, the acquisition methods of the first image and the second image will be further described.
[0135] In one embodiment, acquiring the first image includes:
[0136] Performing transformation processing on the scanned image to obtain the first image; and,
[0137] Acquiring the second image includes:
[0138] Performing transformation processing on the mask image to obtain the second image.
[0139] In practical applications, the transformation processing may include at least one or more of the following: mirror transformation, rotation transformation.
[0140] In practical applications, the imaging methods of the cell imaging system and the cell cutting system may be different, resulting in different image orientations between the image presented by the cell cutting system on the display interface and the image output by the cell imaging system. Exemplarily, the cell imaging system may be based on an upright microscope for imaging, and the cell cutting system may be based on an inverted microscope for imaging. On this basis, if the image output by the cell imaging system is directly input into the cell cutting system for display, the image presented by the cell cutting system on the display interface and the image output by the cell imaging system are in a mirror relationship.
[0141] In practical applications, the transformation processing performed on the mask image may be the same as the transformation processing performed on the scanned image.
[0142] Here, performing transformation processing on the scanned image can make the first image displayed by the cell cutting system consistent with the image orientation of the scanned image. Also, performing transformation processing on the mask image can make the image orientation corresponding to the cutting path consistent with the image orientation corresponding to the mask image when the cell cutting system displays the cutting path based on the first file generated according to the second image. In this way, the operation difficulty for the user to observe images using the cell imaging system and the cell cutting system is reduced, thereby improving the efficiency of cell cutting.
[0143] In one embodiment, performing transformation processing on the scanned image includes:
[0144] responding to a first transformation operation input by the user, performing transformation processing on the scanned image; and
[0145] Performing transformation processing on the mask image includes:
[0146] responding to a second transformation operation input by the user, performing transformation processing on the mask image.
[0147] In practical applications, both the first transformation operation and the second transformation operation can be understood as transformation operations input by the user. The first transformation operation and the second transformation operation can be the same user input or different user inputs.
[0148] In practical applications, it is possible to perform transformation processing on both the scanned image and the mask image in response to a transformation operation input by the user, or to perform transformation processing on the scanned image and the mask image separately in response to two transformation operations input by the user.
[0149] In practical applications, a user can pre-store an image to be transformed in a first set path, which can be a folder path, and multiple images to be transformed can be stored under the first set path. Then the user can input a transformation operation in a display interface for transformation processing, which can be characterized as an interface in an image processing system, and the image processing system can perform image processing based on the image processing method provided in the embodiments of the present application.
[0150] Exemplarily, the transformation operation input by the user can at least include the following operation contents:
[0151] Operation content 1: In the display interface for transformation processing, the user inputs the first set path by selecting a folder or keyboard input, etc.
[0152] Operation content 2: The user clicks a button on the display interface for triggering transformation processing.
[0153] Among them, operation content 2 needs to be the last operation content in a transformation operation, that is, when the user inputs a transformation operation, operation content 2 needs to be the last operation content input by the user.
[0154] In practical applications, in response to the transformation operation input by the user, the first set path can be determined, and then one or more corresponding images under the first set path can be read, and each read image can be transformed.
[0155] In practical applications, the image can be transformed based on a first set function instruction. Exemplarily, the first set function instruction can include "fliplr".
[0156] Here, Figure 2 an example of a scanned image is given, Figure 3 an example of a first image is given, where Figure 3 the first image in Figure 2 is obtained by transforming the scanned image in
[0157] In one embodiment, obtaining a second image includes:
[0158] Expanding the cell contour in the mask image outward by a set number of pixels to obtain a second image.
[0159] In practical applications, expanding the cell contour in the mask image outward by a set number of pixels can be regarded as performing mask dilation processing on the mask image. Mask dilation can enable the target area indicated by the second image to contain cells in a complete form, thereby ensuring the integrity of the cut cells.
[0160] In practical applications, in response to a mask dilation operation input by a user, the cell contours in the mask image can be expanded outward by a set number of pixels to obtain a second image. After obtaining the second image, the second image can be superimposed on the first image in a semi-transparent form to obtain a superimposed image, so that the user can verify whether the target area indicated by the second image contains cells in a complete form based on the superimposed image.
[0161] In practical applications, the user can pre-store the mask image in a second set path, and then the user can input a mask dilation operation in a display interface for mask dilation processing. The display interface can be characterized as an interface in an image processing system, and the image processing system can perform image processing based on the image processing method provided in the embodiments of the present application.
[0162] Exemplarily, referring to Figure 4 the provided display interface for mask dilation processing, the mask dilation operation input by the user can at least include the following operation contents:
[0163] Operation content 1: The user operates the file selector corresponding to "Mask Image" to input the storage path of the mask image.
[0164] Operation content 2: The user operates the file selector corresponding to "Save Folder" to input the output path of the second image. In practical applications, the second image obtained after mask dilation processing can be output to this output path.
[0165] Operation content 3: The user inputs multiple values in the input box corresponding to "Dilation Radius". In practical applications, the multiple values input by the user can be separated by ",", for example, the user can input "10, 20, 30", so that the three cell contours in the mask image can be expanded outward by 10, 20, and 30 pixels respectively.
[0166] Operation content 4: The user clicks the "Run" button in the display interface to trigger mask dilation processing.
[0167] Among them, the order of operation content 1, operation content 2, and operation content 3 in a single mask dilation processing can be unrestricted, and operation content 4 needs to be the last operation content in a single mask dilation processing.
[0168] In practical applications, the mask image can be subjected to mask dilation processing based on a second set of function instructions. Exemplarily, the second set of function instructions can include "cv2.distanceTransform" and "cv2.addWeighted".
[0169] Here, Figure 5 an example of a mask image is given. Figure 6 an example of a second image is given, where Figure 6 the second image in Figure 5 is obtained by performing mask dilation on the scanned image in
[0170] Based on the above method embodiments, an embodiment of the present application further provides an image processing system, including:
[0171] An image processing module, configured to execute the method in any of the above embodiments, so that the cell cutting system cuts the cells imaged in each of one or more first images.
[0172] In practical applications, the image processing module may be used to: obtain one or more first images and one or more second images; convert each second image into a first file based on the first mapping relationship; and output one or more first images and one or more first files to the cell cutting system, so that the cell cutting system cuts the cells imaged in each of one or more first images.
[0173] In practical applications, the cell imaging system may output one or more scanned images and one or more mask images. Each first image obtained by the image processing module may be determined based on a scanned image, and each second image obtained by the image processing module may be determined based on a mask image.
[0174] In practical applications, the image processing system may, in response to a conversion operation input by a user, convert the second image into a first file. On this basis, the image processing system may perform conversion processing based on two conversion modes to convert the second image into a first file. These two conversion modes include:
[0175] The first mode: in response to a single conversion operation input by a user, convert one second image into one first file.
[0176] The second mode: in response to a single conversion operation input by a user, convert multiple second images into first files respectively.
[0177] In practical applications, the first mode can also be described as the single image (Single) mode, and the second mode can also be described as the multi image (Multi) mode.
[0178] In practical applications, the image processing system may further include a display module, and the display module may be used to display a first interface, and the first interface may be used to receive the conversion operation input by a user.
[0179] Exemplarily, Figure 7A schematic diagram of a first interface is provided, where the mode of the image conversion system is in Single mode. Refer to Figure 7 , and a single conversion operation input by the user may at least include the following operation contents:
[0180] Operation content 1: The user operates the file selector corresponding to "Image Folder" to input the storage paths of the scanned image and the mask image. In practical applications, the scanned image and the mask image may be stored in the same storage path, and the image processing module can obtain the scanned image and the mask image based on this storage path, and then determine the first image and the second image.
[0181] Operation content 2: The user operates the file selector corresponding to "Save Folder" to input the output path of the first file. In practical applications, the first file converted by the image processing module can be output to this output path.
[0182] Operation content 3: The user operates the file selector corresponding to "Reference XML (Reference Extensible Markup Language File)" to input the storage path of the second file. In practical applications, the image processing module can obtain the second file based on this storage path, and then determine the first mapping relationship based on the second file.
[0183] Operation content 4: The user clicks the "Run" button on the first interface to trigger the conversion process.
[0184] Among them, the order of operation content 1, operation content 2, and operation content 3 in a single conversion process may have no restrictions, and operation content 4 needs to be the last operation content in a single conversion process.
[0185] In the embodiment of the present application, the image processing system determines the first mapping relationship through a pre-set positioning pattern, and then based on the first mapping relationship, converts the second image into the first file supported by the cell cutting system, which is equivalent to adapting the cell imaging system and the cell cutting system, so that the cell cutting system can perform cell cutting based on the image output by the cell imaging system. Compared with the related art, the solution provided by the embodiment of the present application enables the cell imaging system and the cell cutting system to be combined for cell cutting, thereby improving the cutting efficiency of cells in the imaging image of biological tissues, and further improving the analysis efficiency of biological tissues.
[0186] Moreover, the image processing system provided by the embodiments of the present application can receive a conversion operation input by a user based on a first interface, and then convert a second image into a first file based on the response of an image processing module to the conversion operation. This simplifies the user operation through the first interface, thereby further improving the efficiency of cell cutting. Further, the image processing system provided by the embodiments of the present application also supports a multi-image mode. Therefore, the user only needs to input a conversion operation once to convert multiple second images into first files respectively, thus further simplifying the user operation and improving the efficiency of cell cutting.
[0187] Based on the embodiments described above, the present application also provides an image processing device. Refer to Figure 8 , the image processing device includes:
[0188] An acquisition unit 81, configured to acquire a first image and a second image, where the first image is determined based on a scanned image output after a cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image output after the cell imaging system performs cell contour recognition on the target tissue;
[0189] A conversion unit 82, configured to convert the second image into a first file based on a first mapping relationship, where the first mapping relationship represents the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the positions of a pre-set positioning pattern in the output image and on the display interface, and points determined based on the cell contours in the second image are described in the first file;
[0190] An output unit 83, configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0191] In an embodiment, the image processing device further includes a determination unit, and the determination unit is configured to:
[0192] Determine a first position of the positioning pattern in the output image of the cell imaging system;
[0193] Based on a second file, determine a second position of the positioning pattern in the display interface of the cell cutting system; the second file represents a positioning reference file output by the cell cutting system;
[0194] Determine the first mapping relationship based on the first position and the second position.
[0195] In one embodiment, the determining unit determines a first position of the positioning pattern in an output image of the cell imaging system, including:
[0196] Determining the first position of the positioning pattern in the first image.
[0197] In one embodiment, the conversion unit 82 converts a second image into a first file based on the first mapping relationship, including:
[0198] Based on the first mapping relationship, mapping each pixel corresponding to the cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface;
[0199] Based on the mapped second coordinates, determining a plurality of cutting points, and generating the first file based on the plurality of cutting points.
[0200] In one embodiment, the determining unit is further configured to:
[0201] In response to a drawing operation input by a user, draw the positioning pattern in the output image of the cell imaging system;
[0202] Correspondingly, the determining unit determines the first position of the positioning pattern in the output image of the cell imaging system, including:
[0203] Based on a gradient of color intensity change in the output image, identifying the positioning pattern drawn in the output image;
[0204] Based on the identified positioning pattern, determining the first position of the positioning pattern in the output image.
[0205] In one embodiment, the second file contains the second position of the positioning pattern.
[0206] In one embodiment, the obtaining unit 81 obtains the first image, including:
[0207] Performing a transformation process on the scanned image to obtain the first image; and,
[0208] Obtaining the second image, including:
[0209] Performing a transformation process on the mask image to obtain the second image.
[0210] In one embodiment, the obtaining unit 81 performs a transformation process on the scanned image, including:
[0211] In response to a first transformation operation input by a user, performing a transformation process on the scanned image; and,
[0212] The obtaining unit 81 performs transformation processing on the mask image, including:
[0213] In response to a second transformation operation input by the user, performing transformation processing on the mask image.
[0214] In one embodiment, the obtaining unit 81 obtains the second image, including:
[0215] Expanding the cell contours in the mask image outward by a set number of pixels to obtain the second image.
[0216] In practical applications, the obtaining unit 81, the conversion unit 82, the output unit 83, and the determination unit can all be implemented by a processor in an image processing device.
[0217] It should be noted that: when the image processing device provided in the above embodiment performs image processing, only the division of the above program modules is used for illustration. In practical applications, the above processing can be allocated to different program modules according to needs, that is, the internal structure of the device is divided into different program modules to complete all or part of the above-described processing. In addition, the image processing device provided in the above embodiment and the image processing method embodiment belong to the same concept. For the specific implementation process, please refer to the method embodiment, which will not be elaborated here.
[0218] Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiments of the present application, the present application further provides an electronic device. Referring to Figure 9 , the electronic device includes:
[0219] A communication interface 1 capable of interacting with other devices;
[0220] A processor 2, connected to the communication interface 1 to implement information interaction with other devices, and used to execute the methods provided by one or more technical solutions in the above embodiments when running a computer program. And the computer program is stored on a memory 3.
[0221] Specifically, the communication interface 1 is used to receive a scanned image and a mask image output by a cell imaging system. The scanned image is obtained after the cell imaging system performs cell imaging processing on a target tissue, and the mask image is obtained after the cell imaging system performs cell contour recognition on the target tissue;
[0222] The processor 2 is configured to obtain a first image and a second image, where the first image is determined based on the scanned image, the second image is determined based on the mask image, and to convert the second image into a first file based on a first mapping relationship, where the first mapping relationship represents the coordinate mapping relationship of corresponding pixels between the output image of the cell imaging system and the display interface of the cell cutting system, and the first mapping relationship is determined based on the positions of a preset positioning pattern in the output image and on the display interface, and points determined based on the cell contours in the second image are described in the first file;
[0223] The communication interface 1 is further configured to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
[0224] In one embodiment, the processor 2 is further configured to:
[0225] Determine a first position of the positioning pattern in the output image of the cell imaging system;
[0226] Based on a second file, determine a second position of the positioning pattern in the display interface of the cell cutting system; the second file represents a positioning reference file output by the cell cutting system;
[0227] Determine the first mapping relationship based on the first position and the second position.
[0228] In one embodiment, when the processor 2 determines the first position of the positioning pattern in the output image of the cell imaging system, it includes:
[0229] Determine the first position of the positioning pattern in the first image.
[0230] In one embodiment, when the processor 2 converts the second image into the first file based on the first mapping relationship, it includes:
[0231] Based on the first mapping relationship, map each pixel corresponding to the cell contour in the second image from a first coordinate in the second image to a second coordinate in the display interface;
[0232] Determine a plurality of cutting points based on the mapped second coordinates, and generate the first file based on the plurality of cutting points.
[0233] In one embodiment, the processor 2 is further configured to: in response to a drawing operation input by a user, draw the positioning pattern in the output image of the cell imaging system;
[0234] Correspondingly, the processor 2 determines a first position of the positioning pattern in the output image of the cell imaging system, including:
[0235] Identifying the positioning pattern drawn in the output image based on a gradient of color intensity change in the output image;
[0236] Based on the identified positioning pattern, determining the first position of the positioning pattern in the output image.
[0237] In one embodiment, the second file contains the second position of the positioning pattern.
[0238] In one embodiment, the processor 2 obtains the first image, including:
[0239] Performing a transformation process on the scanned image to obtain the first image; and,
[0240] Obtaining the second image, including:
[0241] Performing a transformation process on the mask image to obtain the second image.
[0242] In one embodiment, the processor 2 performs a transformation process on the scanned image, including:
[0243] In response to a first transformation operation input by a user, performing a transformation process on the scanned image; and,
[0244] The processor 2 performs a transformation process on the mask image, including:
[0245] In response to a second transformation operation input by a user, performing a transformation process on the mask image.
[0246] In one embodiment, the processor 2 obtains the second image, including:
[0247] Expanding the cell contour in the mask image outward by a set number of pixels to obtain the second image.
[0248] It should be noted that: The specific processing process of the communication interface 1 can be understood with reference to the above method.
[0249] Of course, in actual application, each component in the electronic device is coupled together through the bus system 4. It can be understood that the bus system 4 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 4 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 9 all kinds of buses are labeled as the bus system 4.
[0250] The memory 3 in the embodiments of the present application is used to store various types of data to support operations in the electronic device. Examples of such data include: any computer program for operating on the electronic device.
[0251] The method disclosed in the embodiments of the present application above can be applied to the processor 2 or implemented by the processor 2. The processor 2 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in the processor 2 or the instructions in software form. The above-mentioned processor 2 may be a general-purpose processor, DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 2 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. Combining the steps of the method disclosed in the embodiments of the present application, it can be directly embodied as being executed and completed by the hardware decoding processor, or by the combination of the hardware and software modules in the decoding processor. The software module may be located in the storage medium, and this storage medium is located in the memory 3. The processor 2 reads the information in the memory 3 and combines its hardware to complete the steps of the foregoing method.
[0252] In an exemplary embodiment, the electronic device can be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, Microprocessors, or other electronic components for executing the foregoing method.
[0253] It can be understood that the memory 3 in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM, Read-Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory), an electrically erasable programmable read-only memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), a ferromagnetic random access memory (FRAM, ferromagnetic random access memory), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM, Compact Disc Read-Only Memory); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM, RandomAccess Memory), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as a static random access memory (SRAM, Static Random Access Memory), a synchronous static random access memory (SSRAM, Synchronous Static Random Access Memory), a dynamic random access memory (DRAM, Dynamic Random Access Memory), a synchronous dynamic random access memory (SDRAM, SynchronousDynamic Random Access Memory), a double data rate synchronous dynamic random access memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), an enhanced synchronous dynamic random access memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), a sync link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and a direct rambus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.
[0254] In an exemplary embodiment, the embodiments of this application also provide a storage medium, namely a computer storage medium, specifically a computer-readable storage medium. For example, it includes an electronic device storing a computer program, and the above computer program can be executed by the processor 2 of the electronic device to complete the steps described in the foregoing method. The computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM.
[0255] In an exemplary embodiment, the embodiments of this application also provide a computer program product, including a computer program, and the computer program can be executed by the processor 2 of the electronic device to complete the steps described in any of the foregoing methods.
[0256] It should be noted that: "first", "second", etc. are used to distinguish similar objects and do not necessarily describe a specific order or sequence.
[0257] In this article, the term "and / or" is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "one or more" in this article means any one or any combination of at least two of more than one. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set composed of A, B, and C.
[0258] In addition, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict.
Claims
1. An image processing method, characterized in that: The method comprises: Acquire a first image and a second image, wherein the first image is determined based on a scanned image outputted after a cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image outputted after the cell imaging system performs cell contour recognition on the target tissue; Based on a first mapping relationship, converting the second image into a first file, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a preset positioning pattern in the output image and a position on the display interface, and the first file describes points determined based on cell contours in the second image; The first image and the first file are output to the cell cutting system so that the cell cutting system cuts the cells imaged in the first image based on the first file.
2. The method according to claim 1, characterized in that The method further comprises: Determining a first position of the positioning pattern in an output image of the cell imaging system; Determining a second position of the positioning graphic in the display interface of the cell cutting system based on a second file; the second file represents a positioning reference file output by the cell cutting system; The first mapping relationship is determined based on the first position and the second position.
3. The method according to claim 2, characterized in that Determining a first position of the positioning pattern in an output image of the cell imaging system comprises: The first position of the locator pattern in the first image is determined.
4. The method according to claim 1, characterized in that: The converting the second image into the first file based on the first mapping relationship includes: Based on the first mapping relationship, each pixel corresponding to the cell outline in the second image is mapped from the first coordinate in the second image to the second coordinate in the display interface; Based on the mapped second coordinates, a plurality of cutting points are determined, and the first file is generated based on the plurality of cutting points.
5. The method according to claim 2, characterized in that: The method further comprises: In response to a drawing operation input by a user, drawing the positioning pattern in an output image of the cell imaging system; Correspondingly, determining the first position of the positioning pattern in the output image of the cell imaging system includes: Based on the gradient of the color intensity change in the output image, identifying the positioning pattern drawn in the output image; Based on the identified positioning pattern, the first position of the positioning pattern in the output image is determined.
6. The method according to claim 2, characterized in that The second file includes the second position of the positioning pattern.
7. The method according to claim 1, characterized in that Acquiring the first image includes: performing transformation processing on the scanned image to obtain the first image; and, Acquiring the second image includes: The mask image is transformed to obtain the second image.
8. The method according to claim 7, characterized in that The step of transforming the scanned image comprises: In response to a first transformation operation input by a user, transforming the scanned image; and The transforming process of the mask image comprises: In response to a second transformation operation input by a user, the mask image is transformed.
9. The method according to claim 1, characterized in that: Acquiring the second image includes: The cell contour in the mask image is expanded outward by a set number of pixels to obtain the second image.
10. An image processing device, characterized in that: include: An acquisition unit, configured to acquire a first image and a second image, wherein the first image is determined based on a scanned image outputted after a cell imaging system performs cell imaging processing on a target tissue, and the second image is determined based on a mask image outputted after the cell imaging system performs cell contour recognition on the target tissue; A conversion unit, configured to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a preset positioning pattern in the output image and a position on the display interface, and the first file describes points determined based on cell contours in the second image; An output unit is used to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
11. An electronic device, characterized in that: include: A communication interface and a processor, wherein The communication interface is used to receive a scanned image and a mask image output by a cell imaging system, wherein the scanned image is obtained after the cell imaging system performs cell imaging processing on the target tissue, and the mask image is obtained after the cell imaging system performs cell contour recognition on the target tissue; The processor is used to acquire a first image and a second image, wherein the first image is determined based on the scanned image, and the second image is determined based on the mask image, and is used to convert the second image into a first file based on a first mapping relationship, wherein the first mapping relationship represents a coordinate mapping relationship of corresponding pixels between an output image of the cell imaging system and a display interface of the cell cutting system, and the first mapping relationship is determined based on a position of a preset positioning pattern in the output image and on the display interface, and the first file describes points determined based on cell contours in the second image; The communication interface is further used to output the first image and the first file to the cell cutting system, so that the cell cutting system cuts the cells imaged in the first image based on the first file.
12. An electronic device, characterized in that: a processor and a memory for storing a computer program capable of being executed on the processor, Wherein, when the processor is used to run the computer program, it executes the steps of the method described in any one of claims 1 to 9.
13. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.
14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.
Citation Information
Patent Citations
Microscope slide coordinate system registration
CN103430077A
Cutting system and method for determining cell boundary
CN116004377A
Image processing systems and methods for displaying multiple images of a biological specimen
US20180322632A1
Cited By
Cell screening method and device, electronic equipment and computer program product
CN120807435A
Cell screening method, device, electronic equipment and computer program product
CN120807435B
Cell cutting method and device, electronic equipment and computer program product
CN120807542A