Cell extraction method, device, equipment, medium and program product in two-photon imaging data analysis

By displaying label signal images and cell contour data in two-photon imaging data analysis and allowing users to interactively select and modify the contour color, the problem of low cell extraction accuracy on live animal samples is solved, achieving high accuracy and high accuracy Efficient cell extraction.

CN118918584AActive Publication Date: 2024-11-08SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202410991140.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-08
Estimated Expiration
2044-07-23

AI Technical Summary

Technical Problem

The existing two-photon imaging technology has low cell extraction accuracy on live animal samples, mainly due to the large background noise, low signal-to-noise ratio and uneven label signal intensity of live samples, resulting in incorrect matching of label signal signal and cell profile. Accurate cell extraction cannot be achieved.

Method used

By displaying the tag signal image and cell contour data in two-photon imaging data analysis, and allowing the user to interactively select and modify the contour color, thereby achieving accurate cell extraction, using color changes of the first and second channels to identify and extract cells marked by tagged signals.

Benefits of technology

Accurate extraction of cells in two-photon imaging data analysis, especially high accuracy on live animal samples, significantly improving the accuracy and efficiency of cell extraction through an interactive dual-channel process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918584A_ABST
    Figure CN118918584A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a cell extraction method, device and equipment in two-photon imaging data analysis, a medium and a program product. The method comprises the steps that a label signal image is displayed on a display interface, cell contour data are displayed on the label signal image, the cell contour data are obtained on the basis of a first channel used for recording activity signals, the cell contour data represent multiple cell contours, and the label signal image is obtained on the basis of a second channel used for recording label signals; in response to a selection operation acting on the label signal image, for a selected contour in the plurality of cell contours, displaying the selected contour after contour color modification on the label signal image; wherein under the condition that the contour color is modified from a first color corresponding to the first channel to a second color corresponding to the second channel, the selected cell represented by the selected contour is extracted. According to the technical scheme provided by the embodiment of the invention, accurate extraction of the cells labeled by the label signal can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of biological technology, and in particular to a cell extraction method, device, equipment, medium and program product in two-photon imaging data analysis. Background Art

[0002] Two-photon imaging is an imaging technique that is particularly suitable for recording in living animals.

[0003] At present, two-photon imaging instruments are generally equipped with two color channels, red and green. Among them, the green channel is generally used to record cell activity signals, which can be used to obtain the cell outlines of all cells; while the red channel is generally used to record label signals to distinguish special types of cells.

[0004] Therefore, in the later data analysis, identifying cells marked by label signals has become a necessary part of data analysis. However, it is currently impossible to accurately extract such cells, which needs to be solved urgently. Summary of the invention

[0005] The embodiments of the present invention provide a method, device, equipment, medium and program product for cell extraction in two-photon imaging data analysis to achieve accurate extraction of cells marked by label signals.

[0006] According to one aspect of the present invention, a method for cell extraction in two-photon imaging data analysis is provided, which may include:

[0007] Displaying a label signal image on a display interface, and displaying cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on a second channel used to record label signals after two-photon imaging;

[0008] In response to a selection operation performed on the label signal image, for a selected contour among a plurality of cell contours, a selected contour with a modified contour color may be displayed on the label signal image;

[0009] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0010] According to another aspect of the present invention, a cell extraction device for two-photon imaging data analysis is provided, which may include:

[0011] A first display module is used to display a label signal image on a display interface, and to display cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on a second channel used to record label signals after two-photon imaging;

[0012] A second display module is used for displaying the selected contour after the contour color is modified on the label signal image in response to the selection operation on the label signal image for the selected contour among the plurality of cell contours;

[0013] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0014] According to another aspect of the present invention, there is provided an electronic device, which may include:

[0015] at least one processor; and

[0016] a memory communicatively connected to at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the at least one processor implements the cell extraction method in two-photon imaging data analysis provided by any embodiment of the present invention when executing the computer program.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, on which computer instructions are stored, and the computer instructions are used to enable a processor to implement the cell extraction method in two-photon imaging data analysis provided by any embodiment of the present invention when executed.

[0019] According to another aspect of the present invention, a computer program product is provided, on which a computer program is stored. When the computer program is executed by a processor, the cell extraction method in two-photon imaging data analysis provided by any embodiment of the present invention is implemented.

[0020] The technical solution of the embodiment of the present invention is to display the label signal image on the display interface, and then display the cell contour data on the label signal image. The cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging, and the label signal image is obtained based on the second channel used to record the label signal after two-photon imaging. In this way, relevant personnel can browse the label signal image and the cell contour data on the display interface at the same time, and then determine the cell contour corresponding to the cell X (i.e., the cell marked by the label signal) among the multiple cell contours represented by the cell contour data, and trigger the selection operation on this basis; in response to the selection operation acting on the label signal image, for the selected contour among the multiple cell contours, the selected contour after the contour color is modified can be displayed on the label signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it means that the selected cell represented by the selected contour is cell X, and thus extracted. The above technical solution realizes the accurate extraction of cell X in two-photon imaging data analysis through an interactive two-channel cell extraction process, especially realizes the accurate extraction of cell X of living animals in two-photon imaging data analysis.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flow chart of a cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0024] Figure 2 is a flow chart of another method for cell extraction in two-photon imaging data analysis provided according to an embodiment of the present invention;

[0025] Figure 3 is a flow chart of another method for cell extraction in two-photon imaging data analysis provided according to an embodiment of the present invention;

[0026] Figure 4a It is a display result diagram of cell contour data and label signal image in another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0027] Figure 4b It is a local magnified result diagram of cell contour data and label signal image in another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0028] Figure 5a This is a schematic diagram of a result in which the outline color changes from green to red in another method for extracting cells in two-photon imaging data analysis provided according to an embodiment of the present invention;

[0029] Figure 5b According to another method for cell extraction in two-photon imaging data analysis provided by an embodiment of the present invention, Figure 5a The corresponding partial enlarged schematic diagram;

[0030] Figure 6 is a schematic diagram of saving controls in another method for extracting cells in two-photon imaging data analysis provided according to an embodiment of the present invention;

[0031] Figure 7 is a structural block diagram of a cell extraction device in two-photon imaging data analysis provided by an embodiment of the present invention;

[0032] Figure 8 It is a schematic diagram of the structure of an electronic device for implementing the cell extraction method in two-photon imaging data analysis according to an embodiment of the present invention. DETAILED DESCRIPTION

[0033] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0034] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The situations of "target", "original", etc. are similar and will not be repeated here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0035] Before introducing the embodiments of the present invention, the specific reasons why it is currently impossible to accurately extract cells labeled with label signals (hereinafter referred to as cell X) are first exemplified to better understand why the following embodiments can accurately extract cell X.

[0036] For example, currently, machine vision is mainly used to identify the label signal in the label signal image, and then the identified label signal is matched with multiple cell contours represented by the cell contour data, and then the cell represented by the obtained matching contour is used as cell X to complete the extraction. However, the above extraction scheme can achieve a good extraction accuracy rate on in vitro samples, but the extraction accuracy rate on living samples (such as living animals) is not high. After analysis, it is caused by at least the following two reasons:

[0037] On the one hand, the reason is that the imaging characteristics of in vitro samples and living samples are different. Specifically, 1) in vitro samples are brain slices, so their background noise can be compressed and controlled, while living samples are in vivo images, and the background noise brought by many brain tissues cannot be compressed and controlled. This leads to greater background noise in the label signal image of living samples compared to in vitro samples, which will directly affect the accuracy of label signal recognition. 2) Under in vitro sample imaging, mutual contamination between the two color channels rarely occurs or is suppressed by stronger effective signals, while living samples need to avoid phototoxicity, so that the living samples can be protected, so the effective signal is weaker, which leads to more mutual contamination between the two color channels under living sample imaging, resulting in lower signal-to-noise ratio of the label signal image of the living sample compared to the in vitro sample, which in turn leads to lower accuracy of label signal recognition. 3) There are differences in the intensity of the label signals of multiple cells X. This difference is related to the uneven expression of the label signal protein and has little correlation with the intensity of the irradiated light. For example, when the intensity is represented by pixel values, there are differences in the pixel values ​​of each pixel representing the label signal, which further makes it difficult to accurately identify the label signal.

[0038] On the other hand, the identified label signals often make mistakes when matching cell contours, which further reduces the accuracy of cell X extraction.

[0039] In summary, due to the particularity of two-photon imaging of living samples, the currently used cell extraction scheme cannot achieve accurate extraction of cell X in data analysis. In order to solve this problem, the following embodiments propose an interactive cell extraction scheme. The technical scheme will be described in detail below.

[0040] Figure 1 It is a flow chart of a cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention. This embodiment is applicable to the case of extracting cells (i.e., cell X) marked by a label signal in two-photon imaging data analysis, and is particularly applicable to the case of extracting cell X in two-photon imaging data analysis of living samples. The method can be executed by a cell extraction device in two-photon imaging data analysis provided by an embodiment of the present invention, and the device can be implemented by software and / or hardware, and the device can be integrated in an electronic device, which can be various user terminals or servers.

[0041] See also Figure 1 The method of the embodiment of the present invention specifically includes the following steps:

[0042] S110, displaying the label signal image on the display interface, and displaying the cell outline data on the label signal image;

[0043] Among them, the cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on the second channel used to record the label signal after two-photon imaging.

[0044] The display interface may be understood as a pre-set interface for displaying content.

[0045] The first channel can be understood as a channel for recording cell activity signals in two-photon imaging. Cell contour data can be understood as data that can characterize multiple cell contours based on the first channel after two-photon imaging of the imaging sample. On this basis, combined with the application scenarios that may be involved in the embodiments of the present invention, the first channel can be a green channel, and the average value image of the green channel or the characteristic value image obtained based on other feature analysis algorithms can be used to extract the contours of all cells expressing green fluorescent protein, so the cell contour data can be obtained based on the extraction results.

[0046] The second channel can be understood as a channel for recording label signals in two-photon imaging. The label signal image can be understood as an image characterizing the label signal obtained based on the second channel after two-photon imaging of the imaging sample. On this basis, in combination with the application scenarios that may be involved in the embodiments of the present invention, the second channel can be a red channel. Exemplarily, in Ai14*Gad2-cre transgenic mice, red fluorescent protein marks inhibitory neurons, so inhibitory neurons can be distinguished by the label signal under the red channel. Based on this example, optionally, since the average image of the red channel can be used to mark all cells expressing red fluorescent protein, the average image can be referred to as a label signal image here.

[0047] In practical applications, optionally, the above-mentioned imaging samples can be in vitro samples, and in particular can be living samples, such as living animals, etc. This is because the cell extraction scheme proposed in the embodiment of the present invention can not only achieve a higher accuracy rate on in vitro samples, but also can achieve a higher accuracy rate on living samples.

[0048] The label signal image is displayed on the display interface, and the cell contour data is displayed on the label signal image. In this way, relevant personnel can browse the label signal image and the cell contour data at the same time, and then determine the cell X marked by the label signal among the multiple cells represented by the cell contour data. Combined with the above example, the cell X expressing red fluorescent protein and green fluorescent protein at the same time in the multiple cells is determined.

[0049] S120, in response to a selection operation on the label signal image, for a selected contour among a plurality of cell contours, displaying the selected contour after contour color modification on the label signal image;

[0050] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0051] The selection operation can be understood as an operation triggered by a relevant person on the label signal image, which is used to represent that a certain cell contour (i.e., a selected contour) is selected from multiple cell contours. The selected cell represented by the selected contour may be cell X, or may be a cell that the relevant person previously believed to be cell X but is not cell X after further determination. This is related to the actual situation and is not specifically limited here. The operation can be, for example, a click operation (such as a single-click operation or a double-click operation), a press operation, or an input operation, etc. This can be set according to actual needs and is not specifically limited here.

[0052] In response to the selection operation, the outline color of the selected outline is modified, and the selected outline with the modified outline color is re-displayed on the label signal image. On this basis, in combination with the application scenarios that may be involved in the embodiments of the present invention, exemplarily, for the first color corresponding to the first channel and the second color corresponding to the second channel, when the outline color of the selected outline is changed from the first color to the second color, it means that the selected cell represented by the selected outline is extracted, that is, the selected cell is extracted because the relevant personnel believe that the selected cell is cell X; correspondingly, when the outline color is changed from the second color to the first color, it means that the selected cell is cancelled, that is, the selected cell is cancelled because the relevant personnel believe that the previous extraction is wrong. On this basis, optionally, when the first channel is a green channel, the first color can be green; when the second channel is a red channel, the second color can be red. Of course, there are other options for the first color and the second color, which are not specifically limited here.

[0053] The technical solution of the embodiment of the present invention is to display the label signal image on the display interface, and then display the cell contour data on the label signal image. The cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging, and the label signal image is obtained based on the second channel used to record the label signal after two-photon imaging. In this way, relevant personnel can browse the label signal image and the cell contour data on the display interface at the same time, and then determine the cell contour corresponding to the cell X (i.e., the cell marked by the label signal) among the multiple cell contours represented by the cell contour data, and trigger the selection operation on this basis; in response to the selection operation acting on the label signal image, for the selected contour among the multiple cell contours, the selected contour after the contour color is modified can be displayed on the label signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it means that the selected cell represented by the selected contour is cell X, and thus is extracted. The above technical solution realizes the accurate extraction of cell X in two-photon imaging data analysis through an interactive two-channel cell extraction process, especially the accurate extraction of cell X in living animals.

[0054] An optional technical solution is that before displaying the cell contour data on the label signal image, the cell extraction method further includes:

[0055] Identifying the labeled pixel points marked by the label signal in the label signal image, and matching the labeled pixel points with multiple cell contours to obtain matching contours;

[0056] The contour color of the matching contour is modified from the first color to the second color, and the cell contour data is updated based on the modification result.

[0057] Among them, the marked pixel point can be understood as the pixel point marked by the label signal among the pixels of the label signal image. The marked pixel point is automatically identified, and then the matching contour that matches the marked pixel point is determined from multiple cell contours. For example, the cell contour where the marked pixel point is located or the cell contour surrounding the marked pixel point can be used as the matching contour. It should be noted that the matching cell represented by the matching contour can be considered as the cell X that is automatically identified and extracted, so the contour color of the matching contour can be modified from the first color to the second color, and then the cell contour data is updated based on the modification result, and the cell contour data is displayed on the label information image. In this way, the cell contour data browsed by the relevant personnel is the data of the cell X that has been automatically extracted. Of course, this extraction result may be biased. At this time, the relevant personnel can make corrections based on the extraction result, thereby ensuring the accuracy of the extraction of cell X.

[0058] The above technical solution is a supervised semi-automatic cell extraction solution, which can significantly reduce the manual extraction cost and improve the extraction efficiency compared to a completely manual cell extraction solution.

[0059] Figure 2 It is a flowchart of another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the above-mentioned cell extraction method also includes: in response to a zoom operation on the label signal image, displaying the label signal image after zoom processing on the display interface, and displaying at least part of the data corresponding to the label signal image after zoom processing in the cell contour data on the label signal image after zoom processing; in response to a selection operation on the label signal image, for a selected contour in multiple cell contours, displaying the selected contour with modified contour color on the label signal image, including: in response to a selection operation on the label signal image after zoom processing, for a selected contour in at least part of the cell contour represented by at least part of the data, displaying the selected contour with modified contour color on the label signal image after zoom processing. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0060] See also Figure 2 The method of this embodiment may specifically include the following steps:

[0061] S210, displaying the label signal image on the display interface, and displaying the cell outline data on the label signal image;

[0062] Among them, the cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on the second channel used to record the label signal after two-photon imaging.

[0063] S220. In response to a zoom operation on the label signal image, the label signal image after zoom processing is displayed on the display interface, and for at least part of the data in the cell contour data corresponding to the label signal image after zoom processing, at least part of the data is displayed on the label signal image after zoom processing.

[0064] Among them, the zoom operation can be understood as an operation acting on the label signal image to zoom the label signal image, and the operation can be, for example, a click operation, a press operation, a slide operation, or an input operation, which can be set according to actual needs and is not specifically limited here. Exemplarily, the zoom operation includes a zoom-in operation and a zoom-out operation. Relevant personnel can trigger the zoom-in operation to zoom in on a local area in the label signal image to better identify cell X and extract it; of course, the label signal image can also be zoomed out by triggering the zoom-out operation to browse the extraction results of cell X as a whole; and so on.

[0065] In response to the zoom operation, the zoomed label signal image is displayed on the display interface. On this basis, the label signal image and the cell contour data need to be displayed in correspondence with each other according to the position, so that relevant personnel can identify the cell contour containing the label signal. Therefore, after displaying the zoomed label signal image, at least part of the data in the cell contour data corresponding to the zoomed label signal image needs to be displayed on the zoomed label signal image, so as to achieve the corresponding display of the two. In practical applications, optionally, the above-mentioned at least part of the data can also be understood as the zoomed cell contour data.

[0066] S230, in response to a selection operation on the scaled label signal image, for a selected contour in at least a portion of the cell contours represented by at least a portion of the data, displaying the selected contour after the contour color is modified on the scaled label signal image;

[0067] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0068] The at least part of the cell contours can be understood as the cell contours corresponding to at least part of the data among the multiple cell contours. In response to the selection operation, a selected contour is determined from the at least part of the cell contours, and the contour color of the selected contour is modified before display.

[0069] The technical solution of the embodiment of the present invention provides a zoom function, thereby allowing relevant personnel to better identify and extract cell X, and further ensuring the accuracy of cell X extraction.

[0070] Figure 3It is a flow chart of another method for cell extraction in two-photon imaging data analysis provided by an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the above-mentioned cell extraction method also includes: displaying a save control on the display interface; in response to a trigger operation acting on the save control, saving the modified cell contour data to realize the re-reading and display of the modified cell contour data. Among them, the explanations of the terms that are the same as or corresponding to the above-mentioned embodiments are not repeated here.

[0071] See also Figure 3 The method of this embodiment may specifically include the following steps:

[0072] S310. Display the save control and label signal image on the display interface, and display the cell contour data on the label signal image, wherein the cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on the second channel used to record the label signal after two-photon imaging.

[0073] The save control may be understood as a control for saving cell contour data, and the save control is displayed on the display interface, so that when the cell contour data needs to be saved, the save control is triggered to save the data.

[0074] S320, in response to a selection operation on the label signal image, for a selected contour among a plurality of cell contours, displaying the selected contour after contour color modification on the label signal image;

[0075] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0076] S330 , in response to a trigger operation on the save control, the modified cell outline data is saved to enable the modified cell outline data to be read and displayed again.

[0077] The trigger operation can be understood as an operation for triggering the save control, that is, enabling the save control. Since the outline color has been modified before, that is, the cell outline data has been modified, when the trigger operation is detected, the modified cell outline data can be saved by responding to the trigger operation. In this way, based on the saving result, the modified cell outline data can be read and displayed again, so that the relevant personnel can continue to extract cell X based on the modified cell outline data.

[0078] The technical solution of the embodiment of the present invention provides a saving function, so that relevant personnel can save the modified cell contour data, that is, save the extraction result of cell X. On this basis, relevant personnel can also read the existing extraction results, which has good operational convenience.

[0079] In order to better understand the above-mentioned technical solutions as a whole, the following is an exemplary description of the above-mentioned technical solutions in combination with specific examples. For example, an interactive software is designed to implement the above-mentioned technical solutions. The operation process of the interactive software is as follows:

[0080] (1) The cell contour data of the green channel and the label signal image of the red channel (i.e., the grayscale image, the label signal is represented by pixels with pixel values ​​close to 1) are loaded into the interactive software, so that the cell contour data and the label signal image can be displayed simultaneously on the display interface of the interactive software. The display result is as follows: Figure 4a As shown. Figure 4a As shown, the background of the label signal image is complex and the image intensity is uneven, that is, the pixel values ​​of each pixel representing the label signal are not uniform, and the automatic recognition of the label signal is difficult.

[0081] In addition, the interactive software can partially magnify the loaded images and data. Figure 4b As shown, relevant personnel can better identify and extract cell X marked by the label signal.

[0082] (2) If the relevant personnel find a green cell outline that overlaps with the label signal, they can double-click it with the mouse to select the cell outline. The outline color of the cell outline will change from green to red, and the results will be displayed as follows: Figure 5a As shown, its partial enlarged view is as follows Figure 5b shown.

[0083] If the relevant personnel double-click the cell outline that has turned red with the mouse again, the cell outline will be deselected and the outline color of the cell outline will change from red back to green.

[0084] (3) After the selection steps are completed, the relevant personnel can click the "SAVE" button (i.e. the save control described above) with the mouse. Figure 6 As shown, the selected result (i.e. the modified cell outline data) can be saved. In this way, after closing the interactive software, when you open it again, the last saved selected result can be automatically read, and the outline color of the last selected cell outline will also be displayed in red.

[0085] In the above example, interactive software is used to merge the label signal image of the red channel and the cell contour data of the green channel, so that relevant personnel can manually select green cells with label information based on actual judgment, achieving a high accuracy rate in cell extraction.

[0086] Figure 7 This is a structural block diagram of a cell extraction device in two-photon imaging data analysis provided in an embodiment of the present invention. The device is used to execute the cell extraction method in two-photon imaging data analysis provided in any of the above embodiments. The device and the cell extraction method in two-photon imaging data analysis in the above embodiments belong to the same inventive concept. For details not fully described in the embodiment of the cell extraction device in two-photon imaging data analysis, please refer to the embodiment of the cell extraction method in two-photon imaging data analysis. Figure 7 The device may specifically include: a first display module 410 and a second display module 420. Among them,

[0087] A first display module 410 is used to display a label signal image on a display interface, and to display cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel for recording activity signals after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on a second channel for recording label signals after two-photon imaging;

[0088] A second display module 420 is used for displaying the selected contour among the multiple cell contours on the label signal image after the contour color is modified in response to the selection operation on the label signal image;

[0089] Wherein, when the outline color is changed from a first color corresponding to a first channel to a second color corresponding to a second channel, the selected cell represented by the selected outline is extracted.

[0090] Optionally, when the outline color is changed from the second color to the first color, the selected cells are un-extracted.

[0091] Based on any of the above cell extraction devices, optionally, the first channel is a green channel, and the first color is green; the second channel is a red channel, and the second color is red.

[0092] Optionally, the above-mentioned cell extraction device further comprises:

[0093] A third display module is used for displaying the cell contour data on the label signal image, and in response to a zoom operation on the label signal image, displaying the label signal image after zoom processing on the display interface, and for at least part of the data in the cell contour data corresponding to the label signal image after zoom processing, displaying at least part of the data on the label signal image after zoom processing;

[0094] The second display module 420 is specifically used for:

[0095] In response to a selection operation on the zoomed label signal image, for the selected contour in at least a portion of the cell contour represented by at least a portion of the data, the selected contour with modified contour color is displayed on the zoomed label signal image.

[0096] Optionally, the above-mentioned cell extraction device further comprises:

[0097] The fourth display module is used to display the save control on the display interface;

[0098] The data saving module is used to save the modified cell outline data in response to a trigger operation acting on the saving control, so as to realize the re-reading and display of the modified cell outline data.

[0099] Optionally, the above-mentioned cell extraction device further comprises:

[0100] A matching contour obtaining module can be used to identify the labeled pixel points marked by the label signal in the label signal image before displaying the cell contour data on the label signal image, and match the labeled pixel points with multiple cell contours to obtain a matching contour;

[0101] The data updating module is used to change the outline color of the matching outline from the first color to the second color, and update the cell outline data based on the modification result.

[0102] Optionally, the imaging sample for two-photon imaging is a living animal.

[0103] The cell extraction device in the two-photon imaging data analysis provided by the embodiment of the present invention displays the label signal image on the display interface through the first display module, and then displays the cell contour data on the label signal image, the cell contour data is obtained based on the first channel used to record the activity signal after the two-photon imaging, and the label signal image is obtained based on the second channel used to record the label signal after the two-photon imaging. In this way, relevant personnel can browse the label signal image and the cell contour data on the display interface at the same time, and then determine the cell contour corresponding to the cell X (i.e., the cell marked by the label signal) among the multiple cell contours represented by the cell contour data, and trigger the selection operation on this basis; through the second display module, in response to the selection operation acting on the label signal image, for the selected contour among the multiple cell contours, the selected contour after the contour color is modified can be displayed on the label signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it is explained that the selected cell represented by the selected contour is cell X, and thus extracted. The above device realizes the accurate extraction of cell X in two-photon imaging data analysis through an interactive dual-channel cell extraction process, especially realizes the accurate extraction of cell X in living animals.

[0104] The cell extraction device in two-photon imaging data analysis provided in the embodiment of the present invention can execute the cell extraction method in two-photon imaging data analysis provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0105] It is worth noting that in the embodiment of the cell extraction device in the above-mentioned two-photon imaging data analysis, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0106] Figure 8 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0107] like Figure 8As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0108] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0109] The processor 11 may be a variety of general and / or dedicated processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 may execute the various methods and processes described above, such as a cell extraction method in two-photon imaging data analysis.

[0110] In some embodiments, the cell extraction method in two-photon imaging data analysis may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the cell extraction method in two-photon imaging data analysis described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the cell extraction method in two-photon imaging data analysis by any other appropriate means (e.g., by means of firmware).

[0111] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0112] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0113] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0114] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0115] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0116] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0117] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0118] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A cell extraction method in two-photon imaging data analysis, characterized in that: include: Displaying a label signal image on a display interface, and displaying cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging, the cell contour data represents a plurality of cell contours, and the label signal image is obtained based on a second channel used to record label signals after two-photon imaging; In response to a selection operation performed on the label signal image, for a selected contour among the plurality of cell contours, displaying the selected contour with modified contour color on the label signal image; Wherein, when the outline color is changed from a first color corresponding to the first channel to a second color corresponding to the second channel, the selected cell represented by the selected outline is extracted.

2. The method according to claim 1, characterized in that When the outline color is changed from the second color to the first color, the selected cell is un-extracted.

3. The method according to claim 1 or 2, characterized in that: The first channel is a green channel, and the first color is green; the second channel is a red channel, and the second color is red.

4. The method according to claim 1, characterized in that: After displaying the cell outline data on the label signal image, the method further includes: In response to a zooming operation on the label signal image, displaying the label signal image after zooming on the display interface, and displaying at least a portion of the data in the cell outline data corresponding to the label signal image after zooming on the label signal image after zooming; In response to the selection operation on the label signal image, for a selected contour among the plurality of cell contours, displaying the selected contour with modified contour color on the label signal image comprises: In response to a selection operation performed on the zoomed label signal image, for a selected contour in at least a portion of the cell contours represented by the at least portion of the data, the selected contour with a modified contour color is displayed on the zoomed label signal image.

5. The method according to claim 1, characterized in that Also includes: Displaying a save control on the display interface; In response to a trigger operation acting on the save control, the modified cell outline data is saved to enable the modified cell outline data to be read and displayed again.

6. The method according to claim 1, characterized in that Before displaying the cell outline data on the label signal image, the method further includes: Identifying the labeled pixel points in the label signal image that are labeled by the label signal, and matching the labeled pixel points with the multiple cell contours to obtain matching contours; The contour color of the matching contour is modified from the first color to the second color, and the cell contour data is updated based on the modification result.

7. The method according to claim 1, characterized in that The imaging sample for the two-photon imaging is a living animal.

8. A cell extraction device in two-photon imaging data analysis, characterized in that: include: A first display module is used to display a label signal image on a display interface, and to display cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging, the cell contour data represents a plurality of cell contours, and the label signal image is obtained based on a second channel used to record label signals after two-photon imaging; A second display module is used for displaying the selected contour among the plurality of cell contours on the label signal image after the contour color is modified in response to a selection operation on the label signal image; Wherein, when the outline color is changed from a first color corresponding to the first channel to a second color corresponding to the second channel, the selected cell represented by the selected outline is extracted.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the cell extraction method in the two-photon imaging data analysis according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the cell extraction method in two-photon imaging data analysis as described in any one of claims 1-7 when executed.

11. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, implements the cell extraction method in two-photon imaging data analysis according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Method and device for identifying target contour in image, equipment and storage medium

    CN114092709A

  • Bone marrow cell labeling methods and systems

    US20200242759A1

  • Process for providing accurate counting of nuclei in cellular images

    US20240177447A1