Cell extraction method, device, equipment, medium and program product in two-photon imaging data analysis

Abstract

Embodiments of the present application disclose a cell extraction method, device, equipment, medium and program product in two-photon imaging data analysis. The method can comprise: displaying a label signal image on a display interface, and displaying cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel for recording activity signals, the cell contour data represents a plurality of cell contours, and the label signal image is obtained based on a second channel for recording label signals; in response to a selection operation acting on the label signal image, for a selected contour in the plurality of cell contours, the selected contour after modification of contour color is displayed on the label signal image; and in a case where the contour color is modified from a first color corresponding to the first channel to a second color corresponding to the second channel, a selected cell represented by the selected contour is extracted. The technical scheme of the embodiments of the present application can realize accurate extraction of cells marked by label signals.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of biological technology, and in particular to a method, apparatus, device, medium and program product for cell extraction in two-photon imaging data analysis. Background Technology

[0002] Two-photon imaging is an imaging technique particularly well-suited for recording live animals.

[0003] Currently, two-photon imaging instruments are generally equipped with two color channels: red and green. The green channel is typically used to record cellular activity signals, which can be used to obtain the cell outlines of all cells; while the red channel is typically used to record tag signals, thereby distinguishing specific cell types.

[0004] Therefore, identifying cells tagged with specific signals has become an essential part of subsequent data analysis. However, accurate extraction of these cells is currently impossible and requires further investigation. Summary of the Invention

[0005] This invention provides a method, apparatus, device, medium, and program product for cell extraction in two-photon imaging data analysis, so as to achieve accurate extraction of cells labeled by tag signals.

[0006] According to one aspect of the present invention, a cell extraction method for two-photon imaging data analysis is provided, which may include:

[0007] The label signal image is displayed on the display interface, and cell contour data is displayed on the label signal image. The cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging. The cell contour data represents multiple cell contours. The label signal image is obtained based on the second channel used to record the label signal after two-photon imaging.

[0008] In response to a selection operation applied to the label signal image, the selected contour with modified contour color can be displayed on the label signal image for the selected contour among multiple cell contours.

[0009] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0010] According to another aspect of the present invention, a cell extraction device for two-photon imaging data analysis is provided, which may include:

[0011] The first display module is used to display the label signal image on the display interface and display cell contour data on the label signal image. The cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging. The cell contour data represents multiple cell contours. The label signal image is obtained based on the second channel used to record the label signal after two-photon imaging.

[0012] The second display module is used to respond to the selection operation applied to the label signal image and display the selected contour with modified contour color on the label signal image for the selected contour among multiple cell contours.

[0013] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0014] According to another aspect of the present invention, an electronic device is provided, which may include:

[0015] At least one processor; and

[0016] A memory that is communicatively connected to at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by at least one processor, such that when the at least one processor executes the program, it implements the cell extraction method in two-photon imaging data analysis provided in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided having computer instructions stored thereon for causing a processor to execute and implement the cell extraction method in two-photon imaging data analysis provided in any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer program product is provided, on which a computer program is stored, which, when executed by a processor, implements the cell extraction method in two-photon imaging data analysis provided in any embodiment of the present invention.

[0020] The technical solution of this invention displays a tag signal image on a display interface, and then displays cell contour data on the tag signal image. This cell contour data is obtained based on the first channel used to record activity signals after two-photon imaging, and the tag signal image is obtained based on the second channel used to record tag signals after two-photon imaging. In this way, relevant personnel can simultaneously browse the tag signal image and cell contour data on the display interface, thereby determining the cell contour of cell X (i.e., the cell marked by the tag signal) among multiple cell contours represented by the cell contour data, and triggering a selection operation based on this. In response to the selection operation on the tag signal image, for the selected contour among the multiple cell contours, the selected contour with modified contour color can be displayed on the tag signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it indicates that the selected cell represented by the selected contour is cell X, and thus it is extracted. The above technical solution, through an interactive dual-channel cell extraction process, achieves accurate extraction of cell X in two-photon imaging data analysis, especially accurate extraction of cell X from live animals in two-photon imaging data analysis.

[0021] It should be understood that the description in this section is not intended to identify key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a flowchart of a cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0024] Figure 2 This is a flowchart of another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0025] Figure 3 This is a flowchart of another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0026] Figure 4a This is a display result of cell contour data and tag signal image in another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention;

[0027] Figure 4b This is a magnified view of the cell contour data and tag signal image in another cell extraction method for two-photon imaging data analysis provided by an embodiment of the present invention;

[0028] Figure 5a This is a schematic diagram showing the result of the outline color changing from green to red in another cell extraction method for two-photon imaging data analysis according to an embodiment of the present invention.

[0029] Figure 5b This is another cell extraction method in two-photon imaging data analysis provided by the embodiments of the present invention, which is related to... Figure 5a Corresponding enlarged view;

[0030] Figure 6 This is a schematic diagram of the storage control in another cell extraction method for two-photon imaging data analysis according to an embodiment of the present invention;

[0031] Figure 7 This is a structural block diagram of a cell extraction device for two-photon imaging data analysis provided in an embodiment of the present invention;

[0032] Figure 8 This is a schematic diagram of the structure of an electronic device that implements the cell extraction method in two-photon imaging data analysis according to an embodiment of the present invention. Detailed Implementation

[0033] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0034] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. The same applies to "target," "original," etc., and will not be repeated here. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0035] Before introducing the embodiments of the present invention, the specific reasons why it is currently impossible to accurately extract cells tagged by the tag signal (hereinafter referred to as cell X) will be explained by way of example, so as to better understand why the following embodiments can accurately extract cell X.

[0036] For example, current methods primarily utilize machine vision to identify label signals in labeled image data, then match the identified label signals with multiple cell contours represented by cell contour data, and finally use the cell represented by the matched contour as cell X to complete extraction. However, while the above extraction scheme achieves good accuracy on ex vivo samples, its accuracy on live samples (e.g., live animals) is low. Analysis suggests this is due to at least two reasons:

[0037] One reason is the difference in imaging characteristics between ex vivo and live samples. Specifically: 1) Ex vivo samples are brain slices, so their background noise can be compressed and controlled. However, live samples are in vivo images, and background noise from many brain tissues cannot be compressed and controlled. This results in higher background noise in the label signal image of live samples compared to ex vivo samples, which directly affects the accuracy of label signal recognition. 2) In ex vivo sample imaging, cross-contamination between the two color channels is rare or suppressed by a strong effective signal. However, live samples need to avoid phototoxicity, thus protecting the live sample, resulting in a weaker effective signal. This leads to more frequent cross-contamination between the two color channels in live sample imaging, resulting in a lower signal-to-noise ratio in the label signal image of live samples compared to ex vivo samples, and consequently, lower label signal recognition accuracy. 3) The intensity of the tag signal of multiple cells X varies. This difference is related to the uneven expression of the tag signal protein and has little correlation with the intensity of the irradiated light. For example, when the intensity is characterized by pixel value, the pixel value of each pixel representing the tag signal is different, which further complicates the accurate identification of the tag signal.

[0038] Another reason is that the identified tag signals often produce errors when performing cell contour matching, which further reduces the accuracy of cell X extraction.

[0039] In summary, due to the unique characteristics of two-photon imaging of live samples, current cell extraction methods cannot accurately extract cell X during data analysis. To address this issue, the following embodiments propose an interactive cell extraction method. This technical solution will be described in detail below.

[0040] Figure 1 This is a flowchart illustrating a cell extraction method for two-photon imaging data analysis provided in this embodiment of the invention. This embodiment is applicable to extracting cells (i.e., cell X) labeled by a tag signal in two-photon imaging data analysis, and is particularly suitable for extracting cell X in two-photon imaging data analysis of live samples. This method can be executed by the cell extraction device for two-photon imaging data analysis provided in this embodiment of the invention. This device can be implemented in software and / or hardware, and can be integrated into an electronic device, which can be various user terminals or servers.

[0041] See Figure 1 The method of this invention specifically includes the following steps:

[0042] S110. Display the label signal image on the display interface, and display cell contour data on the label signal image;

[0043] The cell contour data is obtained based on the first channel used to record activity signals after two-photon imaging, and the cell contour data represents multiple cell contours. The tag signal image is obtained based on the second channel used to record tag signals after two-photon imaging.

[0044] The display interface can be understood as a pre-set interface used for displaying content.

[0045] The first channel can be understood as the channel used to record cellular activity signals in two-photon imaging. Cell contour data can be understood as data representing multiple cell contours obtained based on the first channel after two-photon imaging of the imaging sample. Based on this, and considering the application scenarios that may be involved in the embodiments of this invention, the first channel can be the green channel, and the average image of the green channel or the feature value image obtained based on other feature analysis algorithms can be used to extract the contours of all cells expressing green fluorescent protein. Therefore, cell contour data can be obtained based on the extraction results.

[0046] The second channel can be understood as the channel used to record the tag signal in two-photon imaging. The tag signal image can be understood as the image representing the tag signal obtained based on the second channel after two-photon imaging of the sample. Based on this, and considering the application scenarios that may be involved in the embodiments of this invention, the second channel can be the red channel. For example, in Ai14*Gad2-cre transgenic mice, red fluorescent protein labels inhibitory neurons; therefore, inhibitory neurons can be distinguished by the tag signal under the red channel. Based on this example, optionally, since the average image of the red channel can be used to label all cells expressing red fluorescent protein, this average image can be referred to here as the tag signal image.

[0047] In practical applications, the imaging sample can optionally be an ex vivo sample, especially a live sample, such as a live animal. This is because the cell extraction scheme proposed in this embodiment of the invention can achieve high accuracy not only on ex vivo samples, but also on live samples.

[0048] The label signal image is displayed on the display interface, and cell contour data is displayed on the label signal image. In this way, relevant personnel can simultaneously browse the label signal image and cell contour data, and then identify the cell X marked by the label signal among multiple cells represented by the cell contour data. Combining the above example, the cell X that simultaneously expresses red fluorescent protein and green fluorescent protein among multiple cells can be identified.

[0049] S120, In response to a selection operation applied to the label signal image, for the selected contour among multiple cell contours, display the selected contour with modified contour color on the label signal image;

[0050] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0051] The selection operation can be understood as an operation triggered by relevant personnel on the label signal image, which represents the selection of a certain cell contour (i.e., the selected contour) from multiple cell contours. The selected cell represented by the selected contour may be cell X, or it may be a cell that the relevant personnel previously thought was cell X, but after further judgment, it is not cell X. This is related to the actual situation and is not specifically limited here. This operation can be, for example, a click operation (such as a single click or double click operation), a press operation, or an input operation, which can be set according to actual needs and is not specifically limited here.

[0052] In response to a selection operation, the outline color of the selected contour is modified, and the selected contour with the modified outline color is re-displayed on the label signal image. Based on this, and considering possible application scenarios in this embodiment of the invention, for example, regarding the first color corresponding to the first channel and the second color corresponding to the second channel, if the outline color of the selected contour is changed from the first color to the second color, it indicates that the selected cell represented by the selected contour has been extracted, i.e., the selected cell was extracted because the relevant personnel believed that the selected cell was cell X; correspondingly, if the outline color is changed from the second color to the first color, it indicates that the selected cell has been de-extracted, i.e., the extraction of the selected cell was de-extracted because the relevant personnel believed that the previous extraction was incorrect. Optionally, if the first channel is a green channel, the first color can be green; if the second channel is a red channel, the second color can be red. Of course, other choices for the first and second colors are also possible, and no specific limitations are made here.

[0053] The technical solution of this invention displays a tag signal image on a display interface, and then displays cell contour data on the tag signal image. This cell contour data is obtained based on the first channel used to record activity signals after two-photon imaging, and the tag signal image is obtained based on the second channel used to record tag signals after two-photon imaging. In this way, relevant personnel can simultaneously browse the tag signal image and cell contour data on the display interface, thereby determining the cell contour of cell X (i.e., the cell marked by the tag signal) among multiple cell contours represented by the cell contour data, and triggering a selection operation based on this. In response to the selection operation on the tag signal image, for the selected contour among the multiple cell contours, the selected contour with modified contour color can be displayed on the tag signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it indicates that the selected cell represented by the selected contour is cell X, and thus it has been extracted. The above technical solution, through an interactive dual-channel cell extraction process, achieves accurate extraction of cell X in two-photon imaging data analysis, especially accurate extraction of cell X from live animals.

[0054] An alternative technical solution, wherein before displaying cell contour data on the labeled signal image, the above cell extraction method further includes:

[0055] Identify the labeled pixels in the labeled signal image and match the labeled pixels with multiple cell contours to obtain the matching contours;

[0056] Change the outline color of the matched outline from the first color to the second color, and update the cell outline data based on the modification.

[0057] In this context, a marked pixel can be understood as a pixel in the label signal image that is marked by a label signal. The marked pixels are automatically identified, and then a matching contour matching the marked pixel is determined from multiple cell contours. For example, the cell contour containing the marked pixel or the cell contour surrounding the marked pixel can be used as the matching contour. It should be noted that the matching cell represented by the matching contour can be considered as the automatically identified and extracted cell X. Therefore, the contour color of the matching contour can be changed from a first color to a second color, and the cell contour data is updated based on the modification result and displayed on the label information image. In this way, the cell contour data viewed by relevant personnel is the data of automatically extracted cell X. Of course, this extraction result may have deviations, which can be corrected by relevant personnel based on the extraction result, thereby ensuring the accuracy of cell X extraction.

[0058] The above-mentioned technical solution is a semi-automatic cell extraction method under human supervision. Compared with a completely manual cell extraction method, it can significantly reduce the cost of manual extraction and improve the extraction efficiency.

[0059] Figure 2 This is a flowchart of another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention. This embodiment is based on and optimized from the above-described technical solutions. Optionally, in this embodiment, the cell extraction method further includes: in response to a scaling operation applied to the label signal image, displaying the scaled label signal image on a display interface, and displaying at least a portion of the data in the cell contour data corresponding to the scaled label signal image on the scaled label signal image; in response to a selection operation applied to the label signal image, displaying the selected contour with modified contour color on the label signal image for the selected contour among multiple cell contours, including: in response to a selection operation applied to the scaled label signal image, displaying the selected contour with modified contour color on the scaled label signal image for the selected contour among the selected contours represented by at least a portion of the data. The explanations of terms that are the same as or corresponding to those in the above embodiments are not repeated here.

[0060] See Figure 2 The method in this embodiment may specifically include the following steps:

[0061] S210. Display the label signal image on the display interface, and display cell contour data on the label signal image;

[0062] The cell contour data is obtained based on the first channel used to record activity signals after two-photon imaging, and the cell contour data represents multiple cell contours. The tag signal image is obtained based on the second channel used to record tag signals after two-photon imaging.

[0063] S220, in response to a scaling operation applied to the label signal image, displaying the scaled label signal image on a display interface, and displaying at least a portion of the data in the cell contour data corresponding to the scaled label signal image on the scaled label signal image.

[0064] The scaling operation can be understood as an operation applied to the label signal image to scale it. This operation can be, for example, a click, press, slide, or input operation, which can be set according to actual needs and is not specifically limited here. For example, the scaling operation includes zooming in and zooming out. Relevant personnel can trigger the zoom-in operation to enlarge a local area in the label signal image, thereby better identifying and extracting cell X; of course, they can also trigger the zoom-out operation to reduce the size of the label signal image to view the extraction results of cell X as a whole; and so on.

[0065] In response to the zoom operation, the scaled label signal image is displayed on the interface. Based on this, the label signal image and cell contour data need to be displayed in a corresponding position so that relevant personnel can identify the cell contour containing the label signal. Therefore, after displaying the scaled label signal image, at least a portion of the cell contour data corresponding to the scaled label signal image must also be displayed on top of the scaled label signal image to achieve a corresponding display. In practical applications, optionally, the aforementioned at least a portion of data can also be understood as the scaled cell contour data.

[0066] S230, in response to a selection operation applied to the scaled label signal image, for the selected contour in the selected contour of at least a portion of the cell contours characterized by at least a portion of the data, display the selected contour with modified contour color on the scaled label signal image.

[0067] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0068] Here, at least a portion of the cell contours can be understood as cell contours corresponding to at least a portion of the data among multiple cell contours. In response to a selection operation, a selected contour is determined from the at least a portion of the cell contours, and the contour color of the selected contour is modified before it is displayed.

[0069] The technical solution of this invention provides a scaling function, thereby allowing relevant personnel to better identify and extract cell X, further ensuring the accuracy of cell X extraction.

[0070] Figure 3This is a flowchart of another cell extraction method in two-photon imaging data analysis provided by an embodiment of the present invention. This embodiment is based on and optimized from the above-mentioned technical solutions. In this embodiment, optionally, the above-mentioned cell extraction method further includes: displaying a save control on the display interface; and saving the modified cell contour data in response to a trigger operation acting on the save control, so as to realize the re-reading and display of the modified cell contour data. The explanations of terms that are the same as or corresponding to those in the above embodiments will not be repeated here.

[0071] See Figure 3 The method in this embodiment may specifically include the following steps:

[0072] S310. Display the save control and the tag signal image on the display interface, and display cell contour data on the tag signal image. The cell contour data is obtained based on the first channel used to record the activity signal after two-photon imaging. The cell contour data represents multiple cell contours. The tag signal image is obtained based on the second channel used to record the tag signal after two-photon imaging.

[0073] The save control can be understood as a control used to save cell outline data. The save control is displayed on the display interface so that when cell outline data needs to be saved, the save control can be triggered to save it.

[0074] S320, In response to a selection operation applied to the label signal image, for the selected contour among multiple cell contours, display the selected contour with modified contour color on the label signal image;

[0075] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0076] S330: In response to a trigger operation on the save control, the modified cell outline data is saved so that the modified cell outline data can be read and displayed again.

[0077] The trigger operation can be understood as the operation that enables the save control. Since the outline color has been modified previously, meaning the cell outline data has been modified, the modified cell outline data can be saved in response to the trigger operation. This allows the modified cell outline data to be read and displayed again based on the saved result, enabling relevant personnel to extract cell X from the modified cell outline data.

[0078] The technical solution of this invention provides a saving function, which allows relevant personnel to save the modified cell contour data, that is, to save the extraction result of cell X. On this basis, it also allows relevant personnel to read the existing extraction results, which has good operational convenience.

[0079] To better understand the various technical solutions described above, specific examples are provided below for illustrative purposes. For instance, an interactive software program was designed to implement the above technical solutions, and the operation flow of this interactive software is as follows:

[0080] (1) The cell contour data of the green channel and the label signal image of the red channel (i.e., grayscale image, where the label signal is represented by pixels with a pixel value close to 1) are loaded into the interactive software, so that the cell contour data and the label signal image can be displayed simultaneously on the display interface of the interactive software. The display result is as follows: Figure 4a As shown. According to Figure 4a As shown, the background of the label signal image is complex and the image intensity is uneven, meaning that the pixel values ​​of each pixel in the label signal are not uniform, making automatic recognition of the label signal quite difficult.

[0081] In addition, this interactive software can zoom in on loaded images and data in specific areas, as shown in the zoom-in results. Figure 4b As shown, this is to enable relevant personnel to better identify and extract cells X that are tagged with the label signal.

[0082] (2) If relevant personnel find a green cell outline that coincides with the label signal, they can double-click it with the mouse to select the cell outline. The outline color of the cell will change from green to red, and the result will be displayed as follows. Figure 5a As shown, its enlarged partial view is as follows: Figure 5b As shown.

[0083] If a user double-clicks on a cell outline that has turned red, the cell outline will be deselected, and its color will change back to green.

[0084] (3) After the selected steps are completed, relevant personnel can click the "SAVE" button (i.e., the save control described above), such as... Figure 6 As shown, you can save the selected results (i.e., the modified cell outline data). In this way, after closing the interactive software and reopening it, the previously saved selection results will be automatically read, and the outline color of the previously selected cells will be displayed in red.

[0085] The above example, by using interactive software, merges the label signal image of the red channel and the cell contour data of the green channel, allowing relevant personnel to manually select green cells with label information based on actual judgment, thus achieving a high accuracy rate in cell extraction.

[0086] Figure 7 This is a structural block diagram of a cell extraction device for two-photon imaging data analysis provided in an embodiment of the present invention. This device is used to perform the cell extraction method for two-photon imaging data analysis provided in any of the above embodiments. This device and the cell extraction methods for two-photon imaging data analysis in the above embodiments belong to the same inventive concept. Details not described in detail in the embodiments of the cell extraction device for two-photon imaging data analysis can be found in the embodiments of the cell extraction methods for two-photon imaging data analysis described above. See also... Figure 7 The device may specifically include a first display module 410 and a second display module 420.

[0087] The first display module 410 is used to display a label signal image on a display interface and display cell contour data on the label signal image. The cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging. The cell contour data represents multiple cell contours. The label signal image is obtained based on a second channel used to record label signals after two-photon imaging.

[0088] The second display module 420 is used to respond to a selection operation applied to the label signal image and display the selected contour with modified contour color on the label signal image for the selected contour among multiple cell contours.

[0089] Specifically, when the outline color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, the selected cells represented by the selected outline are extracted.

[0090] Optionally, if the outline color is changed from the second color to the first color, the selected cells are deselected.

[0091] Based on any of the above cell extraction devices, optionally, the first channel is a green channel with green as the first color; the second channel is a red channel with red as the second color.

[0092] Optionally, the above-mentioned cell extraction device further includes:

[0093] The third display module is used to display the scaled label signal image on the display interface after displaying cell contour data on the label signal image, in response to the scaling operation applied to the label signal image, and to display at least a portion of the data in the cell contour data that corresponds to the scaled label signal image on the scaled label signal image.

[0094] The second display module 420 is specifically used for:

[0095] In response to a selection operation applied to a scaled label signal image, for a selected contour in at least a portion of the cell contours characterized by at least a portion of the data, the selected contour with modified contour color is displayed on the scaled label signal image.

[0096] Optionally, the above-mentioned cell extraction device further includes:

[0097] The fourth display module is used to display the save control on the display interface;

[0098] The data saving module is used to save the modified cell outline data in response to the trigger operation on the save control, so as to enable the re-reading and display of the modified cell outline data.

[0099] Optionally, the above-mentioned cell extraction device further includes:

[0100] The matching contour module can be used to identify the marker pixels marked by the label signal in the label signal image before displaying cell contour data on the label signal image, and match the marker pixels with multiple cell contours to obtain the matching contour;

[0101] The data update module is used to change the outline color of the matched outline from the first color to the second color, and update the cell outline data based on the modification result.

[0102] Optionally, the imaging sample for two-photon imaging can be a live animal.

[0103] The cell extraction device in two-photon imaging data analysis provided in this embodiment of the invention displays a tag signal image on a display interface through a first display module, and then displays cell contour data on the tag signal image. The cell contour data is obtained based on the first channel used to record activity signals after two-photon imaging, and the tag signal image is obtained based on the second channel used to record tag signals after two-photon imaging. In this way, relevant personnel can simultaneously browse the tag signal image and cell contour data on the display interface, thereby determining the cell contour of cell X (i.e., the cell marked by the tag signal) among multiple cell contours represented by the cell contour data, and triggering a selection operation based on this. Through the second display module, in response to the selection operation acting on the tag signal image, for the selected contour among multiple cell contours, the selected contour with modified contour color can be displayed on the tag signal image. It can be understood that when the contour color is changed from the first color corresponding to the first channel to the second color corresponding to the second channel, it indicates that the selected cell represented by the selected contour is cell X, and thus it is extracted. The aforementioned device, through an interactive dual-channel cell extraction process, achieves accurate extraction of cell X in two-photon imaging data analysis, especially accurate extraction of cell X from live animals.

[0104] The cell extraction device for two-photon imaging data analysis provided in this embodiment of the invention can execute the cell extraction method for two-photon imaging data analysis provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects for executing the method.

[0105] It is worth noting that in the embodiments of the cell extraction device in the above two-photon imaging data analysis, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy distinction between each other and are not used to limit the scope of protection of the present invention.

[0106] Figure 8 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0107] like Figure 8As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded into the RAM 13 from storage unit 18. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0108] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0109] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 can perform the various methods and processes described above, such as cell extraction methods in two-photon imaging data analysis.

[0110] In some embodiments, the cell extraction method in two-photon imaging data analysis can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or mounted on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the cell extraction method in two-photon imaging data analysis described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the cell extraction method in two-photon imaging data analysis by any other suitable means (e.g., by means of firmware).

[0111] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0112] Computer programs used to implement the methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs can be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0113] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0114] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0115] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0116] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0117] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0118] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A cell extraction method in two-photon imaging data analysis, characterized in that, include: A label signal image is displayed on the display interface, and cell contour data is displayed on the label signal image. The cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging. The cell contour data represents multiple cell contours. The label signal image is obtained based on a second channel used to record label signals after two-photon imaging. In response to a selection operation applied to the label signal image, for the selected contour among the plurality of cell contours, the selected contour with modified contour color is displayed on the label signal image; Specifically, when the outline color is changed from a first color corresponding to the first channel to a second color corresponding to the second channel, the selected cell represented by the selected outline is extracted.

2. The method according to claim 1, characterized in that, If the outline color is changed from the second color to the first color, the selected cells that have already been extracted are de-extracted.

3. The method according to claim 1 or 2, characterized in that, The first channel is a green channel, and the first color is green; the second channel is a red channel, and the second color is red.

4. The method according to claim 1, characterized in that, Following the display of cell contour data on the labeled signal image, the method further includes: In response to a scaling operation applied to the label signal image, the scaled label signal image is displayed on the display interface, and at least a portion of the cell contour data corresponding to the scaled label signal image is displayed on the scaled label signal image. In response to a selection operation applied to the label signal image, displaying the selected contour with modified contour color on the label signal image for the selected contour among the plurality of cell contours includes: In response to a selection operation applied to the scaled label signal image, the selected contour with modified contour color is displayed on the scaled label signal image for the selected contour in the selected contour of at least a portion of the cell contours represented by the at least a portion of the data.

5. The method according to claim 1, characterized in that, Also includes: A save control is displayed on the display interface; In response to a trigger operation on the save control, the modified cell contour data is saved so that the modified cell contour data can be read and displayed again.

6. The method according to claim 1, characterized in that, Prior to displaying cell contour data on the labeled signal image, the method further includes: Identify the marked pixels in the labeled signal image that are marked by the label signal, and match the marked pixels with the multiple cell contours to obtain the matching contours; The outline color of the matched outline is changed from the first color to the second color, and the cell outline data is updated based on the modification result.

7. The method according to claim 1, characterized in that, The imaging sample used for the two-photon imaging is a live animal.

8. A cell extraction device for two-photon imaging data analysis, characterized in that, include: The first display module is used to display a label signal image on a display interface and display cell contour data on the label signal image, wherein the cell contour data is obtained based on a first channel used to record activity signals after two-photon imaging, the cell contour data represents multiple cell contours, and the label signal image is obtained based on a second channel used to record label signals after two-photon imaging. The second display module is used to respond to a selection operation applied to the label signal image and display the selected contour with modified contour color on the label signal image for the selected contour among the plurality of cell contours. Specifically, when the outline color is changed from a first color corresponding to the first channel to a second color corresponding to the second channel, the selected cell represented by the selected outline is extracted.

9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to cause the at least one processor to perform the cell extraction method in two-photon imaging data analysis as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute and implement the cell extraction method in two-photon imaging data analysis as described in any one of claims 1-7.

11. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the cell extraction method in two-photon imaging data analysis as described in any one of claims 1-7.

Images