Method, apparatus, and system for data acquisition
By combining optical imaging information to slice biological tissue samples and perform spatiotemporal sequencing, image segmentation and registration are performed to generate three-dimensional display data. This solves the accuracy and visualization problems of spatiotemporal omics three-dimensional reconstruction in existing technologies, and realizes the effective processing and display of large-size, high-resolution spatiotemporal data.
Patent Information
- Application Number
- PCT/CN2023/096110
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-24
- Publication Date
- 2024-11-28
AI Technical Summary
Existing spatiotemporal omics 3D reconstruction methods cannot accurately restore the 3D spatial morphology and structure of tissues. The accuracy of data reconstruction back to the original situ expression level is low, making it difficult to process large amounts of tissue samples, and the 2D planar visualization effect is limited.
By combining optical imaging information, expression level data and image data are obtained by slicing and spatiotemporal sequencing of biological tissue samples. Image segmentation and registration are then performed to generate the outer contour and partition contour of the biological tissue, and the data are displayed using 3D rendering tools.
It enables effective processing and display of large-size, high-resolution spatiotemporal group data, accurately restores the three-dimensional location information of tissues, and improves the accuracy of data reconstruction and visualization effects.
Smart Images

Figure CN2023096110_28112024_PF_FP_ABST
Abstract
Description
Data collection method, device and system Technical Field
[0001] The present disclosure relates to the field of data processing technology, and in particular to a data acquisition method, device and system. Background Art
[0002] Since its development, spatiotemporal omics technology has been initially applied in fields such as neuroscience, pathology, and developmental biology. Spatiotemporal omics analysis on a two-dimensional plane makes it difficult to obtain morphological structures and accurate positional information in three-dimensional space. How to break through the research of two-dimensional planes and realize three-dimensional spatiotemporal omics research is of great technical challenge and important scientific significance. At present, the main research is on the three-dimensional reconstruction method of spatiotemporal omics to achieve a comprehensive analysis of the spatial distribution, interactions, gene protein expression and overall morphological structure of different cells at the three-dimensional level of tissue. The current three-dimensional reconstruction of spatiotemporal omics is based only on the expression abundance information captured by the spatiotemporal group, and the expression data measured on the plane are rigidly aligned. There are problems such as low accuracy of data reconstruction back to the original expression level, limited visualization effect, and insufficient data processing and post-display capabilities for large amounts of tissue samples.
[0003] Summary of the Invention
[0004] The present disclosure proposes a data acquisition method, device and system, which targets in situ captured spatiotemporal omics technology, combines optical imaging information to obtain internal and external tissue contours to assist in visual information positioning, achieves cell-precision position alignment at each information acquisition site, and can effectively process and display large-scale, high-resolution spatiotemporal omics data.
[0005] A first aspect embodiment of the present disclosure provides a data acquisition method, comprising: slicing a biological tissue sample and performing spatiotemporal group sequencing on the slices to obtain expression data; performing image acquisition on the sliced biological tissue sample to obtain image data; aligning the expression data and / or image data to generate an outer contour and / or partition contour of the biological tissue sample; and generating three-dimensional display data of the biological tissue sample based on the outer contour and / or partition contour.
[0006] In some embodiments of the present disclosure, slicing a biological tissue sample and performing spatiotemporal group sequencing on the slices to obtain expression data includes: continuously slicing the biological tissue sample, performing spatiotemporal group sequencing once for each first predetermined number of slices to obtain expression data of the slices, wherein the first predetermined number is a positive integer.
[0007] In some embodiments of the present disclosure, the method further includes: preprocessing the expression data, wherein the preprocessing includes at least one of aggregation processing, quality control, logarithmic normalization, finding highly variable genes, and dimensionality reduction processing.
[0008] In some embodiments of the present disclosure, performing image capture on the sliced biological tissue sample to obtain image data includes: performing image capture on the sliced biological tissue sample once every second predetermined number of slices to obtain image data, wherein the second predetermined number is a positive integer.
[0009] In some embodiments of the present disclosure, registering expression data and / or image data to generate an outer contour and / or partition contour of a biological tissue sample includes: performing image segmentation processing on the image data to generate a segmentation result map; registering the segmentation result map to generate a registration result map; and generating the outer contour of the biological tissue sample based on the registration result map.
[0010] In some embodiments of the present disclosure, image segmentation processing of image data includes: converting the image data into HSV color space, extracting the image data of the H channel and converting it into a grayscale image; binarizing the image data through a preset image processing algorithm to determine a contour map of the binarization result; retaining the contour map that meets the preset conditions and merging it with the image data.
[0011] In some embodiments of the present disclosure, the method further includes: acquiring a grayscale image and a histogram of the image data; performing maximum entropy threshold binarization processing on the image data; and merging the processed image with the image data.
[0012] In some embodiments of the present disclosure, registering the segmentation result image to generate a registration result image includes: performing spatial transformation processing and linear interpolation algorithm processing on the segmentation result image; performing mean square error similarity measurement on the processed segmentation result image and the registration reference image; and determining the optimal measurement solution as the registration result image.
[0013] In some embodiments of the present disclosure, generating the outer contour of the biological tissue sample based on the registration result images includes: stacking all the registration result images into an array file in a preset format; and processing the array file to obtain the outer contour of the biological tissue sample.
[0014] In some embodiments of the present disclosure, expression data and / or image data are aligned to generate an outer contour and / or partition contour of a biological tissue sample, including: calculating the expression data to obtain an expression map; performing histogram equalization on the expression map and image data to obtain an image pair of expression map-image data; and performing rigid alignment and elastic alignment on the image pair in sequence to generate a partition contour.
[0015] In some embodiments of the present disclosure, performing rigid registration on an image pair includes: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0016] In some embodiments of the present disclosure, elastic registration of image pairs includes: performing histogram equalization on the rigid registration results; inputting the rigid registration results into a deep learning model, outputting the intermediate results of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training expression quantity graph-image data pairs; and performing nearest neighbor interpolation transformation on the rigid registration results according to the deformation field to obtain an elastic registration result.
[0017] In some embodiments of the present disclosure, registering expression data and / or image data to generate an outer contour and / or partition contour of a biological tissue sample includes: registering expression data in two adjacent or similar slices to obtain registered expression data; and generating an outer contour and / or partition contour of the biological tissue sample based on the registered expression data.
[0018] In some embodiments of the present disclosure, generating three-dimensional display data of a biological tissue sample based on the outer layer contour and / or partition contour includes: performing bioinformatics analysis on the registration results obtained by aligning the expression data and / or image data to obtain clustering and annotation results; constructing a three-dimensional array based on the clustering and annotation results, and adding spatial scale information; and using a three-dimensional rendering tool to render the three-dimensional display data of the biological tissue sample.
[0019] A second aspect of an embodiment of the present disclosure provides a data processing method, which includes: obtaining expression data and image data of a biological tissue sample, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data is obtained by performing image acquisition on the biological tissue sample after slicing; calculating the expression data to obtain an expression map; performing histogram equalization on the expression map and the image data to obtain an image pair of the expression map-image data; and performing rigid alignment and elastic alignment on the image pair in sequence to generate contour data of the biological tissue sample, and the contour data is used to generate three-dimensional display data of the biological tissue sample.
[0020] In some embodiments of the present disclosure, performing rigid registration on an image pair includes: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0021] In some embodiments of the present disclosure, elastic registration of image pairs includes: performing histogram equalization on the rigid registration results; inputting the rigid registration results into a deep learning model, outputting the intermediate results of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training expression quantity graph-image data pairs; and performing nearest neighbor interpolation transformation on the rigid registration results according to the deformation field to obtain an elastic registration result.
[0022] A third aspect of the present disclosure provides a data acquisition device, comprising: a sequencing module for slicing a biological tissue sample and performing spatiotemporal group sequencing on the slices to obtain expression data; an acquisition module for performing image acquisition on the sliced biological tissue sample to obtain image data; a registration module for aligning the expression data and / or image data to generate an outer contour and / or partition contour of the biological tissue sample; and a generation module for generating three-dimensional display data of the biological tissue sample based on the outer contour and / or partition contour.
[0023] A fourth aspect of the present disclosure provides a data processing device, comprising: an acquisition module for acquiring expression data and image data of a biological tissue sample, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data is obtained by performing image acquisition on the biological tissue sample after slicing; a calculation module for calculating the expression data to obtain an expression map; an equalization module for performing histogram equalization on the expression map and the image data to obtain an image pair of the expression map-image data; and a registration module for performing rigid registration and elastic registration on the image pair in sequence to generate contour data of the biological tissue sample, wherein the contour data is used to generate three-dimensional display data of the biological tissue sample.
[0024] An embodiment of the fifth aspect of the present disclosure provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described in the embodiment of the first aspect or the embodiment of the second aspect of the present disclosure.
[0025] The sixth aspect embodiment of the present disclosure provides a computer storage medium, wherein the computer storage medium stores computer-executable instructions; after the computer-executable instructions are executed by a processor, the method described in the first aspect or second aspect embodiment of the present disclosure can be implemented.
[0026] According to the data acquisition method disclosed herein, a biological tissue sample is sliced and subjected to spatiotemporal group sequencing to obtain expression data; images of the sliced biological tissue sample are collected to obtain image data; the expression data and / or image data are aligned to generate the outer layer contour and / or partition contours of the biological tissue sample; and based on the outer layer contour and / or partition contours, three-dimensional display data of the biological tissue sample is generated. The method disclosed herein targets in situ captured spatiotemporal group technology, combines optical imaging information, and assists in the rigid and elastic registration of continuous tissue slices to achieve three-dimensional reconstruction, thereby obtaining internal and external tissue contours to assist in visual information positioning, and effectively processes and displays large-scale, high-resolution spatiotemporal group data.
[0027] Additional aspects and advantages of the present disclosure will be given in part in the description below and in part will be obvious from the description below, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0029] FIG1 is a flow chart of a data collection method according to an embodiment of the present disclosure;
[0030] FIG2 is a flow chart of a data collection method according to an embodiment of the present disclosure;
[0031] FIG3 is a schematic diagram of a data collection method according to an embodiment of the present disclosure;
[0032] FIG4 is a schematic diagram of a slicer according to an embodiment of the present disclosure;
[0033] FIG5 is a schematic diagram of a sliding position of a photographing device according to an embodiment of the present disclosure;
[0034] FIG6 is a schematic diagram of an expression data preprocessing method according to an embodiment of the present disclosure;
[0035] FIG7 is a schematic diagram of an image acquisition and spatiotemporal sequencing rule according to an embodiment of the present disclosure;
[0036] FIG8 is a schematic diagram of a photographing device taking a sample shot according to an embodiment of the present disclosure;
[0037] FIG9 is a schematic diagram of an image segmentation processing strategy according to an embodiment of the present disclosure;
[0038] FIG10 is a schematic diagram of an image segmentation processing strategy according to an embodiment of the present disclosure;
[0039] FIG11 is a schematic diagram of a rigid registration algorithm according to an embodiment of the present disclosure;
[0040] FIG12 is a schematic diagram of an image segmentation and registration result according to an embodiment of the present disclosure;
[0041] FIG13 is a schematic diagram of a tissue outer contour generation process according to an embodiment of the present disclosure;
[0042] FIG14 is a schematic diagram of an image rendering effect according to an embodiment of the present disclosure;
[0043] FIG15 is a schematic diagram of an image segmentation and registration effect according to an embodiment of the present disclosure;
[0044] FIG16 is a schematic diagram of an expression data registration process according to an embodiment of the present disclosure;
[0045] FIG17 is a schematic diagram showing the effect of histogram equalization according to an embodiment of the present disclosure;
[0046] FIG18 is a schematic diagram of a rigid registration process according to an embodiment of the present disclosure;
[0047] FIG19 is a schematic diagram of a rigid registration result according to an embodiment of the present disclosure;
[0048] FIG20 is a schematic diagram of an elastic registration process according to an embodiment of the present disclosure;
[0049] FIG21 is a schematic diagram of an elastic registration result according to an embodiment of the present disclosure;
[0050] FIG22 is a schematic diagram of continuous registration of expression data according to an embodiment of the present disclosure;
[0051] FIG23 is a schematic diagram of a partition outline model generation process according to an embodiment of the present disclosure;
[0052] FIG24 is a schematic diagram of a basic data structure of a command file according to an embodiment of the present disclosure;
[0053] FIG25 is a schematic diagram of a single gene hierarchical block data structure in a command file according to an embodiment of the present disclosure;
[0054] FIG26 is a schematic diagram of cell type hierarchical block data in a unified file according to an embodiment of the present disclosure;
[0055] FIG27 is a schematic diagram of a mouse brain reconstruction rendering effect according to an embodiment of the present disclosure;
[0056] FIG28 is a schematic diagram of a list of single genes that can be displayed by mouse brain according to an embodiment of the present disclosure;
[0057] FIG29 is a schematic diagram showing the effect of generating a tissue outer contour model according to an embodiment of the present disclosure;
[0058] FIG30 is a schematic diagram showing the effect of generating a tissue partition outline according to an embodiment of the present disclosure;
[0059] FIG31 is a schematic diagram of an elastic registration result according to an embodiment of the present disclosure;
[0060] FIG32 is a schematic block diagram of a data acquisition device according to an embodiment of the present disclosure;
[0061] FIG33 is a schematic block diagram of a data processing device according to an embodiment of the present disclosure;
[0062] FIG34 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0063] The following describes in detail embodiments of the present disclosure, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.
[0064] Since its development, spatiotemporal omics technology has found initial application in fields such as neuroscience, pathology, and developmental biology. Methods based on in situ capture typically rely on physical contact between the chip and tissue slices and probe capture to obtain in situ spatial information and various omics information. However, the destructive cutting of tissues and the planar capture of corresponding information limit their use to only two-dimensional spatiotemporal omics analysis of tissues, making it difficult to obtain three-dimensional spatial morphological structure and accurate positional information. However, different organs and tissues have unique three-dimensional cell distributions and gene expression profiles, making three-dimensional spatiotemporal omics research on tissues extremely technically challenging and scientifically significant.
[0065] The key point of three-dimensional spatiotemporal omics lies in how to break through the research of two-dimensional planes and achieve a comprehensive analysis of the spatial distribution, interactions, gene protein expression and overall morphological structure of different cells at the three-dimensional level of tissues.
[0066] Currently, the 3D reconstruction process based on spatiotemporal groups primarily involves rigid registration of adjacent or similar slices, generating partition outlines based on clustering or annotation information, and finally generating the outline of the entire tissue / organism based on the slice stack. The results of 3D reconstruction are typically presented in the form of charts in articles or demo images in code libraries. This has the following drawbacks:
[0067] (1) Rigid registration of expression data measured on a plane is performed based solely on the expression abundance information captured by the spatiotemporal group. This fails to correct for deformations in the expression data caused by human manipulation and biochemical processes during the experiment, and thus fails to reconstruct the data back to the original expression level.
[0068] (2) Using a rigid registration method based on expression abundance information, the expression abundance information that needs to be captured comes from adjacent or close slices. If the slices are far apart, the accuracy of rigid registration will decrease;
[0069] (3) The restored three-dimensional spatial information needs to be projected onto a two-dimensional plane such as a computer screen or paper journal document for visualization. Without other auxiliary information such as boundary lines and surfaces, the three-dimensional effect provided by scattered points in the two-dimensional plane is limited. Especially when the number of scattered points is large and there is no obvious tissue contour information, it is not conducive to the human eye to recognize the three-dimensional spatial information;
[0070] (4) Due to limitations in technology and samples, the number of information points on a single tissue slice is relatively small. When the physical size of the sample and the chip resolution are increased, downstream analysis and display are limited by hardware conditions, and the data processing and post-display capabilities for large amounts of tissue samples are insufficient.
[0071] To this end, the present disclosure proposes a data acquisition method, device and system, which is based on the spatiotemporal omics technology of in situ capture, combined with in situ optical imaging to obtain the original tissue contour, assist in the positioning of the biological information collected internally, so as to restore the three-dimensional position information before tissue cutting, reduce the impact of experimental operations on tissue morphology, achieve cell-precision position alignment for each information collection site on the chip, and effectively process and display tissue samples with larger sizes and data volumes.
[0072] The transmission configuration scheme provided in this application is described in detail below with reference to the accompanying drawings.
[0073] Figure 1 shows a flow chart of a data collection method according to an embodiment of the present disclosure. As shown in Figure 1 , the method may include the following steps.
[0074] S101, slice the biological tissue sample, and perform spatiotemporal sequencing on the slice to obtain expression data.
[0075] Specifically, biological tissue samples are sliced continuously, and slices at designated locations are selected for spatiotemporal group sequencing based on actual conditions.
[0076] In the embodiments of the present disclosure, biological tissue samples are taken from biological samples, which generally refer to body fluids (such as urine, blood, saliva, bile, gastric juice, lymph and other secretions of organisms, etc.), hair, muscles and some tissue organs (such as thymus, pancreas, liver, lungs, brain, stomach, kidneys, etc.) of animals (including humans) and various microorganisms.
[0077] In the embodiments of the present disclosure, the device for slicing the biological tissue sample is not limited. Preferably, a biological tissue slicer is used to slice the biological tissue sample, which has higher precision and stability.
[0078] In the embodiments of the present disclosure, expression data is obtained based on an in situ capture method. This method can be used to capture sequencing chip signals. The chip performance determines technical effects such as accuracy and resolution. Preferably, in situ capture of tissues is performed using DNA nanoball sequencing chips. Large chips and high signal density enable better resolution and field of view. Furthermore, other spatiotemporal genomic data based on in situ capture sequencing, such as proteomics currently under development, can also be applied, and this disclosure does not limit this.
[0079] In the embodiment of the present disclosure, each time a slice is selected for blank group sequencing, the corresponding position of the slice is recorded, and the corresponding position of the slice is used for subsequent three-dimensional reconstruction.
[0080] S102: Capture images of the sliced biological tissue sample to obtain image data.
[0081] In the embodiments of the present disclosure, optical imaging can be used to capture images of biological tissue samples after sectioning, or other in situ imaging techniques that do not affect spatiotemporal omics can be used, which is not limited by the present disclosure.
[0082] In the embodiments of the present disclosure, images of the tissues after sectioning corresponding to all selected slices for spatiotemporal group sequencing are collected. Images of the slice cross-sections are primarily collected for subsequent registration. Image collection of other tissue samples after sectioning is also possible, and the specific selection rules are not limited in this disclosure. For example, images of the tissue sample after sectioning are collected m times, and spatiotemporal sequencing is performed on the sliced tissue sample every n times, where m and n are positive integers that can be adjusted based on actual conditions, and n can be a multiple of m.
[0083] In the embodiment of the present disclosure, each time a slice is selected for image acquisition, the corresponding position of the slice is recorded, and the corresponding position of the slice is used for subsequent three-dimensional reconstruction.
[0084] S103 , registering the expression data and / or the image data to generate an outer layer contour and / or a partition contour of the biological tissue sample.
[0085] Optionally, before matching, expression data is preprocessed and image data is segmented. Preprocessing may include at least one of aggregation, quality control, logarithmic normalization, finding highly variable genes, and dimensionality reduction. Image segmentation primarily involves segmenting tissue using an image segmentation algorithm, identifying and deleting unqualified segmented samples, and retaining qualified segmentation results as image data for subsequent registration.
[0086] In an embodiment of the present disclosure, the method may include registering the image data to generate an outer contour of the biological tissue sample.
[0087] In one embodiment of the present disclosure, image data is segmented to generate a segmentation result map, the segmentation result map is registered to generate a registration result map, and finally, based on the registration result map, the outer contour of the biological tissue sample is generated. A first segmentation result map is selected and subjected to rotation correction, and the corrected map is used as the first reference map for registration of the other segmentation maps. Specifically, rigid registration or other registration methods may be used, which are not limited by the present disclosure.
[0088] In an embodiment of the present disclosure, the method may include registering the expression data and the image data to generate a partition outline of the biological tissue sample.
[0089] In one embodiment of the present disclosure, the expression data is calculated to obtain an expression map, the expression map and image data are histogram-equalized to obtain an image pair of the expression map-image data, and the image pair is rigidly aligned and elastically aligned in turn to generate a partition outline.
[0090] In an embodiment of the present disclosure, when image data is not used, for example, when no image is collected or for other reasons, the method may further include registering the expression data to generate an outer contour and / or partition contour of the biological tissue sample, but the spatiotemporal group slices involved in the registration need to be adjacent or close.
[0091] In one embodiment of the present disclosure, expression data in two adjacent or close slices are registered to obtain registered expression data, and the outer layer contour and / or partition contour of the biological tissue sample is generated based on the registered expression data.
[0092] It should be understood that any of the above methods can be used to generate the outer layer contour and / or partition contour of a biological tissue sample, which can be selected based on actual research or application needs and is not limited by the present disclosure.
[0093] In an embodiment of the present disclosure, contour data of a biological tissue sample is generated based on registered spatiotemporal group data. Specifically, the expression data and / or image data are registered, and the registration results are subjected to bioinformatics analysis to obtain clustering and annotation results. Based on the clustering and annotation results, a three-dimensional array is constructed, and spatial scale information is added. Each cluster or partition result is segmented to generate smooth contour surfaces of multiple tissues or regions within the sample's internal structure. Each cluster or partition result can be segmented using tools such as the segment editor in a 3D slicer. The resulting contour map is stored in common 3D vector model data formats such as vtk, obj, and stl.
[0094] S104: Generate three-dimensional display data of the biological tissue sample according to the outer layer contour and / or the partition contour.
[0095] In the embodiment of the present disclosure, a three-dimensional rendering tool is used to render the three-dimensional display data of the biological tissue sample. The rendering tool used is not limited to the present disclosure.
[0096] In one embodiment of the present disclosure, the outer contour and / or partition contour data are integrated with other image rendering data and registered spatiotemporal group data to form a project master file. This file, while taking both transmission efficiency and rendering quality into account, is generated by layering and partitioning the spatiotemporal group data based on factors such as single gene expression and cell type. The generated master file is loaded into a renderer via a Flask-based backend program, enabling intuitive display of information such as gene expression distribution and tissue contours in three dimensions.
[0097] In summary, according to the transmission configuration method provided by the embodiment of the present disclosure, a biological tissue sample is sliced and the slices are subjected to spatiotemporal group sequencing to obtain expression data; images of the sliced biological tissue sample are collected to obtain image data; the expression data and / or image data are aligned to generate the outer contour and / or partition contour of the biological tissue sample; and three-dimensional display data of the biological tissue sample is generated based on the outer contour and / or partition contour. The present disclosure is directed to in situ captured spatiotemporal omics technology, combined with optical imaging information, to perform alignment to obtain internal and external tissue contours to assist in visual information positioning. This can effectively process and display large-scale, high-resolution spatiotemporal group data, and its application to three-dimensional spatiotemporal omics technology can achieve simultaneous analysis of genes and images.
[0098] Figure 2 shows a flow chart of a data acquisition method according to an embodiment of the present disclosure. Based on the embodiment shown in Figure 1, as shown in Figure 2, the method may include the following steps. For ease of understanding, Figure 3 shows a schematic diagram of a data acquisition method according to an embodiment of the present disclosure.
[0099] In the present disclosure, in order to facilitate understanding of the scheme, an implementation method, process and effect of the present method are also described in detail. Taking the acquisition of macaque brain data as an example, the implementation method of each step will be described in detail. It should be understood that this example is not a limitation of the method.
[0100] Based on the embodiment shown in FIG1 , step S101 includes step S201 shown in FIG2 .
[0101] S201 , continuously sectioning a biological tissue sample, and performing spatiotemporal group sequencing once for each first predetermined number of sections to obtain expression level data of the sections.
[0102] The first predetermined number is a positive integer, for example, one slice is taken for spatiotemporal group sequencing every 10 slices.
[0103] In the embodiments disclosed herein, a biological tissue slicer is preferably used to slice the biological tissue sample, which provides greater precision and stability. Specifically, the biological tissue sample is fixed to the cryostat of the microtome. The position and angle of the microtome are roughly adjusted according to the required position for subsequent imaging. The tissue slice is first trimmed to remove excess OCT embedding agent until the tissue area is exposed. Serial sectioning is then performed on the tissue.
[0104] In one embodiment of the present disclosure, taking the acquisition of macaque brain data as an example, a microtome is used for slicing, as shown in FIG4 . First, the experimenter prepares the monkey brain tissue sample and fixes the monkey brain tissue sample in the center of the microtome head. Secondly, the OCT (frozen section embedding agent) embedding block containing the monkey brain tissue to be cut is fixed on the sample holder, the section is adjusted to a suitable angle, and the indicator screen shown in FIG4 is set to the trimming mode. The trimming thickness is adjusted, and according to the sample embedding status information provided by the customer, the right hand wheel is shaken to perform idling rough trimming of the section so that the OCT surface is cut flat. Before focusing, it is necessary to ensure that the forward displacement display scale pointer of the sample head is around 15 mm. Therefore, when it is estimated that the embedding block may jump out of this range, the microtome head needs to be retracted. At this time, the retraction button should be pressed. The retraction to a certain scale depends on the monkey brain tissue. The remaining thickness of the tissue is determined by the situation. Next, the knife holder needs to be adjusted to make it flat with the tissue surface. Specifically, when the embedding block is about 10mm thick, there is no need to adjust the knife holder. When the monkey brain tissue is larger than 10mm, for example, a 15mm thick embedding block, since the freezing head can only advance 10mm, when the freezing head cannot advance, it is necessary to retract the freezing head by at least 5mm. The specific movement value can be read from the display screen on the right. At this time, the knife holder should also be moved to roughly fit the tissue surface. At this time, the first cut should be removed as a flatness adjustment, and a new round of experiments should be started from the second cut.
[0105] In the embodiments of the present disclosure, expression data is obtained based on an in situ capture method. This method can be used to capture sequencing chip signals. The chip performance determines technical effects such as accuracy and resolution. Preferably, in situ capture of tissues is performed using DNA nanoball sequencing chips. Large chips and high signal density enable better resolution and field of view. Additionally, other spatiotemporal genomic data based on in situ capture sequencing, such as proteomics currently under development, can also be applied, and this disclosure does not limit this.
[0106] In some embodiments of the present disclosure, after obtaining the expression data of the slice, the expression data is also preprocessed, wherein the preprocessing includes at least one of aggregation processing, quality control, logarithmic normalization, finding highly variable genes, and dimensionality reduction processing.
[0107] In the present disclosure, preprocessing of data is beneficial to reducing the noise brought by expression data and reducing the data scale effect caused by experimental conditions and operations, thereby obtaining more accurate annotation results, expression maps that can better reflect the organizational structure, and more accurate display results in the renderer.
[0108] In the present disclosure, as shown in FIG6 , the data is also annotated. The annotation results based on the preprocessing will be used to generate the partition outline and display the data in the renderer.
[0109] It should be noted that the specific preprocessing and annotation methods are determined by the user of the process. Existing processing processes such as binset aggregation, quality control, logarithmic normalization (also known as 'sequencing depth normalization'), finding highly variable genes, dimensionality reduction, and clustering can be used, or self-designed processes can be used.
[0110] In one embodiment of the present disclosure, taking macaque brain data as an example, as shown in FIG6 , the upper portion shows the original expression data of macaque brain slices, and the lower portion shows the corresponding expression data after preprocessing and annotation.
[0111] Based on the embodiment shown in FIG1 , step S102 includes step S202 shown in FIG2 .
[0112] S202 , every time a second predetermined number of slices are cut, an image is captured on the sliced biological tissue sample to obtain image data.
[0113] The second predetermined number is a positive integer.
[0114] In the embodiments disclosed herein, sequencing and image acquisition are performed according to specific rules, where the first predetermined number is a multiple of the second predetermined number. Spatiotemporal group sequencing is always performed simultaneously with imaging, but sometimes imaging is performed without sequencing, which is adjusted based on actual conditions. For example, as shown in Figure 7, the first predetermined number is 10, and the second predetermined number is 5. A biological tissue sample is cut into 13 slices. After the first slice, spatiotemporal group sequencing is performed on the slices and images are collected from the sliced biological sample. After five consecutive slices are cut, images are collected from the sliced biological sample. After another five consecutive slices are cut, spatiotemporal group sequencing is performed on the slices and images are collected from the sliced biological sample, until all slices are cut.
[0115] In the embodiments of the present disclosure, optical imaging can be used to capture images of biological tissue samples after sectioning, or other in situ imaging techniques that do not affect spatiotemporal omics can be used, which is not limited by the present disclosure.
[0116] In one embodiment of the present disclosure, a camera is used to capture images of a biological tissue sample after slicing. Specifically, as shown in FIG5 , the camera is aimed at the tissue slice, the system is calibrated so that the sample section is in focus, and the current camera position is recorded through the slide software control panel. The tissue is sliced according to the plan, and the cutter flow is recorded. The first slice is taken for spatiotemporal group sequencing, and the remaining tissue sections are photographed using BlockFace. The specific photography and spatiotemporal group sequencing rules are performed as shown in FIG7 .
[0117] In one embodiment of the present disclosure, the image acquisition method adopts in-situ optical imaging, taking macaque brain data as an example, the photographic device used is shown in Figure 4, first, connect the photographic device and the computer. Specifically, select a suitable lens, adjust the scale value corresponding to the white dot on the lens to indicate the actual magnification of the lens at this time, connect the power cord and USB signal line of the camera and the slide, wherein the USB signal line should be connected to the USB3.0 interface of the computer, open the camera photography software on the computer desktop, select the camera's "MV-CH250-90UC" to make the camera connect normally. Secondly, by operating the slide software and the camera software, control the photographic device to perform image acquisition. Specifically, start the slide software, select Easy mode, then confirm the servo, the operation interface of the slide appears, set the numerical value of the slide forward and backward, take 100 as an example, in the actual process it is generally between 80 and 100 mm, and the specific size is based on the initial focal plane (when the photographic device has not yet moved to the position where the slicer takes pictures, only set the numerical value, do not click "+"). As shown in Figure 5, slide the camera from the initial end along the slide rail to the stop end and open the hatch to a safe position. Select the video button in the camera software. A live video display will appear in the camera's video display window. Then click the "+" slider (using the previously set value of 100). The slider will extend into the microtome, and a tissue cross-section will appear in the display. If the tissue plane is out of focus, set the slider unit by entering "1" in the slider software box. Select "-" or "+" as needed (selecting "-" extends the slider outward, while selecting "+" extends the slider inward). Through this fine-tuning, the black mark on the OCT (used for fine-tuning) should be clearly visible in the camera display (before marking the mark, ensure that the OCT has been sliced flat by the microtome). Once the OCT is in focus, continue slicing the OCT with the mark in focus until the desired tissue plane is slightly out of focus. At this point, you can proceed with the slicing process. Finally, take a photo, save the image, and reset the camera. Specifically, for a Block Face image that needs to be photographed and saved, click the "Snap Image" button on the camera interface to save the image. After completing a single photo, click "Reset" in the slide software, as shown in Figure 5. This will cause the camera to safely exit the chassis and close the door. The experimenter then moves the camera back to its initial position, completing the single photo session. The photo result is shown in Figure 8.
[0118] Steps S203-205 shown in FIG2 are further disclosure of step S103 in the embodiment of FIG1: registering the expression data and / or the image data to generate the outer contour and / or partition contour of the biological tissue sample.
[0119] S203: Perform image segmentation processing on the image data to generate a segmentation result image.
[0120] In one embodiment of the present disclosure, specifically, a BlockFace image taken by optical imaging is subjected to tissue segmentation using an image segmentation algorithm, unqualified segmentation samples are identified and deleted, and qualified BlockFace image segmentation results are retained for subsequent processing.
[0121] In some embodiments of the present disclosure, image segmentation processing of image data includes: converting the image data into HSV color space, extracting the image data of the H channel and converting it into a grayscale image; binarizing the image data through a preset image processing algorithm to determine a contour map of the binarization result; retaining the contour map that meets the preset conditions and merging it with the image data.
[0122] Specifically, as shown in Figure 9, the original BlockFace image is first segmented, the large area of background is removed, the image is converted to the HSV color space format, the H channel is extracted and converted into a grayscale image, the image is binarized using the Li algorithm, and the contour map of the binarized result is found. The contours greater than the threshold are retained through the first-order moment of the contour, and the target segmentation area is obtained by merging with the original image.
[0123] Optionally, performing image segmentation processing on the image data may further include: acquiring a grayscale image and a histogram of the image data; performing maximum entropy threshold binarization processing on the image data; and merging the processed image with the image data.
[0124] In this disclosure, the strategy shown in FIG9 is preferably used for image segmentation. For images that are not suitable for segmentation using this strategy, or images that are incorrectly segmented using this strategy, the strategy shown in FIG10 can be optionally used for image segmentation. For example, due to the diversity of the BlockFace map of the tissue area itself, if the background pixels in the BlockFace map and the target pixel values of the tissue to be segmented are very close, then the threshold value obtained by the Li algorithm may not be applicable to all cases.
[0125] Specifically, as shown in Figure 10, the original BlockFace image is first segmented to remove large areas of background. The image after large areas of background removal is then grayscaled. The histogram of the grayscaled image is calculated (a grayscale histogram is a histogram of all pixels in a digital image), and the frequency of occurrence is counted according to the size of the grayscale value. Based on the maximization of the information metric between the object and the background, the maximum entropy binarization threshold is obtained and used to segment the grayscale image. The target segmentation area is obtained based on the segmented mask image and the image after large areas of background removal.
[0126] S204: Register the segmentation result image to generate a registration result image.
[0127] In an embodiment of the present disclosure, before registration, the first BlockFace segmentation result image is taken and rotationally corrected, and the corrected image is used as the first reference image to register other segmentation images.
[0128] In some embodiments of the present disclosure, registering the segmentation result image to generate a registration result image includes: performing spatial transformation processing and linear interpolation algorithm processing on the segmentation result image; performing mean square error similarity measurement on the processed segmentation result image and the registration reference image; and determining the optimal measurement solution as the registration result image.
[0129] In one embodiment of the present disclosure, the BlockFace image segmentation result registration logic is shown in Figure 11. The maximum number of iterations of the fixed-step gradient descent optimization algorithm of the rigid registration algorithm is set to K and the learning rate is r, and the step size is t (the values of K, r, and t are adjusted according to actual conditions) to achieve registration. Specifically, the BlockFace image segmentation result image is first subjected to spatial transformation and linear interpolation algorithms. The first BlockFace segmentation result image is used as a reference image and a mean square error similarity test is performed with the reference image. If optimization is required, a descent optimization algorithm with a fixed step size r is performed, and spatial transformation and linear interpolation algorithms are performed again until the maximum number of iterations K is reached to obtain the optimal result output, that is, the registration result image is obtained.
[0130] Regarding step S203 and step S204, taking the BlockFace image of mouse heart tissue as an example, the effects of segmenting and registering the BlockFace image of mouse heart tissue are demonstrated, as shown in FIG12 .
[0131] S205 , generating an outer contour of the biological tissue sample based on the registration result image.
[0132] In some embodiments of the present disclosure, generating the outer contour of the biological tissue sample based on the registration result images includes: stacking all the registration result images into an array file in a preset format; and processing the array file to obtain the outer contour of the biological tissue sample.
[0133] In one embodiment of the present disclosure, as shown in FIG13 , the volume and mesh are generated for the registration result map. Specifically, the BlockFace segmentation map after registration is stacked into a file in .npy format. The obtained npy array file, in which the spatial position occupied by the non-zero value elements is the sample tissue, and the 0 value elements are the spatial background, can be stored in the medical image format NIfTI (Neuroimaging Informatics Technology Initiative). Through image processing tools such as SimpleITK and Nibabel, supplemented by the three-dimensional spatial scale of the slice, it is stored as a file in nii format, and then through related tools such as 3Dslicer, the segment-make surface operation is performed to form a smooth outer contour of the tissue, and stored in common 3D vector model data such as vtk, obj, and stl.
[0134] In an embodiment of the present disclosure, the method further includes processing the registered optical imaging result to obtain a format required for rendering.
[0135] Specifically, the registered BlockFace segmentation images are stacked into a .npy or .tif file, and the BlockFace segmentation images are processed into binary rendering files with a hierarchical block structure supported by the renderer through the Python toolkits CloudVolume and Igneous. The final rendering effect is shown in Figure 14.
[0136] In one embodiment of the present disclosure, as shown in FIG15 , taking macaque brain data as an example, the BlockFace photograph is first rotationally corrected using ImageJ and the ROI analysis region of interest is selected. The BlockFace ROI image is then segmented to identify the target object and the background, and the BlockFace segmentation map is registered to form a stack of BlockFace images aligned in space. The algorithm generates the outermost contour of the object based on the BlockFace segmentation map.
[0137] In some embodiments of the present disclosure, after the outer contour of the biological tissue sample is generated in steps S203-205, the process further includes: calculating the expression data to obtain an expression map; performing histogram equalization on the expression map and the image data to obtain an image pair of the expression map-image data; and performing rigid registration and elastic registration on the image pair in sequence to generate a partition contour.
[0138] Specifically, as shown in Figure 16, the spatiotemporal expression data is processed into expression maps reflecting the abundance of expression in different regions. Histogram equalization is then performed on both the expression map and the BlockFace segmentation map. The results of the histogram equalization are shown in Figure 17. Then, for BlockFace segmentation map-expression map pairs with adjacent slice positions, the following operations are performed: the BlockFace segmentation map is used as the reference image, and the expression map is rigidly and elastically registered with it. After completing both registrations, the transformation relationships determined in the registration (the transformation relationship for rigid registration is represented by a 3*3 transformation matrix, and the transformation relationship for elastic registration is represented by two deformation fields, representing the distribution of deformation in the x and y directions, respectively) are reused on the expression data to achieve registration between the expression data and the BlockFace segmentation map.
[0139] Optionally, performing rigid registration on the image pair includes: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0140] In one embodiment of the present disclosure, as shown in FIG18 , the image pairs are downsampled and noise filtered to remove artifacts. The edge features, shape features, and region segmentation information of the target tissue in the two different modal images are extracted using a deep learning model. The affine transformation is then estimated by maximizing the similarity of the outermost contour of the target tissue at the model output. Finally, the affine transformation is applied to the original image of the expression data to be registered. The processed pair of expression data and the BlockFace segmentation map are then sent to the elastic registration process. The result of the rigid registration is shown in FIG19 .
[0141] Optionally, elastic registration of image pairs includes: performing histogram equalization on the rigid registration results; inputting the rigid registration results into a deep learning model, outputting the intermediate results of the model, and obtaining a deformation field, wherein the deep learning model is obtained by training the expression graph-image data pairs; and performing nearest neighbor interpolation transformation on the rigid registration results according to the deformation field to obtain an elastic registration result.
[0142] In one embodiment of the present disclosure, the implementation of elastic registration is based on the derivation of a deep learning model, as shown in Figure 20. The corresponding deep learning model is obtained through the following process: first, after the expression data is processed into an expression map, the expression map and the corresponding BlockFace segmentation map are histogram equalized respectively. Then, the expression map-BlockFace segmentation map is rigidly registered in the software as the input image for model training, and then elastic registration is performed as the label for model training. Based on the control point coordinates output by the software during manual elastic registration, random parameters are added to generate a randomly deformed expression map to achieve data synthesis. Finally, a supervised model is trained using synthetic and real data, and the training indicators are stopped after the requirements are met, and the model is saved. After obtaining the deep learning model, this model can be used to derive elastic deformation. The expression data and BlockFace segmentation map in the actual problem are processed according to the above-mentioned method to obtain a histogram-equalized image. The two images are input into the model, and the intermediate result of the model is output: the deformation field. Based on the deformation field, the corresponding displacement is obtained, and the expression data is transformed using nearest neighbor interpolation to calculate the new expression data. Figure 21, using a monkey brain as an example, shows the corresponding transformation between the expression map and the BlockFace map before and after elastic registration: the red image is the BlockFace image, and the green image is the expression map. After elastic registration, the deformation of the visible expression map is corrected.
[0143] In another optional method, the expression data can also be used to directly perform registration to generate the outer contour and / or partition contour of the biological tissue sample. The method includes: registering the expression data in two adjacent or similar slices to obtain registered expression data; and generating the outer contour and / or partition contour of the biological tissue sample based on the registered expression data.
[0144] It should be understood that in the absence of image acquisition, such as when the user does not take photos due to habit or there is no photo-taking equipment, executing this method can also generate the outer contour and / or partition contour of the biological tissue sample, but the spatiotemporal group slices involved in the registration need to be adjacent or close.
[0145] In one embodiment of the present disclosure, as shown in Figure 22, the bin set or cell bin is calculated based on the expression data in two adjacent or similar slices. After preprocessing such as logarithmic normalization, the optimal transmission problem is solved to obtain the optimal transmission transfer probability matrix (referred to as the pi matrix); after post-processing the pi matrix, the rigidity, or rigidity + elasticity transformation relationship can be calculated; finally, this transformation relationship is applied to the original expression data.
[0146] S206 , performing bioinformatics analysis on the registration results obtained by registering the expression data and / or image data to obtain clustering and annotation results.
[0147] S207, constructing a three-dimensional array based on the clustering and annotation results, and adding spatial scale information.
[0148] In the present disclosure, an outer contour and / or partition contour model is generated based on a registration result obtained by performing registration on the expression data and / or image data.
[0149] In one embodiment of the present disclosure, the outer contour is generated according to the registration result obtained by performing registration based on the image data, specifically, as shown in FIG13 , refer to step S205 .
[0150] In one embodiment of the present disclosure, a partition outline is generated based on the registration result obtained by registering the expression data and / or image data. Specifically, similar to step S205, as shown in FIG23 , the registered expression data or each bin set or cell bin is subjected to conventional bioinformatics analysis to obtain clustering and annotation results. A three-dimensional npy array is constructed based on the value of the annotation or clustering result of each bin set or cell bin, and spatial scale information is added to obtain a NIfTI file based on the annotation clustering result. Then, a tool such as the segment editor in the 3D slicer is used to segment each cluster or partition result to generate a smooth contour surface of multiple tissues or regions of the internal structure of the sample, and store it in common 3D vector model data such as vtk, obj, and stl. This corresponds to the above-mentioned step S205.
[0151] In the present disclosure, the generated outer contour and / or partition contour model is processed into a binary 3D model file bound with a partition label through the Python toolkit multiresolution-mesh-creator.
[0152] In the present disclosure, the above-mentioned image rendering data, registered spatiotemporal group data, tissue contour data, partition contour data, etc. are integrated into a project management file, and the file content structure is determined according to research or application requirements.
[0153] In one embodiment of the present disclosure, the registered spatiotemporal group expression data is used to generate a cgef format file through geftools, and then the binary image data, binary partition contour model data, tissue outer contour model data, etc. generated in the above steps are used to generate a command file through gef3d. The file content structure is shown in Figure 24, which mainly shows the first three levels of the command file.
[0154] In some embodiments of the present disclosure, taking transmission efficiency and rendering effect into comprehensive consideration, the spatiotemporal group data can be hierarchically and block-processed according to the single gene expression level, cell type, etc. when generating the project management file.
[0155] Hierarchical binning involves sampling a large number of data points in a pyramid-like structure based on spatial location, ensuring that the data points in all bins across all layers are combined into the entire data set. This process is automatically performed when gef3d generates the master file, and requires specifying a threshold for the number of bins / cellbins per bin.
[0156] In one embodiment of the present disclosure, the hierarchical block method may include: first traversing all cgef to obtain the overall space size, setting a maximum number of layers, calculating the division scale according to the length of each data point in the three-dimensional space, and pre-dividing the number of blocks in each layer from top to bottom according to the 8-point method, and each block is approximately a cube. By default, the first layer has only one block. After the first step of traversal, the data of each gene in each slice can be obtained, that is, the attribute value of the data point in the entire space, including coordinates and expression abundance, etc. The data of a single gene is hierarchically divided into blocks. According to the result of the first step calculation, from the top layer to the bottom layer, each small block of each layer is filled in turn from the overall data of the gene until the small block is filled (controlled by a threshold). The remaining part continues to fill the next layer. If a block of data in the next layer is too small (threshold control), the data of this block will be added to the parent block of the previous layer. Distribute downward in sequence until the data of the gene is distributed. The hierarchical block of the annotation results of cell types such as celltype is similar to that of single genes.
[0157] The storage structure of data such as expression levels or cell types after layering and blocking in the command file is shown in Figures 25 and 26. In the L0 directory, "blk" represents "block" and is used to store the block data. In the "blk" directory, "offset" represents "offset", which stores the starting index offset of the block data, and "count" represents "count", which stores the number of points in the block data. "cell" represents "cell", which stores information related to all bin / cellbin data at that level. In the "cell" directory, "x", "y", and "z" respectively store the x, y, and z coordinates of the bin / cellbin spatial coordinates. "umicnt" stores the expression level of the bin / cellbin, and "cellid" represents the cell number, which stores the bin / cellbin number. In the "attrs" directory, "ctype_list" represents the cell type list, which stores a list of cell type numbers, names, and colors. "maxlevelnum" represents the maximum number of layers, which is the maximum number of layers in all cell type data. "blkcnt" represents the number of blocks, which stores the number of blocks in each axis at different levels. "maxumi" represents the maximum expression level, which stores the maximum expression level.
[0158] S208 , using a three-dimensional rendering tool to render and obtain three-dimensional display data of the biological tissue sample.
[0159] Specifically, the generated master file is loaded into the renderer via a Flask-based backend program, enabling a visual display of gene expression distribution, tissue outlines, and other information in three-dimensional space. The webpage display is shown in Figure 27, where the overall expression data and tissue outline model are loaded.
[0160] In summary, according to the data acquisition method provided in the embodiment of the present disclosure, for the in situ captured spatiotemporal omics technology, combined with optical imaging information, it assists in the rigid and elastic alignment of continuous tissue sections, realizes three-dimensional reconstruction, and then obtains the internal and external tissue contours to assist in the visualization information positioning, and effectively processes and displays large-scale, high-resolution spatiotemporal group data.
[0161] The effects of the method disclosed in this disclosure are shown as follows:
[0162] 1. Through steps S204 and S205, the collected sample image data is subjected to an image segmentation processing method and image registration. Taking the BlockFace image of mouse heart tissue as an example, the effects of segmenting and registering the BlockFace image of mouse heart tissue are demonstrated, as shown in FIG12 .
[0163] 2. Referring to the corresponding method in Figure 18 above, taking the monkey brain as an example, the corresponding transformation of the expression map and the collected image before and after elastic registration is demonstrated. The effect is shown in Figure 19. After elastic registration, the deformation of the visual expression map is corrected.
[0164] 3. Generate a tissue contour model and combine it with spatial scatter point information such as the transcriptome for display, as shown in Figure 28. From left to right, the following are the mouse brain tissue contour and cell type display, the mouse brain tissue contour and single gene expression level display, and the mouse brain tissue contour model and total gene expression level display.
[0165] 4. Generate a tissue partition outline model, as shown in Figure 29. The left side shows the mouse brain tissue partition outline model, and the right side shows the mouse brain tissue partition outline model and the corresponding cell type bin.
[0166] 5. Processing and display of tissue samples with larger size and data volume. Figure 30 shows a sample of over 100 spatiotemporal microarray data from a mouse brain. The chip measures 1 cm x 1 cm, and the displayed data contains approximately 900,000 coordinate points, encompassing approximately 22,000 genes.
[0167] Therefore, the method disclosed in the present invention can better restore the tissue contour and related expression data of tissue samples before slicing, and be applied to three-dimensional reconstruction of spatiotemporal omics, which will be conducive to promoting the research and application of three-dimensional spatiotemporal omics technology.
[0168] Figure 31 is a flow chart of a data processing method according to an embodiment of the present disclosure. As shown in Figure 31, the method may include the following steps.
[0169] S301, obtaining expression level data and image data of a biological tissue sample.
[0170] The expression data are obtained by slicing biological tissue samples and performing spatiotemporal sequencing on the slices, and the image data are obtained by capturing images of the biological tissue samples after slicing.
[0171] In an embodiment of the present disclosure, a biological tissue sample is sliced continuously, and slices at designated positions are selected according to actual conditions for spatiotemporal group measurement to obtain expression data.
[0172] In the embodiments of the present disclosure, optical imaging can be used to capture images of biological tissue samples after sectioning to obtain image data. Other in situ imaging techniques that do not affect spatiotemporal omics can also be used, which are not limited by the present disclosure.
[0173] In the embodiments of the present disclosure, biological tissue samples are taken from biological samples, which generally refer to body fluids (such as urine, blood, saliva, bile, gastric juice, lymph and other secretions of organisms, etc.), hair, muscles and some tissue organs (such as thymus, pancreas, liver, lungs, brain, stomach, kidneys, etc.) of animals (including humans) and various microorganisms.
[0174] In the embodiments of the present disclosure, the device for slicing the biological tissue sample is not limited. Preferably, a biological tissue slicer is used to slice the biological tissue sample, which has higher precision and stability.
[0175] In the embodiments of the present disclosure, expression data is obtained based on an in situ capture method. This method can be used to capture sequencing chip signals. The chip performance determines technical effects such as accuracy and resolution. Preferably, in situ capture of tissues is performed using DNA nanoball sequencing chips. Large chips and high signal density enable better resolution and field of view. Furthermore, other spatiotemporal genomic data based on in situ capture sequencing, such as proteomics currently under development, can also be applied, and this disclosure does not limit this.
[0176] In the embodiments of the present disclosure, image acquisition is performed on the tissues after slicing corresponding to all selected slices for spatiotemporal group sequencing, and images of the slice cross sections are mainly acquired for subsequent registration. At the same time, other biological tissue samples after slicing can also be selected for image acquisition. The specific selection rules are not limited by the present disclosure.
[0177] In the embodiment of the present disclosure, each time a slice is selected for spatiotemporal group sequencing or image acquisition, the corresponding position of the slice is recorded, and the corresponding position of the slice is used for subsequent three-dimensional reconstruction.
[0178] In the present disclosure, after acquiring expression data, the data may also be preprocessed. This preprocessing may include at least one of aggregation, quality control, logarithmic normalization, identification of highly variable genes, and dimensionality reduction. Preprocessing helps reduce noise in the expression data and mitigates data scaling effects caused by experimental conditions and manipulations, thereby resulting in more accurate annotation results, expression maps that better reflect tissue structure, and more accurate display results in renderers.
[0179] In the present disclosure, after acquiring the image data, the image data can also be segmented. Specifically, the image data is converted into the HSV color space, the image data of the H channel is extracted and converted into a grayscale image, and the image data is binarized through a preset image processing algorithm to determine the binarization result contour map, retaining the contour map that meets the preset conditions and merging it with the image data.
[0180] Please refer to the specific implementation of step S201 and step 202, which will not be described in detail in this disclosure.
[0181] S302: Calculate the expression data to obtain an expression graph.
[0182] In the embodiments of the present disclosure, the correlation coefficient of the expression data of the spatiotemporal group is calculated according to actual research needs to obtain an expression map that can reflect the expression abundance of different regions. The specific calculation, statistics and drawing methods are not limited in this disclosure.
[0183] S303 , performing histogram equalization on the expression level graph and the image data to obtain an image pair of the expression level graph and the image data.
[0184] Histogram equalization is a simple and effective image enhancement technique. It alters the grayscale of each pixel by changing the image's histogram. It is primarily used to enhance the contrast of images with a small dynamic range. The grayscale distribution of the original image may be concentrated in a narrow range, resulting in a lack of clarity. For example, an overexposed image's grayscale levels are concentrated in the high-brightness range, while an underexposed image's grayscale levels are concentrated in the low-brightness range. Histogram equalization transforms the original image's histogram into a uniformly distributed (balanced) form, increasing the dynamic range of grayscale value differences between pixels and thereby enhancing the overall contrast of the image.
[0185] In one embodiment of the present disclosure, after step S301, a BlockFace image is collected as image data, and the image is segmented to obtain a BlockFace segmentation map, and the BlockFace segmentation map-expression image pairs with adjacent slice positions are taken as image pairs of expression map-image data.
[0186] S304 , performing rigid registration and elastic registration on the image pair in sequence to generate contour data of the biological tissue sample. The contour data is used to generate three-dimensional display data of the biological tissue sample.
[0187] In one embodiment of the present disclosure, as shown in Figure 16, the BlockFace segmentation map is used as the reference image, and the expression map is used to perform rigid and elastic registration with it. After completing both registrations, the transformation relationship determined in the registration (the transformation relationship for rigid registration is in the form of a 3*3 transformation matrix, and the transformation relationship for elastic registration is in the form of two deformation fields, representing the distribution of deformation in the x and y directions respectively) is reused on the expression data to achieve registration between the expression data and the BlockFace segmentation map.
[0188] In an optional embodiment of the present disclosure, performing rigid registration on the image pair includes: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0189] In one embodiment of the present disclosure, as shown in FIG18 , the image pairs are downsampled and noise filtered to remove artifacts. The edge features, shape features, and region segmentation information of the target tissue in the two different modal images are extracted using a deep learning model. The affine transformation is then estimated by maximizing the similarity of the outermost contour of the target tissue at the model output. Finally, the affine transformation is applied to the original image of the expression data to be registered. The processed pair of expression data and the BlockFace segmentation map are then sent to the elastic registration process. The result of the rigid registration is shown in FIG19 .
[0190] In an optional embodiment of the present disclosure, elastic registration of image pairs includes: performing histogram equalization on the rigid registration result; inputting the rigid registration result into a deep learning model, outputting the intermediate result of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training the expression graph-image data pair; according to the deformation field, performing nearest neighbor interpolation transformation on the rigid registration result to obtain an elastic registration result.
[0191] In one embodiment of the present disclosure, the implementation of elastic registration is based on the derivation of a deep learning model, as shown in Figure 20. The corresponding deep learning model is obtained through the following process: first, after the expression data is processed into an expression map, the expression map and the corresponding BlockFace segmentation map are histogram equalized respectively. Then, the expression map-BlockFace segmentation map is rigidly registered in the software as the input image for model training, and then elastic registration is performed as the label for model training. Based on the control point coordinates output by the software during manual elastic registration, random parameters are added to generate a randomly deformed expression map to achieve data synthesis. Finally, a supervised model is trained using synthetic and real data, and the training indicators are stopped after the requirements are met, and the model is saved. After obtaining the deep learning model, this model can be used to derive elastic deformation. The expression data and BlockFace segmentation map in the actual problem are processed according to the above-mentioned method to obtain a histogram-equalized image. The two images are input into the model, and the intermediate result of the model is output: the deformation field. Based on the deformation field, the corresponding displacement is obtained, and nearest neighbor interpolation is performed on the expression data to calculate the new expression data. Figure 21 shows the corresponding transformation between the expression map and the BlockFace map before and after elastic registration, using a monkey brain as an example: the red image is the BlockFace image, and the green image is the expression map. After elastic registration, the deformation of the visible expression map is corrected.
[0192] In the present disclosure, the contour data of the biological tissue sample is generated based on the aligned spatiotemporal group data. Specifically, based on the aligned spatiotemporal expression data, each bin set or cell bin is clustered and annotated after conventional bioinformatics analysis. A three-dimensional npy array is constructed with the value of the annotation or clustering result of each bin set or cell bin as a unit, and spatial scale information is added to obtain a NIfTI file based on the annotated clustering result. Then, tools such as the segment editor in the 3D slicer are used to segment each cluster or partition result to generate smooth contour surfaces of multiple tissues or regions of the sample's internal structure, which are stored in common 3D vector model data such as vtk, obj, and stl.
[0193] In this disclosure, contour data is used to generate three-dimensional display data for biological tissue samples. Specifically, the contour data is integrated with other image rendering data and registered spatiotemporal data to form a project overview file. This file takes into account both transmission efficiency and rendering quality. The spatiotemporal data is then layered and partitioned based on factors such as single gene expression and cell type. The generated overview file is loaded into a renderer via a Flask-based backend program, enabling intuitive display of information such as gene expression distribution and tissue contours in three dimensions.
[0194] You can refer to the specific implementation of the corresponding contents of steps S203-208 in Figure 2, which will not be repeated in this disclosure.
[0195] In summary, according to the data processing method provided in the embodiment of the present disclosure, expression data and image data of a biological tissue sample are obtained, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data is obtained by performing image acquisition on the biological tissue sample after slicing; the expression data is calculated to obtain an expression graph; the expression graph and the image data are histogram-equalized to obtain an image pair of the expression graph-image data; the image pair is rigidly aligned and elastically aligned in sequence to generate contour data of the biological tissue sample, and the contour data is used to generate three-dimensional display data of the biological tissue sample. A registration method for spatiotemporal sequenced expression data and tissue section image data is provided. Application of this method can obtain internal and external tissue contours to assist in visualization information positioning, effectively process and display large-scale, high-resolution spatiotemporal group data, and promote the research and application of three-dimensional spatiotemporal omics technology.
[0196] To implement the various functions of the methods provided in the embodiments of the present application, the network devices and terminal devices may include hardware structures and software modules, and implement the aforementioned functions in the form of hardware structures, software modules, or hardware structures and software modules. Certain of the aforementioned functions may be implemented in the form of hardware structures, software modules, or hardware structures and software modules.
[0197] Corresponding to the data acquisition methods provided in the above-mentioned embodiments, the present disclosure also provides a data acquisition device. Since the data acquisition device provided in the embodiment of the present disclosure corresponds to the data acquisition methods provided in the above-mentioned embodiments, the implementation method of the data acquisition method is also applicable to the data acquisition device provided in this embodiment and will not be described in detail in this embodiment.
[0198] Figure 32 is a structural schematic diagram of a data acquisition device 400 provided in an embodiment of the present disclosure. As shown in Figure 32, the device 400 may include: a sequencing module 410, used to slice a biological tissue sample and perform spatiotemporal group sequencing on the slices to obtain expression data; an acquisition module 420, used to capture images of the sliced biological tissue sample to obtain image data; an alignment module 430, used to align the expression data and / or image data to generate an outer contour and / or partition contour of the biological tissue sample; and a generation module 440, used to generate three-dimensional display data of the biological tissue sample based on the outer contour and / or partition contour.
[0199] According to the data acquisition device provided by the embodiment of the present disclosure, a biological tissue sample is sliced and the slices are subjected to spatiotemporal group sequencing to obtain expression data; images of the sliced biological tissue sample are collected to obtain image data; the expression data and / or image data are aligned to generate the outer contour and / or partition contour of the biological tissue sample; based on the outer contour and / or partition contour, three-dimensional display data of the biological tissue sample is generated. For the spatiotemporal group technology captured in situ, combined with optical imaging information, the inner and outer tissue contours are aligned to assist in the positioning of visualization information, which can effectively process and display large-scale, high-resolution spatiotemporal group data.
[0200] In some embodiments, the transmission configuration information further includes a recommended OAM mode quantity and / or a recommended OAM mode set, and the recommended OAM mode quantity and / or the recommended OAM mode set are obtained by the second device based on the recommended PMI.
[0201] In some embodiments, the sequencing module 410 is specifically used to: continuously slice the biological tissue sample, and perform spatiotemporal group sequencing once for each first predetermined number of slices to obtain expression data of the slices, wherein the first predetermined number is a positive integer.
[0202] In some embodiments, a preprocessing module is further included for preprocessing the expression data, wherein the preprocessing includes at least one of aggregation processing, quality control, logarithmic normalization, finding highly variable genes, and dimensionality reduction processing.
[0203] In some embodiments, the acquisition module 420 is specifically configured to: perform an image acquisition on the sliced biological tissue sample every time a second predetermined number of slices are cut to obtain image data, wherein the second predetermined number is a positive integer.
[0204] In some embodiments, the registration module 430 is specifically used to: perform image segmentation processing on the image data to generate a segmentation result map; perform registration on the segmentation result map to generate a registration result map; and generate an outer contour of the biological tissue sample based on the registration result map.
[0205] In some embodiments, image segmentation processing of image data includes: converting the image data into HSV color space, extracting the image data of the H channel and converting it into a grayscale image; binarizing the image data through a preset image processing algorithm to determine a binarization result contour map; retaining the contour map that meets the preset conditions and merging it with the image data.
[0206] In some embodiments, the method further includes: obtaining a grayscale image and a histogram of the image data; performing maximum entropy threshold binarization processing on the image data; and merging the processed image with the image data.
[0207] In some embodiments, registering the segmentation result image to generate a registration result image includes: performing spatial transformation processing and linear interpolation algorithm processing on the segmentation result image; performing mean square error similarity measurement on the processed segmentation result image and the registration reference image; and determining the optimal measurement solution as the registration result image.
[0208] In some embodiments, generating the outer contour of the biological tissue sample based on the registration result images includes: stacking all the registration result images into an array file in a preset format; and processing the array file to obtain the outer contour of the biological tissue sample.
[0209] In some embodiments, the registration module 430 is also used to: calculate the expression data to obtain an expression map; perform histogram equalization on the expression map and image data to obtain an image pair of expression map-image data; and perform rigid registration and elastic registration on the image pair in sequence to generate a partition outline.
[0210] In some embodiments, performing rigid registration on the image pair includes: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0211] In some embodiments, elastic registration of image pairs includes: performing histogram equalization on the rigid registration results; inputting the rigid registration results into a deep learning model, outputting the intermediate results of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training the expression graph-image data pairs; according to the deformation field, performing nearest neighbor interpolation transformation on the rigid registration results to obtain an elastic registration result.
[0212] In some embodiments, the registration module 430 is further used to: register the expression data in two adjacent or close slices to obtain registered expression data; and generate the outer contour and / or partition contour of the biological tissue sample based on the registered expression data.
[0213] In some embodiments, the generation module 440 is specifically used to: perform bioinformatics analysis on the registration results obtained by registering the expression data and / or image data to obtain clustering and annotation results; construct a three-dimensional array based on the clustering and annotation results, and add spatial scale information; use a three-dimensional rendering tool to render and obtain three-dimensional display data of the biological tissue sample.
[0214] In summary, according to the data acquisition method provided by the embodiment of the present disclosure, the biological tissue sample is sliced and the slices are subjected to spatiotemporal group sequencing to obtain expression data; the sliced biological tissue sample is imaged to obtain image data; the expression data and / or image data are aligned to generate the outer contour and / or partition contour of the biological tissue sample; based on the outer contour and / or partition contour, three-dimensional display data of the biological tissue sample is generated, and for the spatiotemporal omics technology captured in situ, combined with optical imaging information, the rigid and elastic alignment of continuous tissue slices is assisted to achieve three-dimensional reconstruction, and then the internal and external tissue contours are obtained to assist in the visualization information positioning, and large-scale high-resolution spatiotemporal group data are effectively processed and displayed. The application of three-dimensional spatiotemporal omics technology can realize the simultaneous analysis of genes and images.
[0215] Corresponding to the data processing methods provided in the above-mentioned embodiments, the present disclosure also provides a data processing device. Since the data processing device provided in the embodiment of the present disclosure corresponds to the data processing methods provided in the above-mentioned embodiments, the implementation method of the data processing method is also applicable to the data processing device provided in this embodiment and will not be described in detail in this embodiment.
[0216] FIG33 is a schematic diagram of the structure of a data processing device 500 provided in an embodiment of the present disclosure. As shown in FIG33 , the device 500 may include: an acquisition module 510 for acquiring expression data and image data of a biological tissue sample, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data is obtained by capturing images of the sliced biological tissue sample; a calculation module 520 for calculating the expression data to obtain an expression map; an equalization module 530 for performing histogram equalization on the expression map and image data to obtain an image pair of the expression map and image data; and a registration module 540 for sequentially performing rigid registration and elastic registration on the image pair to generate contour data of the biological tissue sample, which is used to generate three-dimensional display data of the biological tissue sample.
[0217] According to the data processing device provided by the embodiment of the present disclosure, expression data and image data of a biological tissue sample are obtained, wherein the expression data are obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data are obtained by performing image acquisition on the biological tissue sample after slicing; the expression data are calculated to obtain an expression graph; the expression graph and the image data are histogram-equalized to obtain an image pair of the expression graph-image data; the image pair is rigidly aligned and elastically aligned in sequence to generate contour data of the biological tissue sample, and the contour data is used to generate three-dimensional display data of the biological tissue sample, thereby realizing the alignment of the spatiotemporal sequenced expression data with the tissue section image data, and obtaining auxiliary visualization information positioning of the internal and external tissue contours, effectively processing and displaying large-scale and high-resolution spatiotemporal group data, and promoting the research and application of three-dimensional spatiotemporal group technology.
[0218] In some embodiments, the registration module 540 is used to perform rigid registration on the image pair, including: downsampling the image pair respectively; extracting feature information of the image pair; and performing similarity estimation affine transformation on the image pair to obtain a rigid registration result.
[0219] In some embodiments, the registration module 540 is used to perform elastic registration on image pairs, including: performing histogram equalization on the rigid registration results; inputting the rigid registration results into a deep learning model, outputting the intermediate results of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training the expression graph-image data pairs; according to the deformation field, performing nearest neighbor interpolation transformation on the rigid registration results to obtain an elastic registration result.
[0220] In summary, according to the data processing method provided in the embodiment of the present disclosure, expression data and image data of a biological tissue sample are obtained, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slices, and the image data is obtained by performing image acquisition on the biological tissue sample after slicing; the expression data is calculated to obtain an expression graph; the expression graph and the image data are histogram-equalized to obtain an image pair of the expression graph-image data; the image pair is rigidly aligned and elastically aligned in sequence to generate contour data of the biological tissue sample, and the contour data is used to generate three-dimensional display data of the biological tissue sample. A registration method for spatiotemporal sequenced expression data and tissue section image data is provided. Application of this method can obtain internal and external tissue contours to assist in visualization information positioning, effectively process and display large-scale, high-resolution spatiotemporal group data, and promote the research and application of three-dimensional spatiotemporal omics technology.
[0221] In the embodiments provided above, the methods and devices provided in the embodiments of the present application are introduced. In order to implement the various functions of the methods provided in the embodiments of the present application, the electronic device may include a hardware structure and a software module, and implement the aforementioned functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. One of the aforementioned functions may be executed in the form of a hardware structure, a software module, or a hardware structure plus a software module.
[0222] Figure 34 is a block diagram of an electronic device 600 for implementing the above-mentioned data collection or data processing method according to an exemplary embodiment. For example, the electronic device 600 can be a mobile phone, a computer, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0223] 34 , the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 606 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .
[0224] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 602 may include one or more modules to facilitate interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.
[0225] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0226] The power supply assembly 606 provides power to the various components of the electronic device 600. The power supply assembly 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.
[0227] The multimedia component 606 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0228] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 604 or transmitted via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.
[0229] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.
[0230] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of components, such as the display and keypad of the electronic device 600. The sensor assembly 614 can also detect changes in the position of the electronic device 600 or a component of the electronic device 600, the presence or absence of user contact with the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and temperature changes of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0231] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (New Radio) or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0232] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
[0233] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, which can be executed by the processor 620 of the electronic device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0234] The embodiments of the present disclosure further provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the data acquisition or data processing method described in the above embodiments of the present disclosure.
[0235] An embodiment of the present disclosure further provides a computer program product, including a computer program, which executes the data collection or data processing method described in the above embodiments of the present disclosure when a processor is used.
[0236] An embodiment of the present disclosure also proposes a chip, which includes one or more interface circuits and one or more processors; the interface circuit is used to receive signals from the memory of the electronic device and send signals to the processor, the signals including computer instructions stored in the memory, and when the processor executes the computer instructions, the electronic device executes the data acquisition or data processing method described in the above embodiments of the present disclosure.
[0237] It should be noted that the terms "first," "second," and the like in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the numbers used in this manner are interchangeable where appropriate so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure as detailed in the appended claims.
[0238] Throughout this specification, references to terms such as "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" indicate that a specific feature, structure, material, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, illustrative uses of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
[0239] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention pertain.
[0240] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processing module, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection having one or more wires (control method), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing it in a suitable manner if necessary, and then storing it in a computer memory.
[0241] It should be understood that various parts of the embodiments of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0242] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.
[0243] Furthermore, the functional units in the various embodiments of the present invention may be integrated into a single processing module, each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in either hardware or software functional modules. If the integrated modules are implemented as software functional modules and sold or used as standalone products, they may also be stored in a computer-readable storage medium. The aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk, etc.
[0244] Although the embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are exemplary and are not to be construed as limitations on the present invention. A person skilled in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.
Claims
1. A data collection method, characterized in that: The method comprises: Slice the biological tissue sample and perform spatiotemporal group sequencing on the slice to obtain expression data; Capturing images of the sliced biological tissue sample to obtain image data; Registering the expression data and / or the image data to generate an outer layer contour and / or a partition contour of the biological tissue sample; Three-dimensional display data of the biological tissue sample is generated according to the outer layer contour and / or the partition contour.
2. The method according to claim 1, characterized in that The step of slicing the biological tissue sample and performing spatiotemporal group sequencing on the slice to obtain expression data includes: The biological tissue sample is sliced continuously, and spatiotemporal group sequencing is performed once for each first predetermined number of slices to obtain expression data of the slices, The first predetermined number is a positive integer.
3. The method according to claim 2, characterized in that The method further comprises: Preprocessing the expression data, The preprocessing includes at least one of aggregation processing, quality control, logarithmic normalization, finding highly variable genes, and dimensionality reduction processing.
4. The method according to any one of claims 1 to 3, characterized in that The step of collecting images of the sliced biological tissue sample to obtain image data includes: Each time a second predetermined number of slices are cut, an image acquisition is performed on the sliced biological tissue sample to obtain the image data, The second predetermined number is a positive integer.
5. The method according to any one of claims 1 to 4, characterized in that The registering the expression data and / or the image data to generate the outer contour and / or partition contour of the biological tissue sample includes: Performing image segmentation processing on the image data to generate a segmentation result graph; Registering the segmentation result map to generate a registration result map; Based on the registration result image, an outer contour of the biological tissue sample is generated.
6. The method according to claim 5, characterized in that The image segmentation processing of the image data comprises: The image data is converted into an HSV color space, the image data of the H channel is extracted and converted into a grayscale image; Binarizing the image data using a preset image processing algorithm to determine a binarization result contour map; The contour map that meets the preset conditions is retained and merged with the image data.
7. The method according to claim 6, characterized in that The method further comprises: Obtaining a grayscale image and a histogram of the image data; Performing maximum entropy threshold binarization processing on the image data; The processed image is merged with the image data.
8. The method according to any one of claims 5 to 7, characterized in that The registering the segmentation result map to generate a registration result map includes: Performing spatial transformation processing and linear interpolation algorithm processing on the segmentation result image; Perform mean square error similarity measurement on the processed segmentation result image and the registration reference image; The optimal measurement solution is determined as the registration result map.
9. The method according to claim 8, characterized in that Generating the outer contour of the biological tissue sample based on the registration result map includes: Stack all the registration result images into an array file of a preset format; The array file is processed to obtain the outer contour of the biological tissue sample.
10. The method according to any one of claims 5 to 9, characterized in that The registering the expression data and / or the image data to generate the outer contour and / or partition contour of the biological tissue sample includes: Calculating the expression data to obtain an expression graph; Performing histogram equalization on the expression level graph and the image data to obtain an image pair of expression level graph-image data; The image pair is sequentially subjected to rigid registration and elastic registration to generate the partition outline.
11. The method according to claim 10, characterized in that The rigid registration of the image pair comprises: Downsampling the image pairs respectively; extracting feature information of the image pair; A similarity estimation affine transformation is performed on the image pair to obtain a rigid registration result.
12. The method according to claim 11, characterized in that The elastic registration of the image pair comprises: Performing histogram equalization on the rigid registration result; Inputting the rigid registration result into a deep learning model, outputting an intermediate result of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training an expression graph-image data pair; According to the deformation field, the rigid registration result is subjected to nearest neighbor interpolation transformation to obtain an elastic registration result.
13. The method according to any one of claims 5 to 12, characterized in that The registering the expression data and / or the image data to generate the outer contour and / or partition contour of the biological tissue sample includes: Registering the expression data in two adjacent or close slices to obtain registered expression data; An outer layer contour and / or a partition contour of the biological tissue sample is generated according to the registered expression quantity data.
14. The method according to any one of claims 1 to 13, characterized in that Generating the three-dimensional display data of the biological tissue sample according to the outer layer contour and / or the partition contour comprises: Performing bioinformatics analysis on the registration results obtained by registering the expression data and / or the image data to obtain clustering and annotation results; Based on the clustering and annotation results, construct a three-dimensional array and add spatial scale information; A three-dimensional rendering tool is used to render and obtain three-dimensional display data of the biological tissue sample.
15. A data processing method, characterized in that: The method comprises: Acquiring expression data and image data of a biological tissue sample, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slice, and the image data is obtained by collecting images of the slicing biological tissue sample; Calculating the expression data to obtain an expression graph; Performing histogram equalization on the expression level graph and the image data to obtain an image pair of the expression level graph-image data; The image pair is sequentially subjected to rigid registration and elastic registration to generate contour data of the biological tissue sample, and the contour data is used to generate three-dimensional display data of the biological tissue sample.
16. The method according to claim 15, characterized in that The rigid registration of the image pair comprises: Downsampling the image pairs respectively; extracting feature information of the image pair; A similarity estimation affine transformation is performed on the image pair to obtain a rigid registration result.
17. The method according to claim 16, characterized in that The elastic registration of the image pair comprises: Performing histogram equalization on the rigid registration result; Inputting the rigid registration result into a deep learning model, outputting an intermediate result of the deep learning model, and obtaining a deformation field, wherein the deep learning model is obtained by training an expression graph-image data pair; According to the deformation field, the rigid registration result is subjected to nearest neighbor interpolation transformation to obtain an elastic registration result.
18. A data acquisition device, characterized in that: The device comprises: A sequencing module is used to slice biological tissue samples and perform spatiotemporal group sequencing on the slices to obtain expression data; An acquisition module is used to acquire images of the sliced biological tissue sample to obtain image data; A registration module, used for registering the expression data and / or the image data to generate an outer layer contour and / or a partition contour of the biological tissue sample; A generating module is used to generate three-dimensional display data of the biological tissue sample according to the outer layer contour and / or the partition contour.
19. A data processing device, characterized in that: The device comprises: An acquisition module, used to acquire expression data and image data of a biological tissue sample, wherein the expression data is obtained by slicing the biological tissue sample and performing spatiotemporal group sequencing on the slice, and the image data is obtained by performing image acquisition on the sliced biological tissue sample; A calculation module, used to calculate the expression data to obtain an expression graph; An equalization module, used for performing histogram equalization on the expression amount graph and the image data to obtain an image pair of the expression amount graph-image data; A registration module performs rigid registration and elastic registration on the image pair in sequence to generate contour data of the biological tissue sample, wherein the contour data is used to generate three-dimensional display data of the biological tissue sample.
20. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 17.
21. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-17.
22. A computer program product, characterized in that It comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 17.
23. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor, the signal includes a computer instruction stored in the memory, and when the processor executes the computer instruction, the electronic device executes the method described in any one of claims 1-17.
Citation Information
Patent Citations
Pipeline inner surface detection method and device based on three-dimensional point cloud
CN112581457A
Intraoperative ultrasonic image and contour real-time registration method and system thereof
CN113592925A
Gene expression image constructing method and gene expression image constructing system
US20100150414A1
Methods and Software For Creating a 3D Image From Images of Multiple Histological Sections and for Mapping Anatomical Information From a Reference Atlas to a Histological Image
US20180137689A1
Cited By
Parameter generation method and textile color fastness calculation method and system
CN120198515A
