Display method, computer device and storage medium

Abstract

This application relates to a display method, computer device, and storage medium. The method includes: acquiring segmentation results of a region of interest (ROI) in a brain image of a subject; the ROI is located on at least one target brain region in the brain image; determining a target region corresponding to the ROI in the brain region contour map based on the segmentation results of the ROI and a preset brain region contour map; the brain region contour map includes multiple brain regions; marking the target region in the brain region contour map, and displaying the marked brain region contour map in a first area of ​​a display interface. This method can save manpower and time in the image analysis process.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a display method, computer device, and storage medium. Background Technology

[0002] The brain governs all life activities in the human body and is also the material basis for human thought. When serious lesions occur in the brain regions, they will affect the normal life of the human body. Therefore, it is very necessary to identify and analyze brain lesions in a timely manner.

[0003] In related technologies, after a patient's brain image is taken, the doctor observes the image on a reading workstation and screens and analyzes the brain image by flipping through and comparing the images layer by layer, ultimately obtaining the analysis results of the brain image.

[0004] However, the above technologies are time-consuming and labor-intensive. Summary of the Invention

[0005] Therefore, it is necessary to provide a display method, computer equipment, and storage medium that can save manpower and time in the image analysis process to address the above-mentioned technical problems.

[0006] In a first aspect, this application provides a display method, the method comprising:

[0007] Obtain the segmentation results of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0008] Based on the segmentation results of the region of interest and the preset brain region contour map, the target region corresponding to the region of interest in the brain region contour map is determined; the brain region contour map includes multiple brain regions.

[0009] Mark the target region in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0010] In one embodiment, the segmentation result includes an identifier of the target brain region where the region of interest is located, and the brain region contour map further includes identifiers of multiple brain regions; determining the target region corresponding to the region of interest in the brain region contour map based on the segmentation result of the region of interest and the preset brain region contour map includes:

[0011] Matching is performed between the target brain region's identifier and the identifiers of multiple brain regions in the brain region contour map to obtain the matching identifier;

[0012] In the brain region contour map, the brain region corresponding to the matching label is identified as the target region.

[0013] In one embodiment, the method further includes:

[0014] Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region;

[0015] Based on the brain region contour map and the segmentation results of each brain region, each brain region in the brain image is marked.

[0016] Establish the linkage between each brain region in the labeled brain image and each first quantification result;

[0017] The labeled brain image is displayed in the second area of ​​the display interface, and the first quantification results are displayed in the third area of ​​the display interface.

[0018] In one embodiment, the method further includes:

[0019] The user's selection operation on the labeled brain image is obtained; the selection operation is used to represent the user's selection of candidate brain regions in the labeled brain image.

[0020] In response to the selection operation, the first quantification result corresponding to the candidate brain region is marked in the third region.

[0021] In one embodiment, displaying each of the first quantization results in the third area of ​​the display interface includes:

[0022] The first quantification result of each brain region, its corresponding location, and its name are treated as a single entry.

[0023] Save the first entry and display each entry in the third area of ​​the display interface.

[0024] In one embodiment, the brain region contour map includes brain region contour maps from different perspectives.

[0025] In one embodiment, the target region marked in the brain region contour map is used to characterize at least one of the following parameters of the target region: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and regions that change during follow-up.

[0026] In one embodiment, marking the target region in the brain region contour map includes:

[0027] By filling the target region with different colors or different grayscale values ​​in the brain region contour map, a labeled brain region contour map is obtained.

[0028] In one embodiment, the method further includes:

[0029] Obtain the second quantization result for the region of interest;

[0030] The second quantization result is displayed in the first area of ​​the display interface.

[0031] Secondly, this application also provides a display device. The device includes:

[0032] The segmentation result acquisition module is used to acquire the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0033] The target region determination module is used to determine the target region corresponding to the region of interest in the brain region contour map based on the segmentation results of the region of interest and the preset brain region contour map; the brain region contour map includes multiple brain regions.

[0034] The marker display module is used to mark target regions in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0035] Thirdly, this application also provides a computer device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0036] Obtain the segmentation results of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0037] Based on the segmentation results of the region of interest and the preset brain region contour map, the target region corresponding to the region of interest in the brain region contour map is determined; the brain region contour map includes multiple brain regions.

[0038] Mark the target region in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0039] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0040] Obtain the segmentation results of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0041] Based on the segmentation results of the region of interest and the preset brain region contour map, the target region corresponding to the region of interest in the brain region contour map is determined; the brain region contour map includes multiple brain regions.

[0042] Mark the target region in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0043] Fifthly, this application also provides a computer program product, comprising a computer program that, when executed by a processor, performs the following steps:

[0044] Obtain the segmentation results of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0045] Based on the segmentation results of the region of interest and the preset brain region contour map, the target region corresponding to the region of interest in the brain region contour map is determined; the brain region contour map includes multiple brain regions.

[0046] Mark the target region in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0047] The aforementioned display method, computer equipment, and storage medium, through the segmentation results of the region of interest (ROI) in the brain image of the subject and a preset brain region contour map including multiple brain regions, determine the target region corresponding to the ROI in the brain region contour map, mark the target region in the brain region contour map, and display the marked brain region contour map in a first area of ​​the display interface; wherein, the ROI is located on at least one target brain region in the brain image. In this method, because the ROI can be segmented, marked, and displayed in the brain region contour map, doctors can quickly analyze the ROI using the brain region contour map and obtain analysis results rapidly. This image analysis process eliminates the need for manual image review and comparison, thus saving manpower and time in image analysis and improving the efficiency of image analysis. Attached Figure Description

[0048] Figure 1 This is an internal structural diagram of a computer device in one embodiment;

[0049] Figure 2 This is a flowchart illustrating the method in one embodiment;

[0050] Figure 3 This is an example diagram showing the labeled target region where brain atrophy occurs in one embodiment;

[0051] Figure 4 This is an example diagram showing the labeled target region where brain region enlargement occurs in one embodiment;

[0052] Figure 5 Here is an example image of a dark version of a brain region outline in one embodiment;

[0053] Figure 6 This is an example diagram of a light-colored version of a brain region outline in one embodiment;

[0054] Figure 7 This is a flowchart illustrating the method in another embodiment;

[0055] Figure 8 This is a flowchart illustrating the method in another embodiment;

[0056] Figure 9 This is an example diagram illustrating the segmentation results of different brain regions in a brain image in one embodiment;

[0057] Figure 10 This is an example diagram showing the combined segmentation and quantization results of a brain image in one embodiment;

[0058] Figure 11 This is a flowchart illustrating the method in another embodiment;

[0059] Figure 12 An example diagram showing the labeling of quantification results for selected brain regions in one embodiment;

[0060] Figure 13 This is a structural block diagram of a display device in one embodiment. Detailed Implementation

[0061] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0062] The display method provided in this application embodiment can be applied to a computer device, which can be a server or a terminal. Taking a terminal as an example, its internal structure diagram can be as follows: Figure 1 As shown. The computer device includes a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a display method. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad located on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0063] Those skilled in the art will understand that Figure 1 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0064] In one embodiment, such as Figure 2 As shown, a display method is provided, which is applied to Figure 1 Taking a computer device as an example, the method may include the following steps:

[0065] S102, obtain the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image.

[0066] In this step, the brain image of the subject is first acquired and input into a brain region segmentation network for brain region segmentation. Segmentation results for each brain region are then obtained. Next, quantization calculations are performed on each brain region based on its segmentation results to obtain corresponding quantization results. These quantization results are compared with the standard quantization results for each brain region to identify abnormal brain regions. These abnormal brain regions are designated as regions of interest (ROIs), and their segmentation results are the segmentation results for these RIOs. If the quantization result of a brain region does not match its corresponding standard quantization result, that brain region is considered abnormal. The quantization results may include the calculated volume or thickness of the corresponding brain region, etc.

[0067] After obtaining the region of interest (ROI), its location within the brain region of the brain image can be determined. Specifically, the ROI is located on which abnormal brain regions in the brain image; these regions can be designated as target brain regions. This can be indicated by location or labeling. The ROI can be a lesion area, such as a region of brain atrophy or enlargement in the brain image. Furthermore, the method used to obtain the brain image of the subject is not specifically limited here.

[0068] S104. Based on the segmentation results of the region of interest and the preset brain region contour map, determine the target region corresponding to the region of interest in the brain region contour map; the brain region contour map includes multiple brain regions.

[0069] The preset brain region contour map is a two-dimensional brain region contour map, which can be a brain region contour template map including all the brain regions involved in the human body. This two-dimensional brain region contour map can be a brain region contour map from a single viewpoint or from multiple different viewpoints. The brain region contour map can be obtained by analyzing data on the brain region contours of a large number of normal individuals and then obtaining the brain region contour map through brain region modeling. Generally, the size of brain regions in people of different ages is similar; therefore, a set of corresponding brain region contour maps can also be set for each age group.

[0070] Specifically, after obtaining the segmentation results of the region of interest (ROI) as described above, the target brain region where the ROI is located can be identified, i.e., the abnormal brain region mentioned above. The target brain region is then compared with each brain region in a pre-defined brain region contour map to identify matching brain regions. This matching region is then identified as the target region in the pre-defined brain region contour map. Alternatively, the target region can be located by comparing its identifier or location with each brain region in the pre-defined brain region contour map.

[0071] S106, mark the target region in the brain region contour map, and display the marked brain region contour map in the first area of ​​the display interface.

[0072] In this step, after obtaining the target region corresponding to the region of interest in the brain contour map, the target region can be marked on the brain contour map. This can be achieved by highlighting, filling with different colors, filling with different grayscale values, or filling with different patterns. The marking here is mainly used to distinguish other unmarked areas in the brain. After marking the target region in the brain contour map, a marked brain contour map is obtained. Specifically, the target regions in the brain contour maps from all viewpoints are generally marked, and the same target regions in the brain contour maps from all viewpoints are marked in the same way, for example, all are highlighted with the same color.

[0073] When marking target regions in a brain region contour map, as an optional embodiment, the marked target regions in the brain region contour map are used to characterize at least one of the following parameters of the target region: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and areas that have changed during follow-up. After marking the target regions in the brain region contour map, doctors can quickly obtain relevant information about the regions of interest from the brain region contour map.

[0074] Specifically, the marking of target regions includes: volume or capacity, which can be used to indicate abnormalities in the volume or capacity of the target region, such as brain enlargement or atrophy; cortical thickness, which can be the average cortical thickness, which can be used to indicate abnormalities in the cortical thickness of the target region, such as the cortical thickness being too thin or too thick; cortical surface, which can be used to indicate abnormalities in the surface area of ​​the target region, such as the cortical surface area being too large or too small; cortical curvature, which can be the average cortical curvature, which can be used to indicate abnormalities in the cortical curvature of the target region, such as the cortical curvature being too large or too small; and areas showing changes during follow-up, which can be used to show changes in various indicators and other data of the target region between two follow-up visits, such as the volume or capacity of the target region increasing or decreasing.

[0075] After marking, the outline of the marked brain region will be displayed in the first area of ​​the display interface. See the example image for a specific display example. Figure 3 and Figure 4 As shown, where Figure 3 Example image showing the labeled target area where brain atrophy is observed. Figure 4 This is a labeled example image showing the target area of ​​brain region enlargement. The brain region contour map includes multiple example images from different perspectives, all of which are labeled. Brain atrophy refers to a brain parenchyma volume ratio below the reference level, while brain region enlargement refers to a cerebrospinal fluid cavity volume ratio above the reference level. The reference level refers to the parameters of a standard normal person. Furthermore, the aforementioned first region can be any area on the display interface or the entire display interface; its specific size and location can be set according to the actual situation and are not specifically limited here.

[0076] The number of regions of interest mentioned above can be multiple different regions of interest, each corresponding to a different target region in the brain region contour map. When marking in the brain region contour map, different marking methods can be used for different target regions, so that doctors can clearly and quickly understand the specific situation of each region of interest by viewing the marked brain region contour map, which facilitates the rapid acquisition of subsequent analysis results.

[0077] In the aforementioned display method, the target region of interest is determined based on the segmentation results of the region of interest in the brain image of the subject and a preset brain region contour map including multiple brain regions. The target region is then marked on the brain region contour map, and the marked brain region contour map is displayed in the first area of ​​the display interface. The region of interest is located on at least one target brain region in the brain image. Because the region of interest can be segmented, marked, and displayed on the brain region contour map in the brain image, doctors can quickly analyze the region of interest and obtain analysis results using the brain region contour map. This image analysis process eliminates the need for manual image review and comparison, thus saving manpower and time in image analysis and improving its efficiency.

[0078] The above embodiments mentioned that the brain region contour map can be multiple or a single brain region contour map. The following embodiments will specifically illustrate the case of multiple brain region contour maps.

[0079] In another embodiment, the brain region contour map described above includes brain region contour maps from different viewpoints. That is, a preset brain region contour. Figure 1 Typically, it can be a set of brain region contour maps, including multiple two-dimensional brain region contour maps from different perspectives. For example, it can include left brain region contour maps, right brain region contour maps, coronal brain region contour maps, sagittal brain region contour maps, and axial brain region contour maps. For instance, a left brain region contour map could include both left supracortical and subcortical brain region contour maps; a right brain region contour map could include both right supracortical and subcortical brain region contour maps; and a coronal brain region contour map could include only subcortical brain region contour maps.

[0080] When pre-setting brain region outlines, each brain region can be numbered to assign different identifiers or indexes. For color versions of brain region outlines, there can be dark and light versions; see [link to relevant documentation]. Figure 5 and 6 The images shown are example images of a dark version and a light version of the brain region outline map, respectively. In the dark and light versions, the outlines of each brain region and the background color of the entire brain region outline map are different. By setting different color schemes for the brain region outline map, it is possible to better adapt to different software interface designs, making the brain region outline map more compatible with the color scheme of the corresponding software interface, thus improving the user experience.

[0081] After setting different color schemes and numbering the brain region contour maps as described above, the relevant data of the brain region contour maps can be saved in SVG format. SVG stands for Scalable Vector Graphics, and this format has the characteristics of clear edges, small file size, and convenient transmission. Therefore, using SVG format to store brain region contour maps can more accurately and clearly save all the data of the brain region contour maps, which is convenient for subsequent use.

[0082] In this embodiment, by setting brain region contour maps from different perspectives, doctors can easily conduct comprehensive analysis using these maps, eliminating the need to flip through images. This significantly saves manpower and time, thereby improving image analysis efficiency. Furthermore, for junior doctors with limited clinical experience, this eliminates the need to compare multiple images to locate the region of interest, thus improving the accuracy of region-of-interest localization and subsequent image analysis.

[0083] The above embodiments mention that the corresponding target region can be determined in the brain region contour map through the segmentation results of the region of interest. It is mentioned that the determination can be made by means of markers or locations. Based on the above embodiments, the segmentation results include the markers of the target brain region where the region of interest is located, and the brain region contour map includes markers of multiple brain regions. The following embodiments will describe in detail how the process of determining the target region through markers is carried out.

[0084] In another embodiment, another display method is provided, based on the above embodiments, such as... Figure 7 As shown, the above S104 may include the following steps:

[0085] S202, Match the target brain region's identifier with the identifiers of multiple brain regions in the brain region contour map to obtain the matching identifier.

[0086] S204. In the brain region contour map, the brain region corresponding to the matched label is identified as the target region.

[0087] The identifier can be any combination of numbers, letters, or words. For example, it can be a number similar to the brain region outline diagram above, or it can be the actual name of each brain region, such as the hippocampus or amygdala.

[0088] Specifically, after obtaining the segmentation results of the region of interest, the identifier of the target brain region where the region of interest is located can be obtained. The identifier of the target brain region can be the identifier of one brain region or the identifier of multiple brain regions. Then, the identifier of the target brain region can be matched with the identifiers of each brain region in the brain region contour map. If the same identifier is obtained in the brain region contour map, the identifier of the matched target brain region can be obtained. Then, the brain region corresponding to the identifier of the matched target brain region in the brain region contour map can be identified as the target region and marked.

[0089] The above embodiments mention that target regions can be marked in brain region contour maps. The following embodiments will describe this process in detail.

[0090] In another embodiment, another display method is provided. Based on the above embodiments, marking the target region in the brain region contour map in S106 above may include the following steps:

[0091] By filling the target region with different colors or different grayscale values ​​in the brain region contour map, a labeled brain region contour map is obtained.

[0092] In this step, if the segmented regions of interest (ROIs) are multiple, each ROI will have a corresponding target region in the brain region contour map. Furthermore, the meanings displayed by different ROIs may differ, resulting in multiple sets of target regions. Different colors or grayscale values ​​can be assigned to the target regions corresponding to each ROI to distinguish them from other unlabeled brain regions. For example, as described above... Figure 3 The target region corresponding to brain atrophy can be marked in blue on the brain region contour map, as mentioned above. Figure 4 The target area corresponding to the enlarged brain region can be marked in red on the brain region outline map, while brain regions within the normal range will display the original color of the brain region outline map.

[0093] In addition, the different colors and different gray values ​​mentioned above can be filled in a gradient or in a jump pattern; no specific restrictions are made here.

[0094] Of course, the target regions corresponding to different regions of interest can be marked on the same brain region contour map. Alternatively, the target region corresponding to the first region of interest can be marked on a brain region contour map, and then the target region corresponding to the second region of interest can be marked again if the brain region contour map is not marked, and so on.

[0095] In this embodiment, by filling the target region with different colors or different gray values ​​in the brain region contour map, a labeled brain region contour map is obtained. This allows doctors to quickly understand the situation of different target regions through color or gray value, speeding up image analysis and thus effectively improving the efficiency of image analysis.

[0096] The above embodiments mention that each brain region can be segmented to obtain the segmentation results of each brain region, and further, the results can be displayed. The following embodiments will describe the display process in detail.

[0097] In another embodiment, another display method is provided, based on the above embodiments, such as... Figure 8 As shown, the above method may further include the following steps:

[0098] S302, Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region.

[0099] In this step, the obtained brain image can be input into a brain region segmentation network for segmentation processing, or the brain regions in the brain image can be segmented using image segmentation algorithms to obtain the segmentation results for each brain region.

[0100] Then, each brain region can be quantified to obtain the corresponding quantification results, which are all recorded as the first quantification results. The first quantification results here can include the volume or capacity of the corresponding brain region, the cortical thickness of the brain region, the cortical surface area of ​​the brain region, the cortical curvature of the brain region, the proportion of the whole brain, the asymmetry index, etc.

[0101] S304. Based on the brain regions in the brain region contour map and the segmentation results of each brain region, mark each brain region in the brain image.

[0102] In this step, the segmentation result of each brain region can usually be a segmented image of each brain region. After obtaining the segmentation result of each brain region in the brain image, the number of brain regions included in each person's brain is generally the same, and the specific brain regions are also corresponding. So here, we can find the corresponding brain region in the brain region contour map, and mark each brain region in the brain image in the same way as the marking method of the corresponding brain region in the brain region contour map, to obtain the segmentation result of each marked brain region.

[0103] For example, when marking brain region outlines, gradient colors can be used to fill them, such as gradient colors between adjacent brain regions. Similarly, the segmentation results of each brain region in the brain image can also be filled with the same gradient color.

[0104] For example, after obtaining the segmentation results of each brain region in a brain image, the segmentation results of each brain region can be marked with different colors according to the marking method of the corresponding brain region in the brain region outline map, so as to distinguish each brain region and facilitate doctors' observation and analysis. See also Figure 9 The image shown is an example of a labeled segmentation result of brain regions in a brain image of the subject under test. The first row, from left to right, shows examples of sagittal and coronal views, while the second row, from left to right, shows examples of transverse and three-dimensional views. By labeling the segmentation results of brain regions from different perspectives, doctors can quickly perform comprehensive analysis by combining multiple views, further improving the efficiency and accuracy of image analysis.

[0105] S306, Establish the linkage relationship between each brain region and each first quantification result in the labeled brain image.

[0106] In this step, after marking each brain region in the brain image using the segmentation results of each brain region, the first quantization result corresponding to each brain region can be obtained by quantizing the segmentation results of each brain region. Then, a correspondence and linkage relationship can be established between each brain region and its corresponding first quantization result, that is, a first quantization result will correspond to a brain region and its segmentation result.

[0107] S308, the labeled brain image is displayed in the second area of ​​the display interface, and the first quantification results are displayed in the third area of ​​the display interface.

[0108] In this step, after obtaining the segmentation results of each brain region and their corresponding first quantization results, and establishing the linkage relationship, the segmentation map of each brain region from multiple perspectives can be displayed in the second area of ​​the display interface, while the first quantization result of each brain region can be displayed in the third area of ​​the display interface.

[0109] As an optional embodiment, when displaying the first quantization results corresponding to each brain region in the third area of ​​the display interface, the first quantization result of each brain region, its corresponding location, and its name can be treated as an entry; the first entry is saved, and each entry is displayed in the third area of ​​the display interface. Here, the location of each brain region mainly refers to its position in the left or right hemisphere, and the name can be the name of a substructure of the brain region, such as the hippocampus or amygdala. Specifically, the labeling method, location, name, and corresponding first quantization result of each brain region can be treated as an entry, saved, and displayed in the third area. To avoid limitations in the display area size, the display of each entry can also be achieved through page turning or other methods.

[0110] For example, see Figure 10As shown, the second and third regions do not belong to the same region as the first region of the brain region outline map displayed above. For example, the middle of the interface can be designated as the second region, the upper part next to the middle as the third region, and the lower part next to the middle as the first region. To facilitate observation and analysis by doctors, the second and third regions can be set relatively close together, and the second region displaying the segmentation map can be set to a larger size. For the third region displaying the quantification results, the classification of brain regions can be displayed first, that is, all brain regions and each brain region can be displayed first, and then the substructures of each brain region and their quantification results can be displayed. In addition, the display interface can also provide options for data export and report generation for user use.

[0111] In this embodiment, by establishing a linkage between the segmentation results of each brain region in the acquired brain image and their corresponding first quantification results, and displaying them in different areas of the display interface, doctors can easily observe and analyze the segmentation results in conjunction with the quantification results, so as to quickly obtain analysis results and improve the efficiency of obtaining analysis results.

[0112] The above embodiments mention the ability to establish and display the linkage relationship between the brain region segmentation results and quantification results. The following embodiments will explain how to use the linkage relationship.

[0113] In another embodiment, another display method is provided, based on the above embodiments, such as... Figure 11 As shown, the above method may further include the following steps:

[0114] S402, Obtain the user's selection operation on the labeled brain image; the selection operation is used to represent the user's selection of candidate brain regions in the labeled brain image.

[0115] S404, in response to the selection operation, marks the first quantization result corresponding to the candidate brain region in the third region.

[0116] In this embodiment, if a user needs to view the correlation between the quantization result and the segmentation result of any brain region, they can perform a selection operation in the labeled brain image. This selection operation means that the user selects the brain region to be viewed from the segmentation map of each brain region in the brain image. After the user makes the selection, the computer device can obtain the candidate brain region selected by the user and the operation to be performed. Subsequently, the computer device can obtain the corresponding first quantization result through the linkage or correspondence relationship of the candidate brain region selected by the user, and mark the corresponding first quantization result in the third area displaying the first quantization result, so that doctors or users can easily and quickly correlate and view the segmentation result and quantization result of the candidate brain region.

[0117] Here, the first quantization result corresponding to the selected brain region is marked within the third region. This can be done by highlighting, selecting the first quantization result by drawing a bounding box, or marking the entire first quantization result with a bounding box, etc. For example, see... Figure 12 As shown, the first quantization result can be marked by setting a marker box for the whole result.

[0118] In addition, the user can select the desired brain region by clicking the desired area in the segmentation map with the mouse.

[0119] In this embodiment, by acquiring the user's selection operation on the brain region segmentation results and responding to the operation to mark and display the corresponding first quantification result, doctors or users can quickly match the segmentation results and quantification results of candidate brain regions and view them, thereby improving the accuracy and efficiency of image analysis.

[0120] The above embodiments mentioned that the target region corresponding to the region of interest can be marked and displayed in the brain region contour map. The following embodiments will explain the process of also displaying the quantification results of the region of interest.

[0121] In another embodiment, another display method is provided. Based on the above embodiments, the method may further include the following steps:

[0122] Obtain the second quantization result for the region of interest and display the second quantization result in the first area of ​​the display interface.

[0123] In this step, after obtaining the segmentation results of the region of interest, the segmentation results of the region of interest can be quantified to obtain the second quantization result corresponding to the region of interest. The second quantization result can include the volume or capacity, cortical thickness, cortical surface area, cortical curvature, and whole brain percentage obtained by calculating the region of interest.

[0124] After obtaining the second quantification result of the region of interest (ROI), this result can be displayed within the first region containing the brain region contour map of the target region corresponding to the ROI. To avoid limitations in the display area size, the display can be done by switching tabs. For example, switching to the Brain Region Overview tab will display the brain region contour map of the target region under that tab; switching to the Quantification Result Display tab for the ROI will display the second quantification result corresponding to the ROI under that tab; or the follow-up curve of the ROI (i.e., the change of the quantification result of the ROI during multiple follow-ups), the MTA score of the ROI or each brain region, brain region patterns, etc., can also be displayed.

[0125] In this embodiment, by obtaining the second quantification result of the region of interest and displaying the second quantification result in the first area of ​​the display interface, doctors can quickly obtain the quantification result of the region of interest, make timely analysis results, and further improve the accuracy and efficiency of obtaining analysis results.

[0126] It should be noted that the above Figure 3 , 4 The display interfaces for numbers 5, 6, 9, 10, and 12 are merely examples, and the lines and other elements therein do not affect the substantive content of the embodiments of this application.

[0127] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0128] Based on the same inventive concept, this application also provides a display device for implementing the display method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more display device embodiments provided below can be found in the limitations of the display method described above, and will not be repeated here.

[0129] In one embodiment, such as Figure 13 As shown, a display device is provided, including: a segmentation result acquisition module 11, a target region determination module 12, and a marker display module 13, wherein:

[0130] The segmentation result acquisition module 11 is used to acquire the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image;

[0131] The target region determination module 12 is used to determine the target region corresponding to the region of interest in the brain region contour map based on the segmentation result of the region of interest and the preset brain region contour map; the brain region contour map includes multiple brain regions.

[0132] The marker display module 13 is used to mark the target region in the brain region contour map and display the marked brain region contour map in the first area of ​​the display interface.

[0133] Optionally, the marker display module 13 described above may include:

[0134] Filling units are used to obtain labeled brain region contour maps by filling target regions with different colors or different grayscale values ​​in the brain region contour map.

[0135] In another embodiment, another display device is provided, wherein the segmentation result includes an identifier of the target brain region where the region of interest is located, and the brain region contour map further includes identifiers of multiple brain regions; based on the above embodiment, the target region determination module 12 includes:

[0136] The matching unit is used to match the identifier of the target brain region with the identifiers of multiple brain regions in the brain region contour map to obtain the matching identifier;

[0137] The target region determination unit is used to identify the brain region corresponding to the matching label as the target region in the brain region contour map.

[0138] In another embodiment, another display device is provided, which may further include, based on the above embodiments, the following:

[0139] The first quantization result acquisition module is used to acquire the segmentation results of each brain region in the brain image and the first quantization result of each brain region;

[0140] The brain region labeling module is used to label each brain region in the brain image based on the brain region contour map and the segmentation results of each brain region.

[0141] A module is established to establish the linkage relationship between each brain region and each first quantization result in the labeled brain image;

[0142] The results display module is used to display the labeled brain image in the second area of ​​the display interface and to display each first quantification result in the third area of ​​the display interface.

[0143] Optionally, the above result display module may include:

[0144] The entry determination unit is used to treat the first quantification result of each brain region, its corresponding location, and its name as an entry;

[0145] The item saving and display unit is used to save the first item and display each item in the third area of ​​the display interface.

[0146] In another embodiment, another display device is provided, which may further include, based on the above embodiments, the following:

[0147] The selection operation acquisition module is used to acquire the user's selection operation on the labeled brain image; the above selection operation is used to represent the user's selection of candidate brain regions in the labeled brain image;

[0148] The response module is used to mark the first quantization result corresponding to the candidate brain region in the third region in response to the selection operation.

[0149] In another embodiment, another display device is provided, which may further include, based on the above embodiments, the following:

[0150] The second quantization result acquisition module is used to acquire the second quantization result of the region of interest.

[0151] The second quantization result display module is used to display the second quantization result in the first area of ​​the display interface.

[0152] Each module in the aforementioned display device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0153] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0154] Obtain the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image; based on the segmentation result of the region of interest and the preset brain region contour map, determine the target region corresponding to the region of interest in the brain region contour map; the brain region contour map includes multiple brain regions; mark the target region in the brain region contour map, and display the marked brain region contour map in the first area of ​​the display interface.

[0155] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0156] The target brain region is matched with the labels of multiple brain regions in the brain region contour map to obtain the matching labels; in the brain region contour map, the brain region corresponding to the matching label is determined as the target region.

[0157] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0158] Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region; mark each brain region in the brain image according to the brain region contour map and the segmentation results of each brain region; establish the linkage relationship between each brain region in the marked brain image and each first quantization result; display the marked brain image in the second area of ​​the display interface and display each first quantization result in the third area of ​​the display interface.

[0159] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0160] The user's selection operation on the labeled brain image is obtained; the selection operation is used to characterize the user's selection of candidate brain regions in the labeled brain image; in response to the selection operation, the first quantization result corresponding to the candidate brain region is labeled in the third region.

[0161] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0162] The first quantification result of each brain region, along with its corresponding location and name, is recorded as an entry; the first entry is saved, and each entry is displayed in the third area of ​​the display interface.

[0163] In one embodiment, the brain region contour map includes brain region contour maps from different perspectives.

[0164] In one embodiment, the target region marked in the brain region contour map is used to characterize at least one of the following parameters of the target region: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and regions that change during follow-up.

[0165] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0166] By filling the target region with different colors or different grayscale values ​​in the brain region contour map, a labeled brain region contour map is obtained.

[0167] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0168] Obtain the second quantization result for the region of interest; display the second quantization result within the first area of ​​the display interface.

[0169] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0170] Obtain the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image; based on the segmentation result of the region of interest and the preset brain region contour map, determine the target region corresponding to the region of interest in the brain region contour map; the brain region contour map includes multiple brain regions; mark the target region in the brain region contour map, and display the marked brain region contour map in the first area of ​​the display interface.

[0171] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0172] The target brain region is matched with the labels of multiple brain regions in the brain region contour map to obtain the matching labels; in the brain region contour map, the brain region corresponding to the matching label is determined as the target region.

[0173] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0174] Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region; mark each brain region in the brain image according to the brain region contour map and the segmentation results of each brain region; establish the linkage relationship between each brain region in the marked brain image and each first quantization result; display the marked brain image in the second area of ​​the display interface and display each first quantization result in the third area of ​​the display interface.

[0175] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0176] The user's selection operation on the labeled brain image is obtained; the selection operation is used to characterize the user's selection of candidate brain regions in the labeled brain image; in response to the selection operation, the first quantization result corresponding to the candidate brain region is labeled in the third region.

[0177] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0178] The first quantification result of each brain region, along with its corresponding location and name, is recorded as an entry; the first entry is saved, and each entry is displayed in the third area of ​​the display interface.

[0179] In one embodiment, the brain region contour map includes brain region contour maps from different perspectives.

[0180] In one embodiment, the target region marked in the brain region contour map is used to characterize at least one of the following parameters of the target region: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and regions that change during follow-up.

[0181] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0182] By filling the target region with different colors or different grayscale values ​​in the brain region contour map, a labeled brain region contour map is obtained.

[0183] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0184] Obtain the second quantization result for the region of interest; display the second quantization result within the first area of ​​the display interface.

[0185] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0186] Obtain the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image; based on the segmentation result of the region of interest and the preset brain region contour map, determine the target region corresponding to the region of interest in the brain region contour map; the brain region contour map includes multiple brain regions; mark the target region in the brain region contour map, and display the marked brain region contour map in the first area of ​​the display interface.

[0187] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0188] The target brain region is matched with the labels of multiple brain regions in the brain region contour map to obtain the matching labels; in the brain region contour map, the brain region corresponding to the matching label is determined as the target region.

[0189] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0190] Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region; mark each brain region in the brain image according to the brain region contour map and the segmentation results of each brain region; establish the linkage relationship between each brain region in the marked brain image and each first quantization result; display the marked brain image in the second area of ​​the display interface and display each first quantization result in the third area of ​​the display interface.

[0191] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0192] The user's selection operation on the labeled brain image is obtained; the selection operation is used to characterize the user's selection of candidate brain regions in the labeled brain image; in response to the selection operation, the first quantization result corresponding to the candidate brain region is labeled in the third region.

[0193] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0194] The first quantification result of each brain region, along with its corresponding location and name, is recorded as an entry; the first entry is saved, and each entry is displayed in the third area of ​​the display interface.

[0195] In one embodiment, the brain region contour map includes brain region contour maps from different perspectives.

[0196] In one embodiment, the target region marked in the brain region contour map is used to characterize at least one of the following parameters of the target region: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and regions that change during follow-up.

[0197] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0198] By filling the target region with different colors or different grayscale values ​​in the brain region contour map, a labeled brain region contour map is obtained.

[0199] In one embodiment, when the computer program is executed by a processor, it further performs the following steps:

[0200] Obtain the second quantization result for the region of interest; display the second quantization result within the first area of ​​the display interface.

[0201] It should be noted that the data involved in this application (including but not limited to data used for analysis, stored data, and displayed data) are all information and data authorized by the user or fully authorized by all parties.

[0202] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0203] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0204] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A display method, characterized in that, The method includes: Obtain the segmentation result of the region of interest in the brain image of the subject to be tested; the region of interest is located on at least one target brain region in the brain image; the region of interest includes brain regions in the brain image of the subject to be tested that show abnormalities; Based on the segmentation results of the region of interest and the preset brain region contour map, the target region corresponding to the region of interest in the brain region contour map is determined; the brain region contour map includes multiple brain regions; the preset brain region contour map is a brain region contour template map obtained by data analysis of the brain region contour of normal people and brain region modeling, which includes various brain regions involved in the human body; the brain region contour map includes brain region contour maps from different perspectives. The target region is marked in the brain region contour map, and the brain region contour map from different perspectives after marking is displayed in the first area of ​​the display interface; The segmentation result includes an identifier of the target brain region where the region of interest is located, and the brain region contour map also includes identifiers of multiple brain regions; determining the target region corresponding to the region of interest in the brain region contour map based on the segmentation result of the region of interest and the preset brain region contour map includes: Matching is performed between the identifier of the target brain region and the identifiers of multiple brain regions in the brain region contour map to obtain a matching identifier; In the brain region contour map, the brain region corresponding to the matched identifier is determined as the target region; The method further includes: Obtain the segmentation results of each brain region in the brain image and the first quantization result of each brain region; Based on the brain regions in the brain region contour map and the segmentation results of each brain region, each brain region in the brain image is marked; Establish the linkage relationship between each brain region in the labeled brain image and each of the first quantification results; The labeled brain image is displayed in a second area of ​​the display interface, and each of the first quantification results is displayed in a third area of ​​the display interface.

2. The method according to claim 1, characterized in that, The method further includes: Acquire user selection operations on the labeled brain image; the selection operations are used to characterize user selection of candidate brain regions in the labeled brain image; In response to the selection operation, the first quantification result corresponding to the candidate brain region is marked in the third region.

3. The method according to claim 1, characterized in that, Displaying each of the first quantization results in the third area of ​​the display interface includes: The first quantification result of each brain region, its corresponding location, and its name are recorded as an entry; The entries are saved and each entry is displayed in the third area of ​​the display interface.

4. The method according to claim 1, characterized in that, The target regions marked in the brain region contour map are used to characterize at least one of the following parameters of the target regions: volume or capacity, cortical thickness, cortical surface area, cortical curvature, and regions that change during follow-up.

5. The method according to claim 1, characterized in that, Marking the target region in the brain region contour map includes: In the brain region contour map, the target region is marked with a different color; the color of the target region is different from the color of the brain region contour map. The step of marking the target regions with different colors includes: marking the target regions corresponding to brain atrophy as blue, and / or marking the target regions corresponding to brain enlargement as red.

6. The method according to claim 1, characterized in that, The method further includes: Obtain the second quantization result of the region of interest; The second quantization result is displayed in the first area of ​​the display interface.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images