Methods for displaying medical images and readable storage media

Abstract

This invention discloses a method for displaying medical images and a readable storage medium, belonging to the field of computer image processing. The display method includes the following steps: in response to interface operations, constructing multiple sub-windows under the same window, and constructing at least one sub-display area in each of the multiple sub-windows, wherein the multiple sub-windows do not overlap and display registered magnetic resonance images of different modalities; displaying a preset section layer of at least one type of anatomical view from the registered magnetic resonance images of the same modality in at least one sub-display area of ​​the same sub-window; in response to interface operations on the multiple sub-windows, updating the section index global variable in the global parameter pool, and updating the section layer displayed in each of the at least one sub-display areas according to the updated section index global variable.

Description

Technical Field

[0001] This invention relates to the field of computer image processing, and in particular to a method for displaying medical images and a readable storage medium. Background Technology

[0002] In the diagnosis of brain diseases, medical professionals typically need to review different modalities of MRI images to help identify lesions. This is because different modalities of MRI images convey unique information about the structure and function of the human brain, allowing medical professionals to observe more intuitively and three-dimensionally, providing rich imaging information for identifying lesions.

[0003] During their work, medical professionals need to review multiple modalities of magnetic resonance imaging (MRI) images (hereinafter referred to as "image reading") to aid in comprehensive analysis and obtain more complementary and comprehensive information. However, existing image reading software suffers from at least one of the following drawbacks: First, because it cannot load multiple images in the same window, medical professionals must switch between multiple windows to view the corresponding modalities of MRI images. This is especially problematic when dealing with patients with complex conditions, requiring repeated comparisons of images from different modalities to pinpoint lesions, making cross-modal image reading extremely inconvenient. Second, because the image spaces of the same patient's multimodal MRI images are inconsistent—that is, the same brain region may be located differently in different modalities on the same section—the brain region's position may shift. Furthermore, sometimes the inconsistent view scales in different modalities necessitate adjustments such as image stretching to resize the images, resulting in significant image distortion and adding further difficulty to the work of medical professionals, such as in lesion location identification and analysis.

[0004] In recent years, brain medical indicators based on fMRI data analysis, such as amplitude of low-fequency fluctuation (ALFF), regional homogeneity (ReHo), and degree centrality (DC), have been proven to be highly effective in diagnosing various diseases, including glioma, encephalitis, Parkinson's disease, schizophrenia, and epilepsy. However, due to the complex calculation process, low degree of automation, and significant need for manual intervention, these indicators are rarely used in actual clinical diagnosis.

[0005] Therefore, it is indeed necessary to provide a new display method and a readable storage medium. Summary of the Invention

[0006] To address at least one of the aforementioned problems and deficiencies in the prior art, the present invention provides a method for displaying medical images and a readable storage medium, which can at least partially enable the loading of multiple images in the same window to facilitate medical workers' image reading, and can enable images in different modalities to be linked together during cross-modal image reading so that medical workers can efficiently locate lesions on medical images.

[0007] According to one aspect of the present invention, a method for displaying medical images is provided, the method comprising the following steps:

[0008] In response to the interface operation, step S1 constructs multiple sub-windows under the same window, and at least one sub-display area is constructed in each of the multiple sub-windows. The multiple sub-windows do not overlap with each other and display registered magnetic resonance images of different modalities. At least one sub-display area in the same sub-window displays a preset section layer of at least one type of anatomical view in the registered magnetic resonance images of the same modality.

[0009] In response to the interface operations on the plurality of sub-windows, step S2 updates the global variable of the aspect index in the global parameter pool, and updates the aspect layer displayed in each of the at least one sub-display areas according to the updated global variable of the aspect index.

[0010] According to another aspect of the present invention, a storable medium is provided, wherein a program or instructions are stored on the readable storage medium, which, when executed by a processor, performs the above-described method for displaying medical images.

[0011] The method for displaying medical images and the readable storage medium according to embodiments of the present invention have at least one of the following advantages:

[0012] (1) The medical image display method and readable storage medium provided by the present invention can load images in multiple registered modalities in the same window, which solves the problem of medical workers switching between multiple windows to view multimodal images, thereby making it more convenient for medical workers to view images and improving the efficiency of medical workers to view images.

[0013] (2) The medical image display method and readable storage medium provided by the present invention realize the interaction between images in different modalities during cross-modal image reading through the design of a global parameter pool and an event listening unit, so as to facilitate the viewing of image information at the same position in images of different modalities;

[0014] (3) The medical image display method and readable storage medium provided by the present invention, through the design of dragging the cross-section layer at the same time, enable medical workers to display the magnified view of the suspected lesion in the same window when locating the lesion, and display different modalities and the same type of anatomical view, reducing the inconvenience of repeatedly looking up different modal images and improving the work efficiency of medical workers.

[0015] (4) The medical imaging display method and readable storage medium provided by the present invention solve the problem of inconsistent size and position of the same brain region in different modalities by registering and projecting multimodal magnetic resonance image data into the same template space;

[0016] (5) The medical image display method and readable storage medium provided by the present invention can automatically calculate medical indicators when the user uploads resting-state functional magnetic resonance image data, and register the medical indicators from the resting-state functional magnetic resonance image space where they are located and project them to the template space.

[0017] (6) The medical image display method and readable storage medium provided by the present invention can clearly and accurately display medical indicators on images of various modalities by adding a layered display function. Attached Figure Description

[0018] These and / or other aspects and advantages of the present invention will become apparent and readily understood from the following description of preferred embodiments taken in conjunction with the accompanying drawings, in which:

[0019] Figure 1 This is a flowchart of a method for displaying medical images according to an embodiment of the present invention;

[0020] Figure 2a yes Figure 1 A schematic diagram of the same viewport shown;

[0021] Figure 2b It is based on Figure 1 The diagram shown illustrates a 6-modal, 1-class anatomical view.

[0022] Figure 2c It is based on Figure 1 The diagram shown illustrates the 3-modal, 3-class anatomical view displayed by the method shown.

[0023] Figure 3 yes Figure 1 The flowchart for step 2 is shown. Detailed Implementation

[0024] The technical solution of the present invention will be further described in detail below through embodiments and in conjunction with the accompanying drawings. In this specification, the same or similar reference numerals indicate the same or similar components. The following description of the embodiments of the present invention with reference to the accompanying drawings is intended to explain the overall inventive concept of the present invention and should not be construed as a limitation thereof.

[0025] See Figure 1 This illustrates a method for displaying medical images according to an embodiment of the present invention. The display method includes the following steps:

[0026] In response to the interface operation, step S1 constructs multiple sub-windows under the same window, and at least one sub-display area is constructed in each of the multiple sub-windows. The multiple sub-windows do not overlap with each other and display registered magnetic resonance images of different modalities. At least one sub-display area in the same sub-window displays a preset section layer of at least one type of anatomical view in the registered magnetic resonance images of the same modality.

[0027] In response to the interface operations on the plurality of sub-windows, step S2 updates the global variable of the aspect index in the global parameter pool, and updates the aspect layer displayed in each of the at least one sub-display areas according to the updated global variable of the aspect index.

[0028] In one example, the medical image display method provided by this invention is applicable to viewing images obtained through multimodal magnetic resonance imaging; it is also applicable to viewing CT images, ultrasound images, etc. Those skilled in the art can also use the medical image display method provided by this invention to simultaneously display any combination of images, such as magnetic resonance imaging images, CT images, and ultrasound images. This example is merely illustrative and should not be construed as a limitation of the invention.

[0029] The term "multimodal magnetic resonance imaging" as used in this article should be broadly understood as the use of weighted imaging modes with multiple pulse sequences in magnetic resonance imaging to comprehensively analyze the morphology and functional status of the examined site.

[0030] The term "coronal plane" as used in this article can be broadly understood as a plane passing through the human body along its vertical and horizontal axes, dividing the body into two equidistant halves. The term "axial plane" can be broadly understood as a plane with the height of the human body as its normal, dividing the body into two equidistant halves. The term "sagittal plane" can be broadly understood as a plane passing through the human body along its vertical and longitudinal axes, dividing the body into two equidistant halves.

[0031] The term "section layer" as used in this article should be understood as all layers in the magnetic resonance imaging data of the human head that are parallel to any one of the coronal, sagittal, or axial planes of the human body.

[0032] Any term “section layer” used in this article may be considered synonymous with the more general term “image data”.

[0033] Any terms used in this article, such as “coronal view,” “axial view,” and “sagittal view,” may be considered synonymous with the more general term “anatomical view.”

[0034] Combination Figure 2a As shown, a display area 10 is provided in the window 100, and the display area 10 includes a first sub-window 11, a second sub-window 12, and a third sub-window 13. Each sub-window is provided with a first sub-display area 111, a second sub-display area 112, and a third sub-display area 113. In one example, the first sub-window 11 displays the T1-weighted imaging (T1WI) mode of magnetic resonance imaging, the second sub-window 12 displays the T2-weighted imaging (T2WI) mode of magnetic resonance imaging, and the third sub-window 13 displays the diffusion-weighted imaging (DWI) mode of magnetic resonance imaging.

[0035] In one example, the image displayed in the first sub-window 11 can also be T2WI or DWI, the image displayed in the second sub-window 12 can also be T1WI or DWI, and the image displayed in the third sub-window 13 can also be T1WI or T2WI. The order in which the images are displayed in the first, second, and third sub-windows is not limited to this; the image display order and modal display order can be determined based on the user's selection on the interface. Those skilled in the art can also display diffusion tensor imaging (DTI), perfusion imaging, and other modalities in the first sub-window 11, second sub-window 12, and third sub-window 13. This example is merely illustrative.

[0036] In one example, the number of sub-windows can be equal to the number of modalities of image data selected by the user for display. That is, when the user selects one modality, there is one sub-window; when the user selects three modalities, there are three sub-windows. Of course, those skilled in the art can design the number of sub-windows to be unequal to the number of modalities to be displayed. For example, when the user selects two modalities, there can be two sub-windows, or even three. The two modalities to be displayed are then selected from two of the three sub-windows for display. Those skilled in the art can choose the appropriate design according to actual needs, as long as the image data of the modalities to be displayed can be displayed simultaneously.

[0037] In one example, the anatomical views displayed in each sub-display area within the same sub-window are different from each other. The types of anatomical views include coronal, sagittal, and axial views. That is, when the user selects one type of anatomical view (e.g., coronal view), the selected coronal view is displayed in a sub-display area within the sub-window; when the user selects two types of anatomical views, both, for example, coronal and sagittal views are displayed simultaneously within the same sub-window, and the coronal and sagittal views are displayed in different sub-display areas within the same sub-window. In other words, the coronal and sagittal views are displayed separately in two different sub-display areas within the sub-window. If the user selects sagittal and axial views respectively, the sagittal and axial views are displayed in different sub-display areas. Similarly, when the user selects three types of anatomical views, the coronal, axial, and sagittal views are displayed in three different sub-display areas within the same sub-window. Alternatively, the number of sub-display areas can be determined based on the type of anatomical view to be displayed. When the user selects type 1 for the anatomical view, the number of sub-display areas can be designed as one, two, or three. When two or three sub-display areas are selected, the anatomical view to be displayed can be shown in one of them. When two types of anatomical views are selected, the number of sub-display areas can be designed as two, three, or more, as long as the selected two types of anatomical views can be displayed in their respective areas.

[0038] In one example, a user can interact with the interface using input devices such as a mouse, keyboard, or touch panel to select the modality and anatomical type of the image data to be loaded and displayed, for example, in a menu bar area or list area.

[0039] In one example, step S1 further includes:

[0040] Step S11: When the user selects the modality and anatomical type of the desired magnetic resonance imaging (MRI) image on the interface (e.g., GUI) via an input device (e.g., a mouse or touch panel), triggering an event, an operation event listener detects the trigger event and requests the corresponding MRI image data based on it. The server (e.g., a cloud server or a local server) then responds to the request based on the requested data instruction. The server retrieves the requested data (i.e., the registered MRI image data) from, for example, a database or dataset based on the file address and unique identifier of the MRI image in the request, and transmits it to the operation event listener.

[0041] In step S12, the operation event listening program, based on the number of modalities of the magnetic resonance image selected by the user (e.g., the controller sends an instruction to the operation event listening program to divide the display area of ​​the window), divides the display area 10 under window 100 into sub-windows matching the number of modalities to be displayed. Simultaneously, based on the number of anatomical view types to be displayed within the same modality, the same sub-window is divided into sub-display areas matching the number of anatomical view types. Through the design of multiple sub-windows, images from multiple registered modalities can be loaded into the same window, solving the problem of medical workers switching between multiple windows to view multimodal images. Furthermore, the sub-display area design allows for viewing different anatomical views of the same modality within the same sub-window, and / or viewing the same anatomical view of different modalities in different sub-windows, thereby making image reading more convenient for medical workers and improving their efficiency.

[0042] For example, when a user selects one modality of three anatomical views, the display area 10 of window 100 is divided into one sub-window based on the number of modalities. Simultaneously, based on the three types of anatomical views, this sub-window is further divided into three sub-display areas, such as a first sub-display area 111, a second sub-display area 112, and a third sub-display area 113. The selected three anatomical types are then displayed in their respective sub-display areas.

[0043] In one example, the type of anatomical view displayed in a sub-display area can be determined based on the order in which the user selects the anatomy type. For instance, if the user selects the coronal view, sagittal view, and axial view in sequence, the coronal view is displayed in the first sub-display area 111, the sagittal view in the second sub-display area 112, and the axial view in the third sub-display area 113. Of course, those skilled in the art can also design it in reverse order; for example, the third sub-display area displays the first selected anatomical view, while the first sub-display area displays the last selected anatomical view. Alternatively, the type of anatomical view displayed in each sub-display area can be fixed. For example, the coronal view is fixed to be displayed in the first sub-display area, and no anatomical view is displayed in the first sub-display area when the user does not select a coronal view, and so on. Further details will not be elaborated here.

[0044] In one example, the boundary of each sub-window in the display area can be determined based on the number of modalities selected by the user. For instance, when the user selects two modalities, the display area 10 is divided into two sub-windows, left and right. In one example, the display area 10 can be divided into two equal sub-windows. The leftmost boundary of the left sub-window can be designed starting from, for example, 2cm from the leftmost boundary of the display area, and the rightmost boundary of the right sub-window can be designed starting from, for example, 2cm from the rightmost boundary of the display area. Then, the display area between the leftmost boundary of the left sub-window and the rightmost boundary of the right sub-window is divided into two equal parts. Similarly, the positions of the boundaries of each sub-window can be determined when the display area is divided into 1, 3, 6, etc. sub-windows, which will not be elaborated further here.

[0045] In one example, when the number of modalities selected by the user is 1, the display area 10 of the window is designed as one sub-window, and the sub-window is divided into 3 sub-display areas proportionally. When the number of modalities selected by the user, n, is in the range of 2 ≤ n ≤ 3, the display area 10 is divided into 3 sub-windows proportionally, and 3 types of anatomical views are displayed in each sub-window according to the user's selection. Of course, 1 type of anatomical view or 2 types of anatomical view can also be displayed. When the number of modalities selected by the user, n, is in the range of 4 ≤ n ≤ 6, the display area 10 is divided into 6 sub-windows proportionally, and 1 to 3 types of anatomical views are displayed in each sub-window according to the user's selection. Preferably, 1 type of anatomical view is displayed. When the number of modalities selected by the user, n, is less than the number of sub-windows pre-designed above, for example, when the number of modalities is 2, the display area is divided into 3 sub-windows, then the extra sub-windows can be designed as empty. By designing multiple sub-windows, it is possible to load registered images from multiple modalities into the same window, solving the problem of medical workers switching between multiple windows to view multimodal images. This makes image reading more convenient for medical workers and improves their efficiency.

[0046] Those skilled in the art will understand that, for example, when the number of selected modalities is 2, the display area 10 can be divided into 2 equal sub-windows, and when the number of selected modalities is 4, the display area 10 can be divided into 4 equal sub-windows, for example, the layout of the sub-windows can be designed in a 2×2 format. Those skilled in the art can make appropriate selections according to actual needs, and can also use other known arrangement layouts as substitutes.

[0047] In one example, the design principles and methods of sub-display areas (e.g., at least one of the first sub-display area 111, the second sub-display area 112, and the third sub-display area 113) are basically similar to those of sub-windows, and will not be elaborated upon here. The difference lies in the fact that sub-display areas within the same sub-window can be designed according to a pre-defined scale. For example, when the user selects the type of image to be displayed in the sub-window as either a 3-modal Class 1 anatomical view (i.e., 3 images) or a 6-modal Class 1 anatomical view (i.e., 6 images, such as...), the design principles and methods of sub-display areas are similar to those of sub-windows. Figure 2b As shown, when selecting to display only one type of anatomical view, the sub-display area within the sub-window can be divided, for example, according to a pre-designed display ratio of 1:1:1. When the user selects an image to be displayed in a sub-window that belongs to a 3-modal, 3-type anatomical view (such as...), the sub-display area can be divided accordingly. Figure 2cAs shown, the display area 10 is divided into 3 sub-windows, and each sub-window is further divided into 3 sub-display areas, thus displaying 9 images in the display area 10. The sub-display areas under each sub-window can be divided, for example, according to a pre-set ratio of 1 to 6:1:1 (e.g., 4:1:1, 2:1:1, or 1:1:1). Through the design of the sub-display areas, in addition to enabling cross-modal image reading, it also allows for viewing different anatomical views of the same modality within the same sub-window, and / or viewing the same anatomical view of different modalities within different sub-windows. This eliminates the cumbersome process of medical staff switching between windows, greatly improving the efficiency of image comparison in identifying lesions and their locations, thereby significantly enhancing the efficiency of image reading.

[0048] Step S13 obtains T1WI and DWI image data (e.g., binary data) based on all the modes to be displayed selected by the user, such as file information (e.g., file address and unique identifier) ​​of magnetic resonance images selected by the user. Then, the image data is processed in a way such as normalization, and the normalized image data is mapped to grayscale values. The grayscale image is then drawn and displayed in the corresponding sub-display area using an asynchronous processing method.

[0049] In one example, the anatomical view initially loaded into the sub-display area is a pre-defined section layer for the anatomical view type selected by the user. Specifically, when the user opens the interface and selects the modality and anatomical view type of the MRI image to be loaded for the first time, for example, if the user selects T1WI as the modality and the selected anatomical view type as coronal, sagittal, or axial, the first sub-display area 111 under the sub-window displays, for example, a pre-defined section layer for the coronal view, the second sub-display area 112 displays, for example, a pre-defined section layer for the sagittal view, and the third sub-display area 113 displays, for example, a pre-defined section layer for the axial view. In one example, the pre-defined section layer can be designed as, for example, a layer for the median coronal section, the median sagittal section, and the median axial section.

[0050] In one example, the asynchronous processing method includes microtask drawing and macrotask drawing. The microtask drawing method includes Promise asynchronous drawing and the queueMicrotask() method, while the macrotask drawing method includes setTimeout drawing. Through the design of the asynchronous processing method, images can be drawn simultaneously in multiple sub-windows and / or multiple sub-display areas, allowing images of multiple modalities to be quickly displayed in the same window, thereby greatly improving the experience of medical workers when viewing multimodal images.

[0051] See Figure 3This illustrates a method for linking slice layers in different modalities within the same viewport. Specifically, step S2 further includes:

[0052] Step S21 enables the first event listening unit to listen for the occurrence of the first operation events of multiple sub-windows and updates the aspect index global variable in the global parameter pool.

[0053] Step S22 activates the second event listening unit to listen for updates to the global variable of the section index in the global parameter pool, and updates the section layers displayed in all sub-display areas of the at least one sub-display area to the section layers of at least one anatomical view corresponding to the updated global variable of the section index according to the updated global variable of the section index.

[0054] In one example, the present invention sets up an event listener unit for monitoring the occurrence of triggered events and a global parameter pool for storing global variables. The event listener unit may include a first event listener unit, a second event listener unit, and a third event listener unit. The first event listener unit is used to listen for the occurrence of triggered events on the interface, while the second and third event listener units are both used to listen for the occurrence of triggered events in the global parameter pool. In one example, the event listener unit can be designed, for example, by listening to program or function calls. Through the design of the first and second event listener units, a connection is established between sub-windows in different modalities and / or between different anatomical views in the same modal, thereby realizing the linkage between sub-windows in different modalities and / or between different anatomical views in the same modal (which will be detailed below).

[0055] In step S21, when the user selects any point on the slice layer in the current sub-display area (i.e., triggering the first operation event), for example, when the user selects any point on the slice layer displayed in the first sub-display area 113 of the third sub-window 13, the first event listening unit detects the occurrence of the first operation event and determines that the slice layer is the master view, and the other slice layers under the same window are the slave views. That is, the slice layer displayed in the first sub-display area 113 of the third sub-window 13 is the master view, while all slice layers under the first sub-window 11, all slice layers under the second sub-window 12, and the slice layers displayed in other sub-display areas under the third sub-window 13 (excluding the first sub-display area 113) are slave views. Obviously, those skilled in the art should understand that when the slice layer that triggered the first operation event is located in a sub-display area of ​​another sub-window, the master view should be the slice layer that triggered the first operation event, and all other slice layers are slave views.

[0056] In one example, when a user selects any point 'a' on the slice layer, they can do so by clicking with the mouse, using a stylus or finger to touch the screen panel, or by entering the coordinates on the keyboard. In one example, the current slice layer when the user selects any point can be a preset slice layer loaded into the display area, or a slice layer obtained after linkage (described in detail below).

[0057] In one example, a second event listener unit is enabled in all sub-display areas within display area 10. This registers the event of updating the global aspect index variable in the global parameter pool to the second event listener unit in each sub-display area. When the first event listener unit transmits the aspect parameter (e.g., the voxel coordinates of point a) that triggered the first event to the global parameter pool and updates the global aspect index variable in the global parameter pool, making the global aspect index variable the voxel coordinates of point a in the current master view, the second event listener unit detects the update of the global aspect index variable. Then, based on the updated global aspect index variable in the global parameter pool, it updates the voxel coordinates in its corresponding slave view, thus establishing a connection between the master view and other slave views.

[0058] In one example, the second event listener units of all sub-display areas in display area 10 respond to the updated voxel coordinates of point a in the global parameter pool, and display the position of the point corresponding to point a on all sub-display areas of display area 10 using, for example, a crosshair cursor. That is, in each sub-display area of ​​display area 10, the position of the user-selected point in the same anatomical view of different modalities and / or different anatomical views of the same modality is displayed using, for example, a crosshair cursor, graphic markers, or markers of different colors; that is, the positions of the same point in the master view and the slave view are shown respectively (e.g., ...). Figure 2b and 2c (The crosshair cursor shown). Through the design of the second event listening unit, medical staff can accurately locate the position of the same point on the lesion in different modal images of the patient's magnetic resonance imaging during the image reading process, and / or the position in different anatomical views in the same modality, thus realizing the first linkage between the master view and the slave view.

[0059] In one example, when the number of modalities of the magnetic resonance image selected by the user is greater than or equal to 2, and the number of anatomical view types displayed in the same sub-window is greater than or equal to 2, the second event listening unit also determines whether the slave view needs to obtain the corresponding section layer data of the section parameters for updating based on the type identifier of the anatomical view to which the master view belongs, obtained from the section index global variable in the global parameter pool.

[0060] In one example, multiple secondary event monitoring units of the secondary views use a parallel approach to determine whether the type identifier of the anatomical view in the sub-display area they are monitoring is consistent with the type identifier of the anatomical view obtained from the global parameter pool. When the secondary event monitoring unit determines that the type identifiers are consistent, there is no need to update the anatomical view in the current sub-display area; when the secondary event monitoring unit determines that the type identifiers are inconsistent, it needs to update the anatomical view in the current sub-display area and obtain the type identifier of the anatomical view that needs to be updated (i.e., the type identifier of the anatomical view that is different from the type of the anatomical view in the main view and is already displayed in the sub-display area). The secondary event monitoring unit obtains the section layer data corresponding to the updated voxel coordinate values ​​based on the type identifier of the anatomical view to be updated and the updated voxel coordinate values. Then, the section layer data is processed sequentially through normalization and grayscale to obtain the corresponding section layer, which is then displayed in the sub-display area monitored by the secondary event monitoring unit, thereby realizing the second linkage between the main view and the secondary views.

[0061] For example, in an interface displaying 3 modalities and 3 types of anatomical views (i.e., each modality displays 3 types of anatomical views), when the user selects point 'a' on the section layer of the coronal view in the T1WI modality, this coronal view section layer becomes the master view, while the section layers of the other two anatomical views in the T1WI modality are slave views. All section layers in the other two modalities are also slave views. When the user enters the multimodal image viewing interface, for example, the master view defaults to selecting a pixel with voxel coordinates of (128, 128, 128), and this voxel coordinate value is recorded in the global parameter pool. All slave views read this coordinate from the global parameter pool and obtain the corresponding point (e.g., a voxel point) in their respective image space based on the voxel coordinate value. Then, the position of this point in each section layer is displayed using their respective crosshair cursors. When a user clicks on a specific voxel / pixel in the main view of the T1WI by, for example, left-clicking the mouse or typing the voxel coordinates of a specific voxel / pixel in the coordinate bar above the view, taking the coordinates of point a on the current section layer of the coronal view as (145, 128, 148) as an example, the global variable of the section index (i.e., the section index voxel coordinate value) in the global parameter pool is updated to (145, 128, 148), and this parameter is pushed to each slave view. Each slave view changes the position of the crosshair according to the voxel coordinate value (145, 128, 148), and at the same time, the section layers corresponding to the axial and sagittal planes are updated. When the voxel coordinates of point a (x, y, z) are (145, 128, 148), and in the coordinate system, the XOZ plane formed by the X-axis and Z-axis is on the same plane as the coronal section layer, the XOY plane formed by the Y-axis and X-axis is the axial plane, and the YOZ plane formed by the Z-axis and Y-axis is the sagittal plane, for example, when the user changes the selected point (115, 0, 130) on the XOZ plane (i.e., the coronal section layer) to the coordinates of point a on the XOZ plane (145, 0, 148), it is possible to... Based on coordinates (145,0,148), magnetic resonance image data of the same mode can be obtained by cutting the plane with x=145 to obtain the corresponding sagittal section layer and display it in the corresponding sub-display area; and / or based on coordinates (145,0,148), magnetic resonance image data of the same mode can be obtained by cutting the plane with z=148 to obtain the corresponding axial section layer and display it in the corresponding sub-display area, and the sagittal and axial section layers of each mode can be updated, thereby realizing the linkage between section layers.

[0062] In one example, after establishing a linkage between the master view and the slave view, it is also possible to achieve a dynamic effect where the same type of anatomical views in different modalities can be dragged simultaneously. The specific method is as follows:

[0063] A displacement reference point is set in each sub-display area of ​​display area 10, and information about the displacement reference points in all sub-display areas is obtained, such as the unique identifier of the sub-display area where each position reference point is located and the coordinate value of each position reference point. In one example, the displacement reference point can be set as any point in each sub-display area, the center point of the corresponding sub-display area, the upper left corner point of the corresponding sub-display area, etc., and the positions of the displacement reference points in each sub-display area are set to correspond to each other.

[0064] In one example, the displacement reference point can also be designed as any point in the corresponding sub-window of each sub-window. The positions of the displacement reference points in each sub-window are set to correspond to each other. For example, the first displacement reference point is selected in the first sub-window, and the second displacement reference point is selected in the second sub-window. The positions of the first displacement reference point and the second displacement reference point are corresponding to each other, and so on. This will not be elaborated on here.

[0065] In one example, the number of displacement reference points in each sub-display area and the number of displacement reference points in each sub-window can be designed according to actual needs, i.e., it can be designed as 2, 3 or more.

[0066] In one example, the first event listening unit is enabled to listen for the occurrence of a second operation event in the display area. When the user drags any point on the section layer in the current sub-display area (e.g., any one of the first sub-display area 111, the second sub-display area 112, and the third sub-display area 113) (i.e., triggering the second operation event), the first event listening unit transmits the position information of the dragged current point to the global parameter pool and updates the global variable of section displacement in the global parameter pool. It also determines that the section layer where the current point that triggered the second operation event is located is the master view, and the section layers with the same anatomy type as the section layer where the current point is located in the other modalities are the slave views. For example, if the display area shows a 3-modality, 3-type anatomical view, when the user drags any point in the first sub-display area 111 (e.g., displaying a section layer of the coronal view) within the first sub-window 11 (e.g., displaying an image of the T1WI modality), the section layer of the coronal view displayed in that first sub-display area 111 becomes the master view, while the section layers of the coronal views in the second and third sub-windows 12 and 13 become the slave views. Those skilled in the art can determine the master and slave views based on the current section layer dragged by the user, but this should not be construed as a limitation of the invention.

[0067] In one example, the location information of the current point includes the coordinates of the current point, the unique identifier of the sub-display area in which the current point is located, and the type identifier of the anatomical view to which the current point belongs.

[0068] When the global variable for section displacement in the global parameter pool is updated, since the global variable for section displacement in the global parameter pool has been registered with the third event listening unit, the third event listening unit can detect the update. Then, the third event listening unit calculates the displacement change based on the updated global displacement variable, and transmits the displacement change and the identification information in the global variable for section displacement to the second event listening unit of each sub-display area in display area 10. In one example, the global variable for section displacement includes the updated coordinates of the current point in the global parameter pool, the unique identifier of the sub-display area where the current point is located, and the type identifier of the anatomical view to which the section layer belongs.

[0069] In one example, a third event listener unit can be set for each sub-display area. Of course, those skilled in the art can set a third event listener unit for each sub-window, or they can set only the same third event listener unit for all sub-windows. The key is that the third event listener unit can detect updates to the global variable of tangential displacement in the global parameter pool.

[0070] In one example, the third event listening unit listens for the change in displacement between the current point and a displacement reference point within the sub-display area, calculated based on the updated coordinates of the current point in the global parameter pool and the unique identifier of the sub-display area. For instance, when the displacement reference point is the currently selected point, the coordinates of the current point when it is selected (i.e., in the first state) are taken as the coordinates of the displacement reference point, and the current coordinates of the current point after the displacement change (i.e., in the second state) are obtained. The change in displacement is then the difference between the current coordinates and the coordinates of the displacement reference point, or the difference between the coordinates in the second state and the coordinates in the first state. As another example, when the displacement reference point is a fixed preset point within the sub-display area, the first change in the coordinates of the current point in the first state relative to the fixed preset point is obtained, followed by the second change in the coordinates of the current point in the second state relative to the fixed preset point. The change in displacement is then calculated based on the difference between the first and second changes.

[0071] The calculated displacement change and the updated anatomical view type identifier are then transmitted to the second event listening units in all sub-display areas. Subsequently, the second event listening units in all sub-display areas determine whether to update the sub-display area where the second listening unit is located based on the updated anatomical view type identifier.

[0072] When the second event listening unit determines, based on the updated anatomical view type identifier, that the type of the anatomical view displayed in the sub-display area where the second event listening unit is located is consistent with that of the anatomical view, it updates the coordinate values ​​of all points in the displayed section layer according to the displacement change. In one example, the second event listening unit adds the displacement change to the coordinate values ​​of all points in its section layer, thus obtaining the updated coordinate values ​​of all points. This achieves a third linkage between the master view and the slave view, thereby demonstrating the dynamic effect of the master view and the slave view being dragged simultaneously. When the second event listening unit determines, based on the updated anatomical view type identifier, that the type of the anatomical view displayed in the sub-display area where the second event listening unit is located is inconsistent with that of the anatomical view, it does not update the coordinate values ​​of all points in the displayed section layer.

[0073] In one example, the master view and slave view in the first, second, and third linkages are all cross-sectional layers of the registered magnetic resonance images. The method for registering magnetic resonance images of different modalities to each other includes:

[0074] The space in which the image of the first mode (e.g., T1WI mode) in different modal magnetic resonance images is located is the template space;

[0075] Images of other modes besides the first mode (e.g., T2WI mode, DWI mode, DTI mode, etc.) are registered and projected into the template space to obtain magnetic resonance images of different modes in the same template space.

[0076] In one example, when registering and projecting images of other modalities into the template space, spatial transformations, such as translation, rotation, scaling, and shearing, are performed on the images of other modalities based on the registration matrix between the other modalities and the template space, thereby registering and projecting the images of other modalities into the template space.

[0077] In one example, methods for displaying medical images also include:

[0078] Step S3: Based on the functional magnetic resonance imaging (fMRI) data uploaded by the user, preferably, resting-state functional magnetic resonance image data is uploaded to obtain medical indicator image data with at least one of the following medical indicators: Amplitude of Low-Fequency Fluctuation (ALFF), Regional Homogeneity (ReHo), and Degree Centrality (DC). The medical indicator image data is then registered and projected into a template space that is the same as the image space of the registered magnetic resonance image, so that the registered medical indicator image data is located on the layer of the magnetic resonance image displayed in each sub-display area of ​​the display area 10.

[0079] In one example, the low-frequency amplitude characteristic (ALFF) medical index, the regional consistency (ReHo) medical index, and the degree centrality (DC) medical index can all be calculated using the relevant algorithms described in the AFNI brain functional imaging analysis software. Of course, those skilled in the art can also use other existing algorithms as alternatives.

[0080] In one example, when a user uploads functional magnetic resonance imaging (fMRI) data, preferably when the user uploads resting-state fMRI data, three medical indicators—ALFF, ReHo, and DC—are automatically calculated. These medical indicators are then registered from their respective fMRI spaces and projected onto the template space. A function button for displaying the medical indicators is registered to a fourth event listening unit. When the fourth event listening unit detects that the "Show Overlay" function button on the interface is turned on, it sends a data request to the server and obtains image data for at least one of the medical indicators—ALFF, ReHo, and DC. The obtained medical indicator image data is then placed on top of the fMRI image layer displayed in each sub-display area of ​​display area 10, forming a layered display of the medical indicators. When the fourth event listening unit detects that the "Show Overlay" function button on the interface is turned off, the layered display of the medical indicators is not displayed.

[0081] In one example, after a user uploads medical image data, the data can be sequentially parsed and processed, including template modal data reconstruction, registration, and transmission, before automatic medical indicator calculation. In another example, when the uploaded medical image data is fMRI data, the fMRI data can be directly used for medical indicator calculation.

[0082] In one example, a readable storage medium is provided according to another embodiment of the invention. In embodiments of the invention, a “readable storage medium” refers to any medium that participates in providing a program or instructions to a processor for execution. The medium can take many forms, including but not limited to non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical discs or magnetic disks, such as storage devices. Volatile media include dynamic memory, such as main memory. Transmission media include coaxial cables, copper wires, and optical fibers, including conductors containing buses. Transmission media can also take the form of acoustic or optical waves, such as acoustic or optical waves generated during radio frequency (RF) and infrared (IR) data communications. Common forms of readable storage media include, for example, floppy disks, flexible disks, hard disks, magnetic tape, any other magnetic media, CD-ROMs, DVDs, any other optical media, punched cards, paper tape, any other physical media with a perforated pattern, RAM, PROMs and EPROMs, FLASH-EPROMs, any other memory chips or cartridges, carrier waves as described below, or any other medium from which a computer can read.

[0083] The readable storage medium stores a program or instructions that, when executed by a processor, perform the aforementioned method for displaying medical images.

[0084] The medical image display method and readable storage medium provided according to various examples of the present invention have at least one of the following advantages:

[0085] (1) The medical image display method and readable storage medium provided by the present invention can load images in multiple registered modalities in the same window, which solves the problem of medical workers switching between multiple windows to view multimodal images, thereby making it more convenient for medical workers to view images and improving the efficiency of medical workers to view images.

[0086] (2) The medical image display method and readable storage medium provided by the present invention realize the interaction between images in different modalities during cross-modal image reading through the design of a global parameter pool and an event listening unit, so as to facilitate the viewing of image information at the same position in images of different modalities;

[0087] (3) The medical image display method and readable storage medium provided by the present invention, through the design of dragging the cross-section layer at the same time, enable medical workers to display the magnified view of the suspected lesion in the same window when locating the lesion, and display different modalities and the same type of anatomical view, reducing the inconvenience of repeatedly looking up different modal images and improving the work efficiency of medical workers.

[0088] (4) The medical imaging display method and readable storage medium provided by the present invention solve the problem of inconsistent size and position of the same brain region in different modalities by registering and projecting multimodal magnetic resonance image data into the same template space;

[0089] (5) The medical image display method and readable storage medium provided by the present invention can automatically calculate medical indicators when the user uploads resting-state functional magnetic resonance image data, and register the medical indicators from the resting-state functional magnetic resonance image space where they are located and project them to the template space.

[0090] (6) The medical image display method and readable storage medium provided by the present invention can clearly and accurately display medical indicators on images of various modalities by adding a layered display function.

[0091] While some embodiments of the present general inventive concept have been shown and described, those skilled in the art will understand that changes may be made to these embodiments without departing from the principles and spirit of the present general inventive concept, the scope of which is defined by the claims and their equivalents.

Claims

1. A medical image display method, comprising the steps of: Step S1, in response to an interface operation, constructing a plurality of sub-windows under the same window, and constructing at least one sub-display region in each of the plurality of sub-windows, the plurality of sub-windows not overlapping with each other and displaying registered different modal magnetic resonance images, and at least one sub-display region in the same sub-window displaying a preset slice layer of an anatomical view of at least one type in the same modal magnetic resonance image; Step S2, in response to an interface operation on the plurality of sub-windows, updating a slice index global variable in a global parameter pool, and updating the slice layer displayed in each of the at least one sub-display region according to the updated slice index global variable; wherein, the step S2 further comprises: Step S21, enabling a first event listening unit to listen to the occurrence of a first operation event of the plurality of sub-windows, and updating the slice index global variable in the global parameter pool; Step S22, enabling a second event listening unit to listen to the update of the slice index global variable in the global parameter pool, and updating the slice layer displayed by all of the at least one sub-display region to at least one slice layer of an anatomical view corresponding to the slice index global variable according to the updated slice index global variable, all of the at least one sub-display region have the second event listening unit enabled. 2.The display method of claim 1, wherein, the step S1 further comprises: Step S11, loading registered different modal magnetic resonance images, and obtaining file information of the different modal magnetic resonance images; Step S12, receiving a selection instruction of a user, determining at least two to-be-displayed modal magnetic resonance images, and obtaining the number and boundary of sub-windows divided under the same window, and simultaneously determining the number and boundary of sub-display regions under the same sub-window; Step S13, obtaining to-be-displayed image data corresponding to each of the at least two to-be-displayed modal magnetic resonance images according to the file information of the magnetic resonance image of each of the at least two to-be-displayed modal magnetic resonance images, and converting the to-be-displayed image data corresponding to each of the at least two to-be-displayed modal magnetic resonance images into the preset slice layer, and displaying the preset slice layer in the corresponding sub-display region of the at least one sub-display region. 3.The display method of claim 2, wherein, the step S12 further comprises: receiving an instruction of a user selecting at least two to-be-displayed modal magnetic resonance images needed to be displayed in the plurality of sub-windows, determining the number of to-be-displayed modal magnetic resonance images and the number of types of anatomical views to be displayed under the same modal, and dividing the display region under the same window into sub-windows matching the number of to-be-displayed modal magnetic resonance images, and simultaneously dividing the same sub-window into sub-display regions matching the number of types of anatomical views to be displayed under the same modal according to the number of types of anatomical views to be displayed under the same modal. 4.The display method of claim 3, wherein, The step S12 further comprises: determining the boundary of each of the plurality of sub-windows according to the size of the preset display region in the same window and the number of the modalities to be displayed, determining the boundary of each of the at least one sub-display region according to the boundary of each of the sub-windows and the number of the types of the anatomical views to be displayed in the same modality.

5. The display method of claim 4, wherein, In step S11, the file information comprises a file address of the magnetic resonance image of each of the modalities to be displayed, In step S13, the corresponding image data to be displayed is drawn into a gray scale image corresponding to the image data to be displayed by an asynchronous processing method and displayed in the corresponding sub-display region.

6. The method of claim 1, wherein, In step S1, the method of registering the magnetic resonance images of different modalities comprises: determining a template space in which an image of a first modality among the magnetic resonance images of different modalities is located; registering and projecting the images of the modalities other than the first modality among the different modalities into the template space to obtain the magnetic resonance images of different modalities in the same template space.

7. The display method of any one of claims 1-6, wherein, In step S21, the first operation event comprises a user selecting an arbitrary point on a slice layer in a current sub-display region, When the first operation event occurs, determining that the slice layer displayed by the sub-display region in the sub-window in which the first operation event occurs is a master view, and all the views displayed in the plurality of sub-windows other than the master view are slave views.

8. The display method of claim 7, wherein, The step S22 further comprises: when the second event listening unit listens to the update of the slice index global variable, updating the corresponding slice parameters in all the slave views according to the updated slice index global variable, and displaying the position of the point corresponding to the point selected by the user in the master view and all the slave views.

9. The display method of claim 8, wherein, The step S22 further comprises: after the second event listening unit updates the slice parameters of the corresponding point in all the slave views according to the updated slice index global variable, obtaining slice layer data corresponding to the slice parameters of different anatomical view types from the master view according to the slice parameters of the corresponding point in all the slave views and the point selected by the user in the master view, then converting the slice layer data into a slice layer corresponding thereto, and displaying the slice layer in the corresponding sub-display region in the at least one sub-display region.

10. The display method of claim 8, wherein, the types of the anatomical views at least comprise one of a sagittal view, an axial view and a coronal view, the number of the sub-display regions divided under the same sub-window and the number of the anatomical types one-to-one correspond to each other, the section index global variable comprises a section index voxel coordinate value of a current point in a master view and a unique identifier of a sub-display region where the current point is located, the section parameter comprises a voxel coordinate value of a point in a slave view corresponding to the current point in the master view, the voxel coordinate value of each point on the master view is identical to the voxel coordinate value of the corresponding point on all slave views.

11. The display method of claim 7, wherein, the step S2 further comprises: setting a displacement reference point in each of the at least one sub-display region, and obtaining information of the displacement reference points in all the sub-display regions; enabling the first event listening unit to listen to occurrence of a second operation event of the plurality of sub-views and to update a section displacement global variable in the global parameter pool; enabling a third event listening unit to listen to the update of the section displacement global variable in the global parameter pool and to calculate a displacement change, and then transmitting the displacement change and the identifier information in the section displacement global variable to all the second event listening units; the second event listening units simultaneously update position information of all points in the section layer of the same type of anatomical view displayed in the plurality of sub-views according to the received displacement change and the identifier information in the section displacement global variable to show a dynamic effect of simultaneously dragging the section layer of the same type of anatomical view in the plurality of sub-views.

12. The display method of claim 11, wherein, the information of the position reference point comprises a unique identifier of a sub-display region where the position reference point is located and a coordinate value of the position reference point; the section displacement global variable comprises a coordinate value of a current point, a unique identifier of a sub-display region where the current point is located, and a type identifier of an anatomical view to which a section layer where the current point is located belongs, the position information of all points in the section layer comprises coordinate values of all points in the section layer, the second operation event comprises user dragging any point on the section layer in the current sub-display region, when the second operation event occurs, the first event listening unit transmits the coordinate value of the current point and the unique identifier of the sub-display region where the current point is located to the global parameter pool, and the global parameter pool updates the coordinate value of the current point and the unique identifier of the sub-display region.

13. The display method of claim 12, wherein: the third event listening unit listens to the update of the section displacement global variable in the global parameter pool, and obtains a displacement change between the current point and a displacement reference point in the sub-display region where the current point is located according to the updated coordinate value and the unique identifier of the sub-display region, and then transmits the obtained displacement change and the updated type identifier of the anatomical view to the second event listening units in all the sub-display regions, the second event listening units in all the sub-display regions determine whether to update the sub-display region where the second event listening unit is located according to the updated type identifier of the anatomical view, the second event listening units in all the sub-display regions determine whether to update the sub-display region where the second event listening unit is located according to the updated type identifier of the anatomical view, when the second event listening unit determines, according to the updated type identifier of the anatomical view, that the type of the anatomical view displayed by the sub-display region in which the second event listening unit is located is consistent, updating coordinate values of all points in the displayed cross-sectional layer according to the displacement change amount, when the second event listening unit determines, according to the updated type identifier of the anatomical view, that the type of the anatomical view displayed by the sub-display region in which the second event listening unit is located is inconsistent, not updating coordinate values of all points in the displayed cross-sectional layer.

14. The display method of claim 1, wherein, the display method of the medical image image further comprises: In step S3, at least one medical index image data is obtained according to the resting state functional magnetic resonance image data uploaded by the user, and the at least one medical index image data is registered and projected into a template space which is the same as the image space of the registered magnetic resonance image, so that the registered at least one medical index image data is located on the layer of the magnetic resonance image displayed by each of the plurality of sub-display regions.

15. A readable storage medium, characterized in that, the readable storage medium stores programs or instructions, and the programs or instructions are executed by a processor to perform the display method of the medical image image according to any one of claims 1-14.

Images