Medical image display and processing system based on cloud computing

Abstract

The invention relates to the technical field of medical image data processing, and discloses a medical image display and processing system based on cloud computing, and the system comprises a file management module which is used for loading a to-be-processed medical image file, screening the medical image file meeting the format requirement, carrying out the data management and processing of the medical image file, and storing the medical image file into a database; image information, metadata and display parameters of the streaming loading medical image file are obtained; the display module is used for receiving the image information, the metadata and the display parameters of the streaming loading medical image file of the file management module, comparing the image information, the metadata and the display parameters with the current display file, and performing data display; the data processing module is used for receiving image information, metadata and display parameters of the standardized medical image files loaded in a streaming mode and conducting data preprocessing or cloud computing operation; the medical image data in various data formats is supported, the data diversity is improved, meanwhile, interaction with the user can be achieved, and the usability of the system is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of medical image data processing, and in particular to a medical image display and processing system based on cloud computing. Background Art

[0002] With the continuous advancement of medical imaging technology, such as the widespread application of X-ray, computed tomography (CT), magnetic resonance imaging (MRI) and other equipment, the amount of medical imaging data has exploded. How to manage and process massive medical imaging data has become a major problem. Most of the existing methods propose to use medical image processing systems based on image algorithms to manage and store medical imaging data. Although they can save data, they have the following problems: (1) There is a lack of output of intermediate results of medical imaging data; (2) The interaction with users is ignored. Users can only get diagnostic results and lack participation in the intermediate process; (3) It is impossible to intuitively browse the basic situation of medical images in the system, and it is impossible to make a preliminary inspection of the data. Obvious image quality problems cannot be discovered, resulting in errors in the final analysis results; (3) There is a lack of intelligent processing of medical imaging data, which causes users to wait for a long time and do not know the processing progress, that is, the medical image processing results cannot be displayed in real time; (4) Only a single format of medical images is supported. Summary of the invention

[0003] In view of the above-mentioned deficiencies in the prior art, the present invention provides a medical image display and processing system based on cloud computing, which is used to solve the problems of lack of intermediate result output and real-time display results in the prior art, while improving interactivity with users and supporting medical image data in multiple formats.

[0004] In order to achieve the above-mentioned object of the invention, the technical solution adopted by the present invention is:

[0005] A medical image display and processing system based on cloud computing, comprising:

[0006] A file management module is used to load the medical image files to be processed, screen the medical image files that meet the format requirements, determine whether the medical image files are compressed files, and if so, decompress them to obtain uncompressed medical image files; otherwise, directly sort and standardize the uncompressed medical image files according to the file names, parse the standardized medical image files and read the image information, metadata and display parameters, and stream the image information, metadata and display parameters of the standardized medical image files into the display module and the data processing module;

[0007] The display module is used to receive the image information, metadata and display parameters loaded by the file management module in a streaming manner, and determine whether the file containing the image information, metadata and display parameters loaded in a streaming manner is the same as the file currently displayed. If so, execute Step 1, otherwise, execute Step 2;

[0008] Step 1: Check whether only the display parameters have changed. If so, execute Step 4, otherwise execute Step 3;

[0009] Step 2: Initialization operation, first clear the cached display data, and load the streamed image information, metadata, and display parameters into the cache of the display module, use the metadata to initialize the rendering engine and load the rendering preset data and loading tool group;

[0010] Step 3: Perform multi-plane modeling and 3D reconstruction on the 3D information in the streamed image information and render it into the corresponding window, activate the tool group at the same time, and execute Step 4;

[0011] Step 4: Load new display parameters and update them to each display window of the display module through responsive and streaming loading;

[0012] The data processing module is used to receive the image information, metadata and display parameters of the stream-loaded standardized medical image files; determine whether the stream-loaded image information, metadata and display parameters need to be processed, if so, perform data preprocessing, otherwise, export the data; determine whether the stream-loaded image information, metadata and display parameters need to be calculated complex data, if so, select the corresponding cloud computing method to calculate the data, otherwise, export the data.

[0013] Furthermore, when screening medical image files that meet the format requirements, the format of the medical image file is checked to determine whether the format of the medical image file is supported. If so, the next step is performed, otherwise, an error message is issued.

[0014] Furthermore, when the image information, metadata and display parameters of the standardized medical image files are streamed into the display module and the data processing module, it is determined whether data processing is required. If so, the data is input into the data processing module for data processing; otherwise, the data is directly exported to the display module.

[0015] Furthermore, the data processing module includes a data storage module, a manual processing module, and a cloud computing module;

[0016] A manual processing module, which is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming and perform data preprocessing, and to set the display parameters based on the UI design to adjust the display of the medical image files;

[0017] The cloud computing module is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming, and to design the cloud computing operation UI for selecting the corresponding cloud computing method for calculation according to the corresponding needs;

[0018] The data storage module is used to receive and store the medical image files pre-processed by the manual processing module and the medical image files processed by cloud computing by the cloud computing module.

[0019] Furthermore, the cloud computing method includes an image segmentation method and an image detection method.

[0020] The present invention has the following beneficial effects:

[0021] 1. The cloud computing-based medical image display and processing system proposed in the present invention performs data processing and display based on a file management module, has a responsive design, and adopts streaming loading and transmission, and can support medical image data in multiple data formats, thereby improving data diversity;

[0022] 2. The designed display module can interact with the user, which improves the usability of the system, enables the system to have feedback, and effectively improves the processing speed of the system, which can greatly enhance the user experience;

[0023] 3. In the data processing module, data preprocessing and cloud computing algorithm are proposed to calculate data, which improves the interactivity with users and at the same time improves the diversity of data processing and the calculation speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a schematic diagram of the structure of a medical image display and processing system based on cloud computing proposed by the present invention. DETAILED DESCRIPTION

[0025] The specific implementation modes of the present invention are described below so that those skilled in the art can understand the present invention. However, it should be clear that the present invention is not limited to the scope of the specific implementation modes. For those of ordinary skill in the art, as long as various changes are within the spirit and scope of the present invention as defined and determined by the attached claims, these changes are obvious, and all inventions and creations utilizing the concept of the present invention are protected.

[0026] like Figure 1 As shown, a medical image display and processing system based on cloud computing includes:

[0027] The file management module is used to load the medical image files to be processed, screen the medical image files that meet the format requirements, determine whether the medical image files are compressed files, and if so, decompress them to obtain uncompressed medical image files. Otherwise, directly sort and standardize the uncompressed medical image files according to the file names, parse the standardized medical image files and read the image information, metadata and display parameters, and stream the image information, metadata and display parameters of the standardized medical image files into the display module and the data processing module.

[0028] Specifically, when screening medical image files that meet the format requirements, the format of the medical image file is checked to determine whether the format of the medical image file is supported. If so, the next step is performed, otherwise, an error message is issued.

[0029] Specifically, when the image information, metadata and display parameters of the standardized medical image files are streamed into the display module and the data processing module, it is determined whether data processing is required. If so, the data is input into the data processing module for data processing; otherwise, the data is directly exported to the display module.

[0030] In this embodiment, the file management module can screen data in various formats to select the required file format for data management. In addition, the file management module in this embodiment supports files in formats such as DICOM, NIFTI, zip, and png, and its file format coverage is wide to support the input of files in various formats. When streaming the image information, metadata, and display parameters of standardized medical image files into the display module and the data processing module, it is necessary to determine whether data processing is required for the purpose of simplifying the process to save the output time of medical image files. Most importantly, when exporting data, you can choose to export the entire currently displayed file sequence, or you can export only the currently displayed file. You can choose to export in multiple file formats. The purpose of doing this is to meet the different needs of different users.

[0031] The display module is used to receive the image information, metadata and display parameters streamed by the file management module, and determine whether the file containing the streamed image information, metadata and display parameters is the same as the currently displayed file. If so, execute Step 1, otherwise, execute Step 2.

[0032] Step 1: Check whether only the display parameters have changed. If so, execute Step 4, otherwise execute Step 3.

[0033] In this embodiment, the purpose of checking whether only the display parameters have changed is: if only the display parameters have changed, only Step 4 needs to be executed; if not only the display parameters but also the file have changed, Step 3 needs to be executed before Step 4. This design will reduce unnecessary calculations, thereby speeding up image display.

[0034] Step 2: Initialization operation, first clear the cached display data, and load the streamed image information, metadata and display parameters into the cache of the display module, use the metadata to initialize the rendering engine and load the rendering preset data and loading tool group.

[0035] In this embodiment, the purpose of clearing the cached display data is to facilitate initialization, thereby preventing previously discarded data from contaminating currently loaded data and causing display errors. The purpose of initialization is to prevent old data from affecting the display, so when loading a new file, it is necessary to initialize various parameters to maintain initial consistency and restore to default settings.

[0036] Step 3: Perform multi-plane modeling and 3D reconstruction on the 3D information in the streamed image information and render it into the corresponding window, activate the tool group at the same time, and execute Step 4.

[0037] In this embodiment, the purpose of implementing Step 3 is: since the data content is determined to have changed in Step 1, it is necessary to re-perform multi-plane modeling and three-dimensional reconstruction on the data, so as to update the display content. The corresponding window refers to a plane imaging window including three directions and a 3D display window. The purpose of this design is: the three coordinate axis directions and the stereoscopic display are more convenient for users to view in an all-round and intuitive manner; in addition, the tool group includes other tools for operating images such as annotation, line drawing, zooming in and out, rotation, and distance measurement. The purpose of this design is: it is convenient for users to view and record image information more accurately.

[0038] Step 4: Load new display parameters and update them to each display window of the display module through responsive and streaming loading.

[0039] In this embodiment, the new display parameters come from the manual processing module. When the user operates the display parameters in the UI interface in the manual processing module, the display parameters will be changed, thereby generating new display parameters.

[0040] The data processing module is used to receive the image information, metadata and display parameters of the stream-loaded standardized medical image files; determine whether the stream-loaded image information, metadata and display parameters need to be processed, if so, perform data preprocessing, otherwise, export the data; determine whether the stream-loaded image information, metadata and display parameters need to be calculated complex data, if so, select the corresponding cloud computing method to calculate the data, otherwise, export the data.

[0041] Specifically, the data processing module includes a data storage module, a manual processing module, and a cloud computing module.

[0042] The manual processing module is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming and perform data preprocessing, and set the display parameters based on the UI design to adjust the display of the medical image files.

[0043] In this embodiment, a display interactive operation submodule is designed in the manual processing module, which has a UI design that can set display parameters, that is, it is used to change the display of medical image files by setting these parameters. For example, the window height and window width, color mapping, brightness, size, position and other information of the medical image can be set to better view the medical image file. At the same time, in the three-dimensional display window, the opacity transfer function in the three-dimensional reconstruction can be set to better display specific organs in the medical image, the three-dimensional image can be better observed by rotating the angle, and the current three-dimensional angle can be obtained to record the observation angle and other functions; in addition, the medical image files processed by the manual processing module can be streamed back to the file management module, and can also be transmitted to the data storage module for viewing anytime and anywhere.

[0044] The cloud computing module is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming, and to design the cloud computing operation UI for selecting the corresponding cloud computing method for calculation according to the corresponding needs.

[0045] In this embodiment, for medical image files that need to be kept confidential and have a large amount of calculation, a cloud computing module is used to perform data calculation and processing; in the cloud computing module, multiple cloud computing sub-blocks are equipped, each cloud computing sub-block stores a cloud computing method, that is, a cloud computing operation UI is designed for selecting the corresponding cloud computing method according to one's own needs. When the user selects a cloud computing method, the cloud computing sub-block will automatically input the medical image file to be processed into the method interface for cloud computing processing.

[0046] Specifically, cloud computing methods include image segmentation methods and image detection methods.

[0047] In this embodiment, in addition to the image segmentation method and the image detection method, the traditional image cloud processing methods are deployed in the cloud computing method; at the same time, the cloud computing method stored in the cloud computing module is modularized, and its purpose is to facilitate upgrading and adding new cloud computing methods; and the medical image files processed by the cloud computing method will be streamed back to the file management module. This transmission method will continuously transmit the processed files back to the file management module, and will not wait for all files to be processed before transmission. On the one hand, it can make the system have a timely feedback mechanism, so that users can clearly and quickly understand the processing progress. On the other hand, it can reduce the pressure on the display module, and will not pile up data for processing, which improves the processing speed of the system as a whole; in addition, the medical image files processed by cloud computing can also be stored in the data storage module of the cloud for storage, so that they can be viewed anytime and anywhere.

[0048] The data storage module is used to receive and store the medical image files pre-processed by the manual processing module and the medical image files processed by cloud computing by the cloud computing module.

[0049] In this embodiment, Figure 1The structure of the medical image display and processing system based on cloud computing is demonstrated, including a file management module, a display module and a data processing module. The data processing module includes a manual processing module, a cloud computing module and a data storage module. Data preprocessing is performed in the manual processing module, that is, the streaming loaded image information, metadata and display parameters can be manually processed, including manual segmentation, annotation, line drawing, ranging and other operations on the image. At the same time, the images processed in the data processing stage of the manual processing module are processed in the cache of the file management module, and the processed data can be entered into the data storage module for storage so that it can be viewed at any time. For algorithms that require confidentiality and large computational complexity, a cloud computing module is required because cloud computing has advantages in speed and scalability. Therefore, the present invention introduces a cloud computing module, and sets an operation UI for each cloud computing algorithm to ensure that users can select the corresponding cloud computing method in the cloud computing module according to their needs. After the selection is completed, the data is automatically transmitted to the method interface in the cloud computing module for data calculation operations; in addition, the cloud algorithm in the cloud computing module includes various types of methods, such as image segmentation, image detection, etc., and the traditional image cloud processing method and the algorithm based on artificial intelligence are deployed in the cloud computing module, that is, through the modularization of the cloud algorithm, the system is upgraded and new algorithms are added to improve the accuracy of cloud computing; and the image processed by the cloud algorithm can be streamed and transmitted back to the file management module. This transmission method will continuously transmit the processed files back to the file management module, and will not wait for all files to be processed before transmission. The benefits of such transmission are: on the one hand, the system can have a feedback mechanism, so that the user can clearly understand the processing progress; on the other hand, it can reduce the pressure on the display module, and the data will not be piled up together for processing, which improves the processing speed of the system as a whole; at the same time, it can also choose to store the image data processed by the cloud computing module in the data storage module for storage, which is convenient for viewing at any time.

[0050] In summary, the medical image display and processing system based on cloud computing proposed in the present invention performs data processing and display around the file management module, has a responsive design, and adopts streaming loading and transmission, can support medical image data in various data formats, and improves data diversity; at the same time, the designed display module can interact with users, improves the usability of the system, enables the system to have feedback, and effectively improves the processing speed of the system, which can greatly enhance the user experience; in addition, data processing and providing cloud computing algorithms to calculate data are proposed in the data processing module, which improves interactivity with users, and at the same time improves the diversity and calculation speed of processed data.

[0051] The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

[0052] Those skilled in the art will appreciate that the embodiments described herein are intended to help readers understand the principles of the present invention, and should be understood that the protection scope of the present invention is not limited to such specific statements and embodiments. Those skilled in the art can make various other specific variations and combinations that do not deviate from the essence of the present invention based on the technical revelations disclosed by the present invention, and these variations and combinations are still within the protection scope of the present invention.

Claims

1. A medical image display and processing system based on cloud computing, characterized in that: include: A file management module is used to load the medical image files to be processed, screen the medical image files that meet the format requirements, determine whether the medical image files are compressed files, and if so, decompress them to obtain uncompressed medical image files; otherwise, directly sort and standardize the uncompressed medical image files according to the file names, parse the standardized medical image files and read the image information, metadata and display parameters, and stream the image information, metadata and display parameters of the standardized medical image files into the display module and the data processing module; The display module is used to receive the image information, metadata and display parameters loaded by the file management module in a streaming manner, and determine whether the file containing the image information, metadata and display parameters loaded in a streaming manner is the same as the file currently displayed. If so, execute Step 1, otherwise, execute Step 2; Step 1: Check whether only the display parameters have changed. If so, execute Step 4, otherwise execute Step 3; Step 2: Initialization operation, first clear the cached display data, and load the streamed image information, metadata, and display parameters into the cache of the display module, use the metadata to initialize the rendering engine and load the rendering preset data and loading tool group; Step 3: Perform multi-plane modeling and 3D reconstruction on the 3D information in the streamed image information and render it into the corresponding window, activate the tool group at the same time, and execute Step 4; Step 4: Load new display parameters and update them to each display window of the display module through responsive and streaming loading; A data processing module is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming; determine whether the image information, metadata and display parameters loaded by streaming need to be processed, if so, perform data preprocessing, otherwise, export the data; Determine whether the image information, metadata, and display parameters loaded in streaming mode require complex data calculation. If so, select the corresponding cloud computing method to perform data calculation. Otherwise, export the data.

2. The cloud computing-based medical image display and processing system according to claim 1, characterized in that: When screening medical image files that meet the format requirements, the format of the medical image file is checked to determine whether the format of the medical image file is supported. If so, the next step is performed, otherwise, an error message is issued.

3. The cloud computing-based medical image display and processing system according to claim 2, characterized in that: When the image information, metadata and display parameters of the standardized medical image files are streamed into the display module and the data processing module, it is determined whether data processing is required. If so, the data is input into the data processing module for data processing; otherwise, the data is directly exported to the display module.

4. The cloud computing-based medical image display and processing system according to claim 3, characterized in that: The data processing module includes a data storage module, a manual processing module, and a cloud computing module; A manual processing module, which is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming and perform data preprocessing, and to set the display parameters based on the UI design to adjust the display of the medical image files; The cloud computing module is used to receive the image information, metadata and display parameters of the standardized medical image files loaded by streaming, and to design the cloud computing operation UI for selecting the corresponding cloud computing method for calculation according to the corresponding needs; The data storage module is used to receive and store the medical image files pre-processed by the manual processing module and the medical image files processed by cloud computing by the cloud computing module.

5. The cloud computing-based medical image display and processing system according to claim 4, characterized in that: Cloud computing methods include image segmentation and image detection.

Images