Method and device for outputting reference content of medical image analysis, equipment and medium

Abstract

The invention relates to the technical field of medical image analysis and processing, and provides a method, a device, equipment and a medium for outputting reference content of medical image analysis. The image post-processing algorithm can also be used for post-processing the medical image to serve as the reference content of medical image analysis. The method comprises the following steps: when a user loads a medical image through image analysis report software for analysis, capturing a displayed picture to obtain a screenshot; analyzing the screenshot to obtain an image identification number of the medical image; acquiring a medical image from the centralized management system based on the image identification number; and performing post-processing on the medical image by using an image post-processing algorithm, and outputting a post-processing result as a reference content for analyzing the medical image by the user.

Description

Technical Field

[0001] The present application relates to the technical field of medical image analysis and processing, and particularly to a method, device, computer device, storage medium, and computer program product for outputting reference content for medical image analysis. Background Art

[0002] Users such as doctors can use the image analysis report software on the workstation to analyze medical images and form corresponding reports. During the analysis process, doctors can also use the image post-processing algorithm on the workstation to post-process the medical images, and the obtained post-processing results are used for reference to form a more complete medical image report.

[0003] However, the image post-processing algorithm is generally strongly coupled with the workstation. When the image analysis report software actually used by the doctor and the image post-processing algorithm the doctor wants to use do not belong to the same workstation, it is difficult for the doctor to obtain the post-processing results output by the image post-processing algorithm for reference. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide a method, device, computer device, storage medium, and computer program product for outputting reference content for medical image analysis.

[0005] The present application provides a method for outputting reference content for medical image analysis, and the method includes:

[0006] When a user loads a medical image through image analysis report software for analysis, intercept the displayed screen to obtain a screenshot;

[0007] Analyze the screenshot to obtain the image identification number of the medical image;

[0008] Based on the image identification number, obtain the medical image from the centralized management system;

[0009] Use an image post-processing algorithm to post-process the medical image and output a post-processing result as the reference content for the user to analyze the medical image.

[0010] In one embodiment, analyzing the screenshot to obtain the image identification number of the medical image includes:

[0011] Analyze the screenshot to obtain the first-level image identification number, second-level image identification number, and third-level image identification number of the medical image; the first-level image identification number is used to distinguish different imaging objects, the second-level image identification number is used to distinguish different imaging modalities, and the third-level image identification number is used to distinguish different parameters used in the same imaging method.

[0012] In one embodiment, obtaining the medical image from the centralized management system based on the image recognition number includes:

[0013] Based on the first-level image recognition number, the second-level image recognition number, and the third-level image recognition number, determining the image file storage path of the medical image on the disk of the centralized management system;

[0014] Based on the image file storage path, obtaining the medical image from the centralized management system.

[0015] In one embodiment, capturing the displayed screen to obtain a screenshot includes:

[0016] When the user clicks the screenshot button, determining that the user issues a screenshot instruction;

[0017] In response to the screenshot instruction, capturing the displayed screen to obtain a screenshot.

[0018] In one embodiment, using the image post-processing algorithm to post-process the medical image includes:

[0019] Among multiple image post-processing algorithms, determining an image post-processing algorithm that matches the imaging modality of the medical image to obtain a target image post-processing algorithm;

[0020] Inputting the medical image into the target image post-processing algorithm to post-process the medical image.

[0021] In one embodiment, before determining an image post-processing algorithm that matches the imaging modality of the medical image among multiple image post-processing algorithms, the method further includes:

[0022] Obtaining the second-level image recognition number included in the image recognition number;

[0023] According to the second-level image recognition number, determining the imaging modality of the medical image.

[0024] In one embodiment, the image analysis report software and the image post-processing algorithm belong to different workstations.

[0025] This application provides an output device for reference content of medical image analysis, and the device includes:

[0026] A screenshot processing module, configured to capture the displayed screen to obtain a screenshot when the user loads a medical image through the image analysis report software for analysis;

[0027] An analysis module, configured to analyze the screenshot to obtain the image recognition number of the medical image;

[0028] An image acquisition module, configured to obtain the medical image from the centralized management system based on the image identification number;

[0029] A post-processing module, configured to perform post-processing on the medical image by using an image post-processing algorithm and output a post-processing result as reference content for the user to analyze the medical image.

[0030] This application provides a computer device, including a memory and a processor, where the memory stores a computer program and the processor executes the above method.

[0031] This application provides a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to perform the above method.

[0032] This application provides a computer program product, on which a computer program is stored, and the computer program is executed by a processor to perform the above method.

[0033] For the above method, device, computer device, storage medium, and computer program product for outputting reference content for medical image analysis, when a user loads a medical image through image analysis report software for analysis, the displayed screen can be intercepted to obtain a screenshot; the screenshot is parsed to obtain the image identification number of the medical image; based on the image identification number, the medical image is obtained from the centralized management system; the medical image is post-processed by using an image post-processing algorithm, and a post-processing result is output as reference content for the user to analyze the medical image. Thus, even if the image analysis report software actually used by a doctor and the image post-processing algorithm the doctor wants to use do not belong to the same workstation, the medical image can still be post-processed by using the image post-processing algorithm, and the corresponding post-processing result is output as reference content, enabling the doctor to perform a more complete analysis of the medical image. Description of the Drawings

[0034] Figure 1 It is an application scenario diagram of the method for outputting reference content for medical image analysis in one embodiment;

[0035] Figure 2 It is a flowchart of the method for outputting reference content for medical image analysis in one embodiment;

[0036] Figure 3 It is a flowchart of the method for outputting reference content for medical image analysis in another embodiment;

[0037] Figure 4 It is a structural block diagram of the device for outputting reference content for medical image analysis in one embodiment;

[0038] Figure 5It is the internal structure diagram of a computer device in an embodiment. Detailed implementation manners

[0039] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0040] Referring to "embodiments" in the present application means that the specific features, structures or characteristics described in combination with the embodiments may be included in at least one embodiment of the present application. The phrase appears at various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described in the present application may be combined with other embodiments.

[0041] When the image analysis report software actually used by users such as doctors and the image post-processing algorithm they want to use do not belong to the same workstation, based on the method provided in the present application, the medical image can also be post-processed using the image post-processing algorithm, and the corresponding post-processing result can be output as reference content, enabling doctors to perform a more complete analysis of the medical image.

[0042] The image analysis report software and the image post-processing algorithm involved in the method provided in the present application can be installed on workstations, and the image analysis report software and the image post-processing algorithm can belong to different workstations; the workstation equipped with the image analysis report software is called the first workstation, and the workstation equipped with the image post-processing algorithm is called the second workstation, as Figure 1 shown. The computer program corresponding to the method provided in the present application can be packaged into an application program. With the authorization of the user, the above application program can be installed on the first workstation, enabling the processor of the first workstation to execute the steps as Figure 2 shown.

[0043] Step S201, when the user loads a medical image through the image analysis report software for analysis, capture the displayed screen to obtain a screenshot.

[0044] The processor can detect whether the image post - processing algorithm that the user wants to use is installed on the first workstation. If so, it indicates that the image post - processing algorithm that the user wants to use is on the same workstation as the imaging analysis report software, and the above - mentioned application program startup can be not triggered. If not, it indicates that the image post - processing algorithm that the user wants to use and the imaging analysis report software are not on the same workstation, and then it can continuously detect whether the imaging analysis report software on the first workstation is running. If it is detected that the imaging analysis report software is running, the above - mentioned application program startup can be triggered. The fact that the imaging analysis report software is running indicates that the user may load medical images through the imaging analysis report software for analysis. The user can perform operations such as viewing, drawing, evaluating, and writing reports on the medical images through the imaging analysis report software. The medical images can be obtained by the imaging analysis report software from the centralized management system. In addition, the processor can also detect whether the imaging analysis report software stops running. If so, the above - mentioned application program can be closed.

[0045] The loaded medical images will be displayed on the screen. After the above - mentioned application program starts up automatically, the processor can capture the screen display to obtain a screenshot. When the processor detects that the imaging analysis report software is running, it may take a certain amount of time for the medical images to be displayed on the screen. In order to ensure that the screen image when the medical images are displayed on the screen is captured, the processor can capture the screen images at a set frequency.

[0046] The image post - processing algorithm that the user wants to use can be pre - set by the user on the first workstation, or it can be determined by analyzing the situation of the user's historical use of image post - processing algorithms, and the image post - processing algorithm with a high usage frequency is used as the image post - processing algorithm that the user wants to use.

[0047] Step S202: Analyze the screenshot to obtain the image identification number of the medical image.

[0048] Medical images not only include the imaged parts but also the image identification numbers used by the centralized management system to uniquely identify medical images when managing medical images. Thus, after obtaining the screenshot, the processor can analyze the screenshot to determine the image identification number of the medical image.

[0049] Step S203: Obtain the medical image from the centralized management system based on the image identification number.

[0050] After obtaining the image identification number, the processor can obtain the medical image from the centralized management system according to the image identification number. Since the image identification number is used by the centralized management system to uniquely identify medical images when managing medical images, the medical image obtained from the centralized management system according to the image identification number is very likely to be the medical image loaded by the imaging analysis report software.

[0051] Step S204: Use an image post - processing algorithm to post - process the medical image and output the post - processing result as the reference content for the user to analyze the medical image.

[0052] After the processor obtains the medical image, it can send the medical image to the image post - processing algorithm of the second workstation. The image post - processing algorithm can post - process the medical image and output the post - processing result, and the post - processing result can be fed back to the user so that the user can refer to the post - processing result when analyzing the medical image.

[0053] In the above method for outputting the reference content of medical image analysis, when the user loads the medical image through the image analysis report software for analysis, the displayed screen can be intercepted to obtain a screenshot; the screenshot is parsed to obtain the image identification number of the medical image; based on the image identification number, the medical image is obtained from the centralized management system; an image post - processing algorithm is used to post - process the medical image and output the post - processing result as the reference content for the user to analyze the medical image. Thus, even if the image analysis report software actually used by the doctor and the image post - processing algorithm the doctor wants to use do not belong to the same workstation, the image post - processing algorithm can be used to post - process the medical image and output the corresponding post - processing result as the reference content, enabling the doctor to perform a more comprehensive analysis of the medical image.

[0054] In one embodiment, parsing the screenshot in step S202 to obtain the image identification number of the medical image includes: parsing the screenshot to obtain the first - level image identification number, the second - level image identification number, and the third - level image identification number of the medical image.

[0055] When the centralized management system manages medical images, it can manage medical images in four levels according to the DICOM (Digital Imaging and Communications in Medicine) standard. The first level can be represented by "patient", the second level by "study", the third level by "series", and the fourth level by "image", and each level has a unique identification number. Thus, the image identification number of each medical image includes four - level image identification numbers, which can be called: the first - level image identification number, the second - level image identification number, the third - level image identification number, and the fourth - level image identification number.

[0056] The first-level image identification number is used to distinguish different imaging objects, the second-level image identification number is used to distinguish different imaging modalities, the third-level image identification number is used to distinguish different parameters used in the same imaging method (such as different sequences used in the MRI imaging method), and the fourth-level image identification number is used to distinguish different medical images. Imaging modalities include, for example, CT (Computed Tomography), MRI (Magnetic Resonance Imaging), and ultrasound, etc.

[0057] Multiple medical images with the same first-level image identification number, second-level image identification number, and third-level image identification number can be considered as the same medical image sequence, which can be obtained by imaging the same imaging object based on the same imaging method and the same parameters.

[0058] After parsing the screenshot to obtain the first-level image identification number, second-level image identification number, and third-level image identification number of the medical image, when the processor obtains the medical image from the centralized management system based on the image identification number, it may specifically include Figure 3 The steps shown: Step S301, based on the first-level image identification number, second-level image identification number, and third-level image identification number, determine the image file storage path of the medical image on the disk of the centralized management system; Step S302, based on the image file storage path, obtain the medical image from the centralized management system.

[0059] According to the first-level image identification number, second-level image identification number, and third-level image identification number, the image file storage path on the disk of the centralized management system can be determined. The first-level image identification number, second-level image identification number, and third-level image identification number of several medical images under this image file storage path are all the same and belong to the same medical image sequence. This medical image sequence includes the intercepted medical image. The medical image sequence can be input into the image post-processing algorithm for post-processing to obtain the post-processing result and feedback it to the user.

[0060] Furthermore, if the processor also parses the fourth-level image identification number from the screenshot, then it can also determine the intercepted medical image from the above medical image sequence according to the fourth-level image identification number, input the medical image into the image post-processing algorithm for post-processing, obtain the post-processing result and feedback it to the user.

[0061] In one embodiment, intercepting the displayed screen in step S201 to obtain a screenshot may specifically include: when the user clicks the screenshot button, determine that the user issues a screenshot instruction; in response to the screenshot instruction, screenshot the displayed screen to obtain a screenshot.

[0062] A screenshot button can be provided for the user. When the user clicks the screenshot button, the processor can determine that the user issues a screenshot instruction. In response to this screenshot instruction, the screen display is captured to obtain a screenshot. Specifically, the screen capture can be implemented through technologies such as WGC (Windows Graphics Capture). The processor can call the interface of the WGC unit to trigger the WGC unit to capture the screen display.

[0063] In one embodiment, the post-processing of the medical image using the image post-processing algorithm in step S204 includes: determining, among multiple image post-processing algorithms, an image post-processing algorithm that matches the imaging modality of the medical image to obtain a target image post-processing algorithm; and inputting the medical image into the target image post-processing algorithm to post-process the medical image.

[0064] For a specific medical image, the medical image is obtained based on a certain imaging method, such as CT, MRI, or ultrasound. Correspondingly, the medical image has a corresponding imaging modality. For example, if a medical image is obtained based on the CT method, the imaging modality of this medical image is CT.

[0065] After the processor obtains the captured medical image, it can determine the imaging modality of the medical image, and determine an image post-processing algorithm that matches the imaging modality among multiple image post-processing algorithms. The image post-processing algorithm is used as the target image post-processing algorithm, and the medical image is input into the target image post-processing algorithm for post-processing. Among them, the multiple image post-processing algorithms can be the image post-processing algorithms that the user wants to use.

[0066] Furthermore, the method provided by this application further includes: obtaining the second-level image identification number included in the image identification number; and determining the imaging modality of the medical image according to the second-level image identification number.

[0067] Since the second-level image identification number can distinguish different imaging modalities (such as CT, MRI, and ultrasound, etc.), after the processor analyzes the screenshot to obtain multiple-level image identification numbers, it can determine the second-level image identification number among the multiple-level image identification numbers, and determine the imaging modality of the captured medical image according to the second-level image identification number.

[0068] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0069] In one embodiment, as Figure 4 shown, there is provided an output device for reference content of medical image analysis, including:

[0070] A screenshot processing module 401, configured to capture the displayed screen when a user loads a medical image through image analysis report software for analysis, so as to obtain a screenshot;

[0071] An analysis module 402, configured to analyze the screenshot to obtain the image identification number of the medical image;

[0072] An image acquisition module 403, configured to obtain the medical image from a centralized management system based on the image identification number;

[0073] A post-processing module 404, configured to perform post-processing on the medical image by using an image post-processing algorithm, and output a post-processing result as the reference content for the user to analyze the medical image.

[0074] In one embodiment, the analysis module 402 is further configured to: analyze the screenshot to obtain the first-level image identification number, the second-level image identification number, and the third-level image identification number of the medical image; the first-level image identification number is used to distinguish different imaging objects, the second-level image identification number is used to distinguish different imaging modalities, and the third-level image identification number is used to distinguish different parameters used in the same imaging method.

[0075] In one embodiment, the image acquisition module 403 is further configured to: determine the image file storage path of the medical image on the disk of the centralized management system based on the first-level image identification number, the second-level image identification number, and the third-level image identification number; and obtain the medical image from the centralized management system based on the image file storage path.

[0076] In one embodiment, the screenshot processing module 401 is further configured to: when the user clicks the screenshot button, determine that the user issues a screenshot instruction; in response to the screenshot instruction, capture the displayed screen to obtain a screenshot.

[0077] In one embodiment, the post-processing module 404 is further configured to: among multiple image post-processing algorithms, determine an image post-processing algorithm that matches the imaging modality of the medical image to obtain a target image post-processing algorithm; input the medical image into the target image post-processing algorithm to post-process the medical image.

[0078] In one embodiment, the device further includes an imaging module determination module, configured to: obtain a second-level image identification number included in the image identification number; determine the imaging modality of the medical image according to the second-level image identification number.

[0079] In one embodiment, the image analysis report software and the image post-processing algorithm belong to different workstations.

[0080] For the specific limitations of the output device of the reference content for medical image analysis, reference can be made to the limitations of the output method of the reference content for medical image analysis in the above text, which will not be elaborated here. Each module in the above output device of the reference content for medical image analysis can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to the above modules.

[0081] In one embodiment, a computer device is provided, and its internal structure diagram can be as Figure 5 shown. The computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store the output data of the reference content for medical image analysis. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer device further includes an input / output interface, and the input / output interface is a connection circuit for exchanging information between the processor and external devices. They are connected to the processor through a bus, abbreviated as the I / O interface. When the computer program is executed by the processor, it implements a method for outputting reference content for medical image analysis.

[0082] Those skilled in the art can understand, Figure 5The structure shown is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0083] In one embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps in the above-mentioned method embodiments are implemented.

[0084] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0085] In one embodiment, a computer program product is provided, on which a computer program is stored. The computer program is executed by a processor to implement the steps in the above-mentioned method embodiments.

[0086] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0087] Those of ordinary skill in the art can understand that all or part of the processes of implementing the above method embodiments can be completed by instructing relevant hardware through a computer program. The above computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the above method embodiments. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memories. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0088] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

[0089] The above embodiments only represent several implementation manners of the present application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several deformations and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. A method for outputting reference content for medical image analysis, It is characterized in that The method comprises: When a user loads a medical image for analysis through the image analysis report software, the displayed image is captured to obtain a screenshot; Parsing the screenshot to obtain an image identification number of the medical image; Based on the image identification number, obtaining the medical image from a centralized management system; The medical image is post-processed using an image post-processing algorithm, and a post-processing result is output as a reference for the user to analyze the medical image.

2. The method according to claim 1, It is characterized in that Parsing the screenshot to obtain the image identification number of the medical image includes: The screenshot is parsed to obtain a first-level image identification number, a second-level image identification number and a third-level image identification number of the medical image; the first-level image identification number is used to distinguish different imaging objects, the second-level image identification number is used to distinguish different imaging modalities, and the third-level image identification number is used to distinguish different parameters used in the same imaging method.

3. The method according to claim 2, It is characterized in that Based on the image identification number, obtaining the medical image from a centralized management system includes: Determine, based on the first-level image identification number, the second-level image identification number, and the third-level image identification number, an image file storage path of the medical image on a disk of the centralized management system; Based on the image file storage path, the medical image is obtained from the centralized management system.

4. The method according to claim 1, It is characterized in that Capture the displayed screen to get a screenshot, including: When the user clicks a screenshot button, determining that the user issues a screenshot instruction; In response to the screenshot instruction, a screenshot is taken of the displayed screen to obtain a screenshot.

5. The method according to claim 1, It is characterized in that The medical image is post-processed using an image post-processing algorithm, including: Determine, among multiple image post-processing algorithms, an image post-processing algorithm that matches the imaging modality of the medical image, and obtain a target image post-processing algorithm; The medical image is input into the target image post-processing algorithm to post-process the medical image.

6. The method according to claim 5, It is characterized in that Before determining, among a plurality of image post-processing algorithms, an image post-processing algorithm that matches the imaging modality of the medical image, the method further comprises: Obtaining a second-level image identification number included in the image identification number; An imaging modality of the medical image is determined according to the second-level image identification number.

7. The method according to claim 1, It is characterized in that The image analysis reporting software and the image post-processing algorithm belong to different workstations.

8. A device for outputting reference content for medical image analysis, It is characterized in that The device comprises: A screenshot processing module is used to capture the displayed screen and obtain a screenshot when the user loads the medical image for analysis through the image analysis report software; An analysis module, used to analyze the screenshot to obtain an image identification number of the medical image; An image acquisition module, configured to obtain the medical image from the centralized management system based on the image identification number; A post-processing module, configured to perform post-processing on the medical image by using an image post-processing algorithm, and output a post-processing result as reference content for the user to analyze the medical image.

9. A computer device, comprising a memory and a processor, where the memory stores a computer program, characterized in that, when the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that, when the computer program is executed by the processor, the method according to any one of claims 1 to 7 is implemented.

Images