Medical report generation method and device, computer equipment and storage medium

Abstract

The invention relates to a medical report generation method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring a medical image of a target object; based on the medical image, acquiring a stimulation analysis result of each contact on the electrode implanted into the target object; for each contact on the electrode, generating a stimulation view corresponding to the contact based on the stimulation analysis result of the contact; and generating a medical report of the target object according to the stimulation view of each contact and the basic information of the target object. For each contact on each electrode, generating a stimulation view corresponding to a single contact, thereby generating a medical report of the target object based on the stimulation view corresponding to each contact; the medical report comprises the stimulation view corresponding to the single contact, so that the user can visually and clearly see the stimulation condition of the single contact; by adopting the method, the readability of the medical report can be improved, and the efficiency and accuracy of subsequent analysis of the contact by the user through the medical report can be improved.

Description

Technical Field

[0001] This application relates to the field of medical technology, and in particular to a method, apparatus, computer device, and storage medium for generating medical reports. Background Technology

[0002] In the medical field, for neurosurgical robots, after electrodes are implanted into a patient's body using the surgical robot, it is usually necessary to perform relevant analyses on the implanted electrodes, such as analyzing the stimulation range of each contact point on the electrode, and exporting the analysis results to generate an analysis report.

[0003] However, analysis reports generated using traditional methods are often poorly readable. Summary of the Invention

[0004] Therefore, it is necessary to provide a medical report generation method, device, computer equipment, computer-readable storage medium, and computer program product that can improve the readability of postoperative analysis reports, addressing the aforementioned technical problems.

[0005] Firstly, this application provides a method for generating a medical report, including:

[0006] Acquire medical images of the target object;

[0007] Based on medical images, obtain stimulation analysis results of each contact point on the electrode implanted in the target object;

[0008] For each contact point on the electrode, a stimulation view corresponding to the contact point is generated based on the stimulation analysis results of the contact point;

[0009] Generate a medical report for the target object based on the stimulation views of each touchpoint and the basic information of the target object.

[0010] In one embodiment, the medical images include a first modality image and a second modality image. Based on the medical images, stimulation analysis results are obtained for each contact point on the electrode implanted in the target object, including:

[0011] The electrodes in the first modality image are identified to obtain the electrode identification results;

[0012] A preset region in the second modality image is identified to obtain the region identification result; the preset region includes multiple sub-regions;

[0013] Based on the electrode identification results, region identification results, and configuration information of each contact point on the electrode, the stimulation analysis results of each contact point on the electrode implanted in the target object are determined.

[0014] In one embodiment, based on electrode identification results, region identification results, and configuration information of each contact point on the electrode, the stimulation analysis results of each contact point on the electrode implanted in the target object are determined, including:

[0015] Based on the electrode identification results and the configuration information of each contact point on the electrode, the stimulation area of ​​each contact point on the electrode is determined in the medical image;

[0016] For each contact on the electrode, based on the stimulation area of ​​the contact and the region identification result, the sub-region that intersects with the stimulation area of ​​the contact is determined in the medical image;

[0017] In medical images, identify the stimulation region of the contact point and the intersection region between the sub-regions that intersect with the stimulation region of the contact point;

[0018] The stimulation analysis results of the contact are generated based on the electrode where the contact is located, the stimulation area of ​​the contact, the stimulation volume of the stimulation area, the sub-regions that intersect with the stimulation area of ​​the contact, the identifiers of the sub-regions, the intersection area between the stimulation area of ​​the contact and the intersecting sub-regions, and the volume of the intersection area.

[0019] In one embodiment, based on the stimulation analysis results of the touch point, a stimulation view corresponding to the touch point is generated, including:

[0020] The attention information corresponding to the touch point is extracted from the medical image to generate the stimulation view corresponding to the touch point; the attention information corresponding to the touch point includes at least part of the information in the stimulation analysis results of the touch point.

[0021] In one embodiment, extracting attention information corresponding to the touch point from a medical image to generate a stimulation view corresponding to the touch point includes:

[0022] The non-interested information corresponding to the touch point in the medical image is hidden, and the area containing the interest information corresponding to the touch point is extracted from the hidden medical image as the stimulation view corresponding to the touch point.

[0023] In one embodiment, an image of the region containing the attention information corresponding to the touch point is extracted from the hidden medical image as the stimulation view corresponding to the touch point, including:

[0024] Extract the region of interest corresponding to the touch point from the medical image after hiding the image.

[0025] The region image is magnified to obtain the stimulation view corresponding to the touch point.

[0026] In one embodiment, the method further includes:

[0027] A three-dimensional model of the target object is obtained based on medical image reconstruction;

[0028] Determine the display positioning of the 3D model based on the implantation direction of the electrodes;

[0029] The 3D model is repositioned according to the displayed positioning, and the repositioned 3D model is added to the stimulation view corresponding to each contact point on the electrode.

[0030] In one embodiment, the method further includes:

[0031] Display an image containing the electrodes on the current screen;

[0032] In response to the user's setting command for the electrodes, the setting interface is displayed on the current display screen;

[0033] Based on the stimulation parameters of each contact point on the electrode entered by the user on the settings interface, the configuration information of each contact point on the electrode is determined.

[0034] In one embodiment, a medical report for the target object is generated based on the stimulation view of each touchpoint and basic information about the target object, including:

[0035] Upon receiving a preview command triggered by the user on the current display interface, an initial medical report of the target object is generated and displayed based on the stimulation view of each touchpoint and the basic information of the target object.

[0036] In response to the user's instruction to adjust the target stimulus view in the initial medical report, the adjustment interface is displayed on the current display screen;

[0037] Based on the user's adjustments to the target stimulus view in the adjustment interface, the target stimulus view in the initial medical report is updated to generate a medical report for the target object.

[0038] In one embodiment, the method further includes:

[0039] Upon receiving an export command triggered by the user on the current display interface, the medical report is exported, and the stimulation views of each touchpoint in the medical report are converted into preset image formats before being exported.

[0040] Secondly, this application also provides a medical report generation device, comprising:

[0041] The first acquisition module is used to acquire medical images of the target object;

[0042] The second acquisition module is used to acquire stimulation analysis results of each contact point on the electrode implanted in the target object based on medical images;

[0043] The first generation module is used to generate a stimulation view corresponding to each contact point on the electrode based on the stimulation analysis results of the contact points.

[0044] The second generation module is used to generate a medical report for the target object based on the stimulation view of each touch point and the basic information of the target object.

[0045] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the medical report generation method in the first aspect described above.

[0046] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the medical report generation method described in the first aspect above.

[0047] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the medical report generation method described in the first aspect above.

[0048] The aforementioned medical report generation method, apparatus, computer equipment, storage medium, and computer program product involve a computer device acquiring a medical image of a target object and, based on that image, obtaining stimulation analysis results for each contact point on an electrode implanted in the target object. Then, for each contact point on the electrode, a stimulation view corresponding to that contact point is generated based on the stimulation analysis results. Finally, a medical report for the target object is generated based on the stimulation views of each contact point and the basic information of the target object. In other words, in this embodiment, a stimulation view corresponding to each contact point on each electrode is generated separately, thereby generating a medical report for the target object based on the stimulation view corresponding to each contact point. Since the medical report includes stimulation views corresponding to individual contact points, users can intuitively and clearly see the stimulation status of individual contact points, avoiding interference caused by stimulation information from other contact points. Therefore, this method not only improves the readability of the medical report but also enhances the efficiency and accuracy of subsequent contact point analysis by users through the medical report. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a diagram illustrating the application environment of a medical report generation method in one embodiment;

[0051] Figure 2This is a flowchart illustrating a medical report generation method in one embodiment;

[0052] Figure 3 This is a flowchart illustrating a medical report generation method in another embodiment;

[0053] Figure 4 This is a flowchart illustrating a medical report generation method in another embodiment;

[0054] Figure 5 This is a flowchart illustrating a medical report generation method in another embodiment;

[0055] Figure 6 This is a flowchart illustrating a medical report generation method in another embodiment;

[0056] Figure 7 This is a schematic diagram of the medical report generation process for a DBS procedure in one embodiment;

[0057] Figure 8(a) is a schematic diagram of electrode contact parameter settings in DBS procedure;

[0058] Figure 8(b) is a preview of the DBS postoperative analysis report;

[0059] Figure 8(c) shows the image corresponding to the stimulation view of one of the touch points in the DBS postoperative analysis report;

[0060] Figure 9 This is a schematic diagram of the medical report generation process for the SEEG procedure in one embodiment;

[0061] Figure 10(a) is a schematic diagram of electrode contact parameter settings in the SEEG procedure;

[0062] Figure 10(b) is a preview of the post-SEEG analysis report;

[0063] Figure 10(c) is an image corresponding to the stimulation view of one of the touch points in the SEEG postoperative analysis report;

[0064] Figure 11 This is a structural block diagram of a medical report generation device in one embodiment;

[0065] Figure 12 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0066] In order to make the purpose, technical solutions and advantages of this application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0067] Typically, after performing postoperative analysis, the neurosurgical robot needs to export the results to generate an analysis report. Postoperative analysis primarily targets deep brain stimulation (DBS) and stereotactic electroencephalography (SEEG) procedures.

[0068] The DBS procedure involves postoperative computed tomography (CT) and magnetic resonance imaging (MR) scans. The implanted electrodes are automatically extracted using the CT sequence, and the nuclei are extracted using the MR sequence. By setting the electrode parameters of the implanted electrodes, the volume of the stimulation range at each contact point on the implanted electrode, as well as the volume of the intersection between the stimulation range and the nucleus, can be calculated. The medical report generated by the DBS procedure displays basic patient information and activation information for all electrodes. This activation information may include, but is not limited to, electrode information, contact point information, nucleus information where each contact point intersects, stimulation range and volume at each contact point, and the intersection range and volume of the stimulation range and the nucleus.

[0069] The SEEG procedure involves postoperative CT scans to automatically extract the implanted electrodes, and preoperative MR sequences to extract brain atlases. For example, the brain atlas may include, but is not limited to, Brodmann Area (BA) maps. By setting the electrode parameters of the implanted electrodes, it is possible to calculate whether there is any intersection between each contact point on the implanted electrode and each region of the brain atlas. The medical report generated by the SEEG procedure can display basic patient information and activation information for all electrodes. This activation information may include, but is not limited to, electrode information, contact point information on the electrode, information on the regions where each contact point intersects with the brain atlas, stimulation range and volume of each contact point, the intersection range of the stimulation range with the intersecting brain atlas regions, and the intersection volume.

[0070] Traditionally, postoperative neurosurgical analysis reports only include basic patient information and textual versions of the corresponding analysis results, lacking pictorial representations of the intersections between implanted electrodes and nuclei or brain maps. This results in poor readability. Even when images are included, they often depict all electrode information in two-dimensional views, leading to a large amount of information if many tissues are processed, which can interfere with user judgment and further reduce readability. Furthermore, crucial information such as the reconstruction path corresponding to the implanted electrodes, the stimulation range of the electrode contacts, brain maps, and nuclei is often presented in small-scale images, making them difficult to view and analyze intuitively. Features such as default screenshots being inconvenient for observation or the ability to adjust tissue display / hiding are also not readily available or implemented.

[0071] Based on this, this application proposes a medical report generation method that generates an independent stimulation view for each contact point on each electrode, enabling users to observe and analyze the stimulation of different contact points based on different stimulation views, thereby greatly improving the readability of postoperative analysis reports.

[0072] The medical report generation method provided in this application embodiment can be applied to, for example... Figure 1 In the application environment shown, computer device 102 can be a terminal or a server; the terminal can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices, such as smartwatches, smart bracelets, and head-mounted devices. The server can be implemented using a standalone server or a server cluster composed of multiple servers.

[0073] In one exemplary embodiment, such as Figure 2 As shown, a method for generating medical reports is provided, which can be applied to... Figure 1 The following steps are used as an example of computer equipment, including steps 202 to 208. Wherein:

[0074] Step 202: Obtain medical images of the target object.

[0075] The target object can be a living human or animal with the electrode implanted, or a phantom required for a simulation experiment. After the electrode is implanted in the target object, a medical image of the target object with the implanted electrode can be obtained, and relevant information about the implanted electrode can be obtained from the medical image.

[0076] For example, a computer device can acquire medical images of a target object containing implanted electrodes from a medical imaging device, or it can acquire medical images of a target object containing implanted electrodes from a Picture Archiving and Communication System (PACS). This application embodiment does not specifically limit the method by which the computer device acquires medical images of the target object.

[0077] Furthermore, this medical image can be either an intraoperative or postoperative image; that is, during the surgical procedure, a medical image scan can be performed on the target object with implanted electrodes to obtain a medical image of the target object including the implanted electrodes. This allows for rapid analysis of the implanted electrodes during the procedure and timely adjustment of the implanted electrodes if any abnormalities are detected. Of course, the target object can also be scanned after the surgical procedure to obtain a medical image including the implanted electrodes.

[0078] For example, the medical image can be a computed tomography (CT) image, a magnetic resonance (MR) image, etc. In this embodiment of the application, the modality of the medical image is not specifically limited, as long as it can be ensured that the medical image contains the implanted electrode.

[0079] Step 204: Based on medical images, obtain the stimulation analysis results of each contact point on the electrode implanted in the target object.

[0080] The stimulation analysis results of the contact point can include one or more analysis results related to the stimulation information of the contact point, including but not limited to the stimulation region, stimulation volume, the intersection region between the stimulation region and the preset region, the volume of the intersection region, and the identifier of the preset region that intersects with the stimulation region. Optionally, the preset region can be a nucleus region, a brain atlas region, etc. For example, for DBS, the preset region can be a nucleus region, and correspondingly, the stimulation analysis results can include the target nucleus region that intersects with the stimulation region of the contact point, the intersection region between the stimulation region of the contact point and the target nucleus region, etc.; for SEEG, the preset region can be a brain atlas region, and correspondingly, the stimulation analysis results can include the target brain atlas region that intersects with the stimulation region of the contact point, the intersection region between the stimulation region of the contact point and the target brain atlas region, etc.

[0081] For example, a computer device can input a medical image of the target object into a preset analysis model to analyze the stimulation of each contact point on the electrode, thereby outputting the stimulation analysis results of each contact point on the electrode.

[0082] For example, when there are multiple electrodes in the target object, that is, when there are multiple electrodes in the medical image of the target object, the computer device can first determine the sub-medical image corresponding to each electrode based on the medical image; then, the sub-medical image corresponding to each electrode is input into the preset analysis model for analysis and processing, thereby obtaining the stimulation analysis result of each contact point on each electrode.

[0083] Step 206: For each contact point on the electrode, generate a stimulation view corresponding to the contact point based on the stimulation analysis results of the contact point.

[0084] The stimulation view corresponding to the touch point can be a three-dimensional view or a two-dimensional view.

[0085] For example, when the stimulation analysis results of each contact point on the electrode are obtained, a visual stimulation view corresponding to each contact point on the electrode can be generated based on the stimulation analysis results of the contact point. The stimulation view may include a visual image and text information. The text information may be located in the image or on the side of the image, such as the top, bottom, left or right side of the image.

[0086] For example, for each contact point on the electrode, the computer device can generate a visual stimulation view corresponding to that contact point based on one or more of the following: electrode, contact point, stimulation region, preset region intersecting with the stimulation region, and the intersection region of the two. Additionally, it can generate text information corresponding to that contact point based on information such as the contact point's identifier, the stimulation volume of the stimulation region, the identifier of the preset region intersecting with the stimulation region, and the volume of the intersection region, and add this information to the stimulation view, ultimately forming the stimulation view corresponding to that contact point. In other words, for each contact point on the electrode, the computer device can generate a visual stimulation view corresponding to that contact point based on one or more pieces of information from the stimulation analysis results of the contact point.

[0087] For example, different color attributes, transparency attributes, etc., can be used to color different objects in the stimulus view to improve the visibility of the stimulus view corresponding to the touch point.

[0088] Step 208: Generate a medical report for the target object based on the stimulation views of each touchpoint and the basic information of the target object.

[0089] For example, the basic information of the target object may include, but is not limited to, name, gender, age, date of birth, number, department, type of procedure, examination items, and report date; this application embodiment does not specifically limit this.

[0090] In this example, after acquiring the stimulation view corresponding to each contact point on the electrode, the computer device can generate a medical report for the target object based on the stimulation view of each contact point and the basic information of the target object. In this medical report, through the stimulation view corresponding to each contact point, the user can clearly see the stimulation status of each contact point, thus enabling efficient analysis of individual contact points. This avoids the situation where, with many electrodes and contact points, the presentation of too much information can prevent the user from quickly and accurately grasping the information of a single contact point, leading to errors in contact point analysis.

[0091] For example, when generating a medical report, the computer device can place the stimulation views of each contact point on the electrode in an appropriate position according to a preset view format requirement. For instance, if the view format requirement is n rows and 4 columns, the computer device can arrange the stimulation views of each contact point according to the order of each contact point on the electrode, with 4 views per row. Optionally, in the case of multiple electrodes, the stimulation views corresponding to each electrode can be placed in the same row according to the order of the electrodes, and the stimulation views of the next electrode can be placed in the next row. The number of contacts corresponding to each electrode can be the same or different. The stimulation views of different electrodes are in different rows.

[0092] In the aforementioned medical report generation method, the computer device acquires a medical image of the target object and, based on the image, obtains stimulation analysis results for each contact point on the electrode implanted in the target object. Then, for each contact point on the electrode, a stimulation view corresponding to that contact point is generated based on the stimulation analysis results. Finally, a medical report for the target object is generated based on the stimulation views of each contact point and the basic information of the target object. In other words, in this embodiment, a stimulation view corresponding to each contact point on each electrode is generated separately, thereby generating a medical report for the target object based on the stimulation view corresponding to each contact point. Since the medical report includes stimulation views corresponding to individual contact points, users can intuitively and clearly see the stimulation status of a single contact point, avoiding interference caused by stimulation information from other contact points. Therefore, this method not only improves the readability of the medical report but also enhances the efficiency and accuracy of subsequent contact point analysis by users through the medical report.

[0093] In an exemplary embodiment, the aforementioned medical image may include a first modality image and a second modality image. The first modality image includes electrodes and can be used to identify the electrodes and contacts on the electrodes. Exemplarily, the first modality image may be a postoperative scan of a preset modality medical image including the implanted electrodes; for example, a postoperative CT image. The second modality image is used to identify a preset region of the target object, obtaining multiple sub-regions of the target object. For example, if the preset region is a nucleus, the nucleus of the target object can be identified, obtaining multiple nucleus sub-regions; if the preset region is a brain atlas region, the brain atlas of the target object can be identified, obtaining multiple brain atlas sub-regions.

[0094] For example, the second modality image can be an MR image used for nucleus identification or brain mapping; in addition, the second modality image can be a preoperative medical image of the target object, or an intraoperative or postoperative medical image of the target object, etc.

[0095] It should be noted that before performing stimulation analysis on each contact point on the electrode based on the first modal image and the second modal image, the first modal image and the second modal image need to be image registered first so that the first modal image and the second modal image can achieve tissue structure alignment; for example, after image registration, the first modal image and the second modal image can also be fused to obtain a registered fused image; when performing stimulation analysis later, stimulation analysis on each contact point can also be performed based on this registered fused image.

[0096] Based on this, such as Figure 3 As shown, step 204 above may include steps 302 to 306. Wherein:

[0097] Step 302: Identify the electrodes in the first modality image to obtain the electrode identification results.

[0098] The electrode identification result may include one or more electrodes, and the electrodes may include one or more contacts.

[0099] For example, the computer device can acquire a preset electrode recognition model and input the first modal image into the preset electrode recognition model to obtain the electrode recognition result of the target object. For example, the computer device can also output the first modal image and provide a user input function, allowing the user to mark the electrodes and contacts on the electrodes in the first modal image, and the computer device can recognize the electrodes and contacts on the electrodes according to the user's markings, thereby obtaining the electrode recognition result.

[0100] Step 304: Identify the preset region in the second modality image to obtain the region identification result; the preset region includes multiple sub-regions.

[0101] For example, a computer device can acquire a preset region recognition model and input the second modality image into the preset region recognition model to obtain the region recognition result of the target object. Optionally, the preset region recognition model may include a preset nucleus recognition model and a preset brain map recognition model. For DBS, the computer device can input the second modality image of the target object into the preset nucleus recognition model to obtain the nucleus recognition result of the target object; wherein, the nucleus recognition result includes multiple nucleus sub-regions, each nucleus sub-region having a corresponding nucleus identifier and nucleus region location; for SEEG, the computer device can input the second modality image of the target object into the preset brain map recognition model to obtain the brain map recognition result of the target object; wherein, the brain map recognition result includes multiple brain map sub-regions, each brain map sub-region having a corresponding brain map identifier and brain map region location.

[0102] Step 306: Based on the electrode identification results, region identification results, and configuration information of each contact point on the electrode, determine the stimulation analysis results of each contact point on the electrode implanted in the target object.

[0103] The electrode identification results include one or more electrodes, and each electrode includes one or more contacts; the region identification results include multiple sub-regions.

[0104] For example, based on the electrode identification results and the configuration information of each contact on the electrode, the stimulation region of each contact on the electrode can be determined in the medical image, and the stimulation volume of the stimulation region can be further obtained. Then, for each contact on the electrode, based on the stimulation region of the contact and the region identification results, the sub-region intersecting with the stimulation region of the contact is determined in the medical image, and the intersection region between the stimulation region of the contact and the sub-region intersecting with the stimulation region of the contact is determined in the medical image. Furthermore, the identifiers of the corresponding intersecting sub-regions and the volume of the intersection region between the stimulation region and the intersecting sub-region can be obtained. Then, the stimulation analysis result of the contact is generated based on the electrode where the contact is located, the stimulation region of the contact, the stimulation volume of the stimulation region, the sub-region intersecting with the stimulation region of the contact, the identifier of the sub-region, the intersection region between the stimulation region of the contact and the intersecting sub-region, and the volume of the intersection region. In other words, when multiple different stimulation information related to the contact is obtained, the stimulation analysis result of the contact can be generated based on all the stimulation information related to the contact.

[0105] In other words, for each contact point on each electrode in the electrode identification results, the stimulation area of ​​the contact point can be determined first based on the position and configuration information of the contact point. Then, by combining the sub-regions identified from the second modality image, the sub-regions that intersect with the stimulation area of ​​the contact point can be determined. Here, the sub-regions that intersect with the stimulation area can include one or more. And the intersection area between the stimulation area and each intersecting sub-region can be determined.

[0106] It should be noted that the configuration information for each contact can be the same or different; when the configuration information is different, the range and size of the determined stimulation area may also be different. For example, the configuration information of the contact may include, but is not limited to, information such as voltage, resistance, and pulse width. Based on the configuration information of the contact, the stimulation range and stimulation volume of the contact can be determined.

[0107] In this embodiment, the medical image of the target object may include a first modality image for electrode identification and a second modality image for region identification. Based on this, the computer device can obtain electrode identification results by identifying electrodes in the first modality image and obtain region identification results by identifying preset regions in the second modality image, wherein the preset regions include multiple sub-regions. Furthermore, the computer device can determine the stimulation analysis results of each contact on the electrode implanted in the target object based on the electrode identification results, region identification results, and configuration information of each contact on the electrode. That is, using the method in this embodiment, the electrodes, nuclei, or brain maps implanted in the target object can be identified according to different modalities of medical images to obtain accurate identification results, thereby achieving detailed analysis of the stimulation of the contacts on the implanted electrodes and improving the accuracy and comprehensiveness of the stimulation analysis results.

[0108] In an exemplary embodiment, generating a stimulation view corresponding to the touch point based on the stimulation analysis results of the touch point in step 206 above may include:

[0109] The attention information corresponding to the touch point is extracted from the medical image to generate the stimulation view corresponding to the touch point; wherein, the attention information corresponding to the touch point may include at least part of the information in the stimulation analysis results of the touch point.

[0110] Because medical images contain a lot of information, in order to avoid other unnecessary information interfering with the relevant information of the touch point, when generating the stimulation view corresponding to the touch point, only the attention information corresponding to the touch point can be extracted from the medical image, and the stimulation view corresponding to the touch point can be generated based on this attention information. In other words, when generating the stimulation view of a single touch point, other irrelevant information of that touch point is removed or hidden, and only the attention information corresponding to that touch point is displayed, which can further improve the readability of the stimulation situation of that touch point.

[0111] For example, extracting attention information corresponding to a touch point from a medical image to generate a stimulation view corresponding to the touch point may further include: hiding non-attention information corresponding to the touch point in the medical image, and cropping the area containing the attention information corresponding to the touch point from the hidden medical image as the stimulation view corresponding to the touch point. In other words, the computer device can directly operate on the medical image to obtain the stimulation view corresponding to the touch point; that is, first, all non-attention information corresponding to the touch point in the medical image is hidden, and after hiding, only the attention information corresponding to the touch point is displayed in the medical image; then, through a screenshot operation, the area containing the attention information corresponding to the touch point is cropped from the hidden medical image, and the screenshotted area is used as the stimulation view corresponding to the touch point.

[0112] For example, for the attention information corresponding to the touch point, different attention information can be distinguished by adjusting attribute parameters such as color and transparency, so that the differences between different attention information in the generated stimulus view corresponding to the touch point are obvious, thereby improving the visual appeal and display effect of the stimulus view.

[0113] For example, when generating a stimulation view of a touch point by cropping the area containing the attention information of the touch point from a medical image, since the attention information of the touch point is usually a small part of the entire medical image, the size of the area image obtained by directly cropping is small. Therefore, in order to further improve the display effect of the stimulation view, when the computer device crops the area image containing the attention information corresponding to the touch point from the medical image after hiding it, as the stimulation view corresponding to the touch point, it can first crop the area image containing the attention information corresponding to the touch point from the medical image after hiding it, and then enlarge the area image to obtain the stimulation view corresponding to the touch point.

[0114] During the magnification process, the magnification factor of different touch points can be the same or different. The computer device can determine the magnification factor corresponding to the touch point based on the size of the image of the area where the information of interest is located and the size of the stimulation view displayed in the medical report. In other words, the size of the magnified stimulation view corresponding to each touch point can be consistent, so that the size of the stimulation view of each touch point displayed in the medical report is also consistent, which can improve the aesthetics of the medical report.

[0115] Using the method in this embodiment, when generating the stimulation view corresponding to each touch point, the non-interest information of the touch point can be hidden, so that only the interest information of the touch point is displayed in the stimulation view of the touch point, that is, the relevant information of the user's stimulation analysis of the touch point, thus avoiding interference from non-interest information to the touch point stimulation analysis; in addition, by magnifying the interest information of the touch point, the visibility and readability of the stimulation view can be further improved.

[0116] In one exemplary embodiment, such as Figure 4 As shown, the above method may further include steps 402 to 406. Wherein:

[0117] Step 402: Obtain a three-dimensional model of the target object based on medical image reconstruction.

[0118] Medical images obtained from medical imaging scans typically include at least one of the target object's internal tissues, such as vascular tissue, brain parenchyma, brain atlas, sulci, nuclei, and skull. Based on these medical images, surface reconstruction can be performed to obtain a three-dimensional model of the target object that includes its surface features. This three-dimensional model may not include the target object's internal tissues and structures. For example, if the medical image is a head image of the target object, the reconstructed three-dimensional model of the target object can be a head three-dimensional model that includes the target object's facial features, thus obtaining a simulated head model corresponding to the target object.

[0119] For example, a computer device can input a medical image into a preset reconstruction algorithm to reconstruct a three-dimensional model of the target object; the medical image here can be the first modal image mentioned above, the second modal image mentioned above, or other modal images of the target object, etc.

[0120] Step 404: Determine the display position of the three-dimensional model according to the implantation direction of the electrodes.

[0121] The relative positional relationship between the display positioning of the 3D model and the implantation direction of the electrode is consistent with the relative positional relationship between the electrode and the target object in the medical image.

[0122] For example, when generating stimulation views of the contact points for electrodes implanted in different directions in the target object, the original orientation of the electrodes where the contact points are located in the medical image can be maintained, or the original orientation of the electrodes can be adjusted so that the electrodes all maintain a preset orientation. For example, the electrodes in all stimulation views can be set to the vertical direction. After adjusting the original orientation of the electrodes, the positioning of the three-dimensional model of the target object needs to be adjusted adaptively to maintain the relative positional relationship between the three-dimensional model and the electrodes.

[0123] Therefore, in this example, when generating the stimulation view of each contact point on the electrode, the display position of the three-dimensional model can also be determined according to the implantation direction of the electrode where the contact point is located.

[0124] For example, when multiple electrodes are implanted in a target object, the display position of the three-dimensional model corresponding to each electrode can be determined according to the implantation direction of the electrode.

[0125] Step 406: Adjust the position of the 3D model according to the displayed position, and add the adjusted 3D model to the stimulation view corresponding to each contact point on the electrode.

[0126] When generating a stimulation view corresponding to a touchpoint based on the touchpoint's attention information, the display positioning of the 3D model can be adjusted according to the implantation direction of the electrode where the touchpoint is located. The 3D model is then repositioned based on this display positioning and added to the stimulation view corresponding to the touchpoint. In other words, the stimulation view of the touchpoint includes not only the touchpoint's attention information but also the 3D model of the target object in the corresponding positioning, further improving the display effect of the stimulation scene and stimulation status, which is beneficial for assisting users in subsequent analysis of the touchpoint's stimulation status. It should be noted that since all touchpoints on the same electrode belong to the same electrode, the display positioning of the 3D model corresponding to each touchpoint on the same electrode is the same. In the stimulation views of all touchpoints on the same electrode, the electrode orientation is consistent, and the display positioning of the 3D model is also consistent.

[0127] For example, the three-dimensional model in the stimulus view can be displayed at a smaller scale around the attention information of the touch point, such as the lower left corner, lower right corner, upper left corner, upper right corner, etc.; the position of the three-dimensional model in the stimulus view is not specifically limited in this embodiment.

[0128] In this embodiment, the computer device can also reconstruct a three-dimensional model of the target object based on medical images, determine the display position of the three-dimensional model according to the implantation direction of the electrode, adjust the position of the three-dimensional model according to the display position, and add the adjusted three-dimensional model to the stimulation view corresponding to each contact point on the electrode. In this way, the stimulation view corresponding to the contact point not only includes the attention information of the contact point, but also the three-dimensional model of the corresponding position, so as to assist the user in observing and analyzing the stimulation of the contact point and improving the visibility and readability of the stimulation view.

[0129] In one exemplary embodiment, a method for obtaining touch point configuration information is provided, such as... Figure 5 As shown, the above method may further include steps 502 to 506. Wherein:

[0130] Step 502: Display an image containing the electrodes on the current display interface.

[0131] Optionally, the image containing the electrodes can be a medical image of the target object mentioned above, or other images containing electrodes, such as a three-dimensional image corresponding to a three-dimensional model containing electrodes, or a reference medical image used for surgical procedures after electrodes are added to a preoperative medical image.

[0132] For example, a computer device can acquire an image containing electrodes and display the image containing electrodes on the current display interface; wherein the method of acquiring the image containing electrodes can be determined according to the type of the image; for example, if the image containing electrodes is a preoperative reference medical image, the computer device can first display the preoperative medical image of the target object on the current display interface; then, by planning the puncture path on the preoperative medical image, the puncture electrode needle is determined to obtain the reference medical image containing electrodes; or, the user can also manually plan the puncture path on the preoperative medical image to obtain the reference medical image containing electrodes, etc.

[0133] Step 504: In response to the user's setting command for the electrodes, display the setting interface on the current display screen.

[0134] For example, the current display interface may include a setting control. By clicking the setting control, the user triggers a setting command for the electrode, thereby causing the computer device to display the setting interface on the current display interface. In this case, the setting interface may include a parameter configuration area for the default electrode, or it may include parameter configuration areas for multiple electrodes or all electrodes.

[0135] For example, each electrode can also be configured with setting attributes. When a user clicks on an electrode, a setting instruction for the currently clicked electrode can be triggered to display the setting interface on the current display screen. In this case, the setting interface can include a parameter configuration area for the currently clicked electrode, that is, the setting interface can be the setting interface corresponding to the currently clicked electrode.

[0136] For example, the settings interface can also switch electrodes to configure parameters for different electrodes. For instance, the settings interface may also include an electrode input component to input different electrode information and configure parameters for the electrode corresponding to the currently input electrode information.

[0137] Additionally, the parameter configuration area for the electrode can include a sub-area for configuring parameters for each contact; alternatively, it can include only a sub-area for configuring parameters for a single contact, allowing parameter configuration for different contacts on the electrode by switching between them. For example, the settings interface can also include a contact input component to input different contact information and configure the parameters of the contacts on the electrode corresponding to the currently input contact information.

[0138] Step 506: Determine the configuration information of each contact point on the electrode based on the stimulation parameters of each contact point entered by the user on the settings interface.

[0139] The configuration information for each contact point can be the same or different.

[0140] For example, the computer device can generate configuration information for each contact point on the electrode based on the stimulation parameters of each contact point entered by the user on the settings interface, so that when performing stimulation analysis on each contact point, the stimulation analysis result of each contact point can be determined based on the configuration information of each contact point.

[0141] In addition, it should be noted that the above parameter configuration process can be performed before or after electrode implantation. In this embodiment, the timing of the electrode contact parameter configuration is not specifically limited.

[0142] In this embodiment, an image containing electrodes is displayed on the current display interface. Then, in response to a user's setting command for the electrodes, a setting interface is displayed on the current display interface. Based on the stimulation parameters of each contact point on the electrodes input by the user in the setting interface, the configuration information of each contact point on the electrodes is determined. That is, this embodiment provides an interactive implementation method for contact point configuration information. Users can trigger the setting interface for the electrodes through the image containing electrodes displayed on the current display interface, and configure the stimulation parameters of each contact point on the electrodes in this setting interface; this improves the diversity of interaction and the flexibility of parameter configuration.

[0143] In one exemplary embodiment, such as Figure 6 As shown, step 208 above may further include steps 602 to 606. Wherein:

[0144] Step 602: Upon receiving a preview command triggered by the user on the current display interface, generate and display an initial medical report of the target object based on the stimulation views of each touchpoint and the basic information of the target object.

[0145] For example, a preview control may be included on the current display interface. Before exporting the medical report, the user can trigger the preview control to preview the medical report. If the previewed medical report is found to be without problems, the medical report can be exported.

[0146] In other words, when a computer device receives a preview instruction triggered by a user clicking a preview control, it can generate and display an initial medical report of the target object based on the stimulation views of each touchpoint and the basic information of the target object.

[0147] Step 604: In response to the user's instruction to adjust the target stimulus view in the initial medical report, display the adjustment interface on the current display screen.

[0148] In other words, in the preview mode, users can also edit the stimulation views of each touchpoint in the initial medical report. If a user is not satisfied with the stimulation view of a certain touchpoint, they can click on the target stimulation view that needs to be adjusted, which will allow the computer device to jump to the adjustment interface, where the user can adjust the target stimulation view.

[0149] For example, the adjustment interface can be suspended on the current display interface or overlaid on the current display interface; and the target stimulus view is displayed in the adjustment interface.

[0150] Step 606: Based on the user's adjustment operation on the target stimulus view in the adjustment interface, update the target stimulus view in the initial medical report and generate a medical report for the target object.

[0151] For example, the adjustment interface may also include one or more different adjustment controls, including but not limited to zoom in, zoom out, rotate, pan, show, hide, and toggle controls. The toggle control may include a first toggle control and a second toggle control. The first toggle control is used to replace the target stimulus view with the previous stimulus view of the target stimulus view, that is, to display the previous stimulus view of the target stimulus view in the adjustment interface. The second toggle control is used to replace the target stimulus view with the next stimulus view of the target stimulus view, that is, to display the next stimulus view of the target stimulus view in the adjustment interface.

[0152] Based on different adjustment controls, users can perform various adjustments to the target stimulus view to obtain the adjusted target stimulus view; then, based on the adjusted target stimulus view and other stimulus views, a medical report on the target object can be generated.

[0153] For example, the current display interface may also include an export control, which allows the user to export the generated medical report of the target object by clicking the export control. Upon receiving an export command triggered by the user clicking the export control on the current display interface, the computer device can export the medical report and convert the stimulation views of each touchpoint in the medical report into preset image formats before exporting them. In other words, in this example, when exporting the medical report, the stimulation views of each touchpoint can also be saved separately as images; that is, the stimulation views of each touchpoint can be converted into preset image formats, and the converted stimulation views can be exported. The preset image format can be a default format or a user-defined format; this embodiment does not specifically limit this.

[0154] Additionally, it should be noted that users can also directly perform the export operation while previewing the initial medical report. In this case, the computer device can export the medical report with the initial medical report as the target object.

[0155] In this embodiment, the computer device can also provide preview and export functions, allowing users to preview the medical report before exporting. If they are not satisfied with the stimulation view, they can adjust it and finally export the adjusted medical report. In addition, when exporting the medical report, the stimulation views of each contact point can be saved separately in a preset image format, so that users can view the stimulation views of each contact point through the saved images later. Compared with viewing the stimulation view in the report, opening the stimulation view through the preset image format can improve the viewing effect of the stimulation view, thereby improving the reliability and accuracy of the stimulation analysis of the contact points.

[0156] In one exemplary embodiment, a complete embodiment of a medical report generation method is provided. In this method, the intersection information of the contacts of the reconstructed path (i.e., the path where the implanted electrodes are located) and the brain parenchyma or brain atlas is recorded in the form of images from a three-dimensional virtual reality (VR) view. Furthermore, when there are multiple reconstructed paths, each image in the generated report only displays the current reconstructed path, automatically hiding other reconstructed paths to remove interference. Specifically, when generating the report, the background and non-nuclear tissues of the DBS procedure are hidden to remove interference from other tissues, and the reconstructed path, nuclei, and electrode contact stimulation field are automatically magnified proportionally (the reconstructed path, nuclei, and electrode contact stimulation field are smaller in the normal view and are not easily observed in the report), and the electrode contacts of each reconstructed path are automatically positioned (relative to the observer's perspective). The SEEG procedure automatically hides the background and non-brain atlas tissues of the sequence to remove interference from other tissues, and automatically enlarges the electrode needles and brain atlas tissues proportionally (the electrode needles and brain atlas are small in the normal view and are not easy to observe in the report). The SEEG procedure automatically positions and highlights the atlas partitions of each contact point (relative to the observer's perspective).

[0157] Furthermore, when previewing a report, if adjustments are needed to the image content, the image to be adjusted can be selected to enter the adjustment interface, which displays a VR view of the current image. The VR view can then be positioned, and adjustments and markings can be made to the path, sequence, and organization. For example, the display or hiding of sequences, window width and level can be adjusted, or the organization can be shown or hidden. General tools can also be used to mark image content.

[0158] Furthermore, when exporting medical reports, the 3D images within the report can be saved as vector graphics, allowing users to easily annotate each image individually without distortion when zoomed in. Post-operative analysis results are also saved and can be used for re-importing.

[0159] The following sections provide a detailed description of the medical report generation process for both DBS and SEEG procedures.

[0160] refer to Figure 7 As shown, it illustrates the process of generating and exporting medical reports for DBS procedures, including the following steps:

[0161] Step 1: Select the preoperative sequence and add the postoperative CT sequence and postoperative MR sequence to enter the DBS procedure.

[0162] Step 2: Perform anterior commissure-posterior commissure (ACPC) correction on the postoperative MR sequence, then extract the nucleus based on the postoperative MR sequence, and automatically reconstruct and extract the implanted electrode needle based on the postoperative CT sequence.

[0163] Step 3: Select a reconstruction path (i.e., an implanted electrode), set the electrode needle contact and contact parameters, as shown in Figure 8(a), which shows a schematic diagram of an electrode parameter setting interface. The electrode parameter setting interface may include an electrode needle schematic diagram and multiple parameter setting components; among them, the contact parameters may include, but are not limited to, voltage, resistance and pulse width.

[0164] For example, in this electrode parameter setting interface, parameters for multiple contacts on the same electrode can be set; for instance, one of the contacts can be selected in the example diagram of the electrode needle, and then the parameters set by the multiple parameter setting components are the contact parameters corresponding to the selected contact.

[0165] Step 4: Calculate the stimulation analysis results of each contact point of the selected electrode needle, including but not limited to the stimulation area, stimulation volume, and intersection size with the nucleus of the contact point.

[0166] Step 5: Select the next electrode needle and repeat steps 3 and 4.

[0167] Step 6, Preview the report. The preview report interface supports operations such as page turning, zooming in and out, slider dragging, exiting the preview, and exporting the report. Each image in the report displays the current reconstruction path and automatically hides other electrodes to remove interference from other reconstruction paths. The DBS procedure can hide the background and non-nuclear tissues of the sequence to remove interference from other tissues, and automatically calculates and enlarges the reconstruction path, nuclei, and stimulation field (the reconstruction electrodes, nuclei, and stimulation field are small in the normal view and are not easy to observe in the report), and automatically positions the electrode contacts of each reconstruction path (relative to the observer's viewpoint); as shown in Figure 8(b).

[0168] Step 7: Adjust the report and display the VR view of the current report images, adjusting the path, organization, sequence, and image placement.

[0169] Step 8: Generate a post-DBS medical report. For example, when generating a post-DBS medical report, each stimulus view in the report can be exported separately as an image. The post-DBS medical report can be referenced in Figure 8(b), and the stimulus views can be referenced in Figure 8(c). The post-operative analysis results will also be saved.

[0170] refer to Figure 9 As shown, it illustrates the medical report generation and export process for the SEEG procedure, including the following steps:

[0171] Step 1: Select the preoperative MR sequence and add the postoperative CT sequence to enter the SEEG procedure.

[0172] Step 2: Automatically reconstruct and extract implanted electrode needles based on postoperative CT sequences, and extract brain atlases based on preoperative MR sequences.

[0173] Step 3: Select a reconstruction path (i.e., an implanted electrode), and set the electrode needle contacts and contact parameters for the reconstruction path, as shown in Figure 10(a). The electrode parameter setting interface may include an electrode needle schematic diagram and multiple parameter setting components. The contact parameters may include, but are not limited to, instrument diameter, number of contacts, contact spacing, contact length, and tip distance.

[0174] For example, in this electrode parameter setting interface, parameters for multiple contacts on the same electrode can be set. For instance, one contact can be selected in the example electrode needle diagram, and the parameters set by the multiple parameter setting components will then be the contact parameters corresponding to the selected contact. For example, the electrode parameter setting interface may also include a batch setting control. For instance, when the batch setting control is selected, the parameters set by the multiple parameter setting components can be used as the contact parameters for each contact. When the batch setting control is not selected, parameters can be set sequentially for each contact, or each contact can be flexibly selected for parameter setting.

[0175] Step 4: Automatically calculate the stimulation analysis results of each contact point on the selected electrode needle; including but not limited to the stimulation area, stimulation volume, intersection area between the stimulation area and a certain region of the brain map, and the size of the intersection.

[0176] Step 5: Select the next electrode needle and repeat steps 3 and 4.

[0177] Step 6, Preview the report. The preview report interface supports page turning, zooming in and out, slider dragging, exiting the preview, and exporting the report. The report displays the current reconstruction path and automatically hides other electrodes to remove interference from other reconstruction paths. When generating the report, the SEEG procedure automatically hides the background of the sequence and non-brain atlas tissues to remove interference from other tissues, and automatically enlarges the electrode needles and brain atlas tissues proportionally (the electrode needles and brain atlas are small in the normal view and are not easy to observe in the report). The SEEG procedure automatically positions and highlights the atlas partitions of each contact point (relative to the observer's viewpoint). As shown in Figure 10(b).

[0178] Step 7: Adjust the report and display the VR view of the current report images, adjusting the path, organization, sequence, and image placement.

[0179] Step 8: Generate a post-SEEG medical report. For example, when generating a post-SEEG medical report, each stimulus view in the report can be exported separately as an image. The post-SEEG medical report can be referenced in Figure 10(b), and the stimulus views can be referenced in Figure 10(c). The post-operative analysis results will also be saved.

[0180] In the medical report generation workflows for the DBS and SEEG procedures described above, postoperative analysis results are recorded using 3D VR view images. Interfering graphic elements are hidden while essential graphic elements are magnified, making it more suitable for analysis, localization, and postoperative effect evaluation. Furthermore, during report preview, the VR view perspective can be adjusted, allowing for the showing / hiding of paths, tissues, and sequences, as well as marking with tools, increasing the flexibility of report adjustments. Moreover, all images in the report can be saved independently as vector graphics, facilitating subsequent marking and detailed viewing; postoperative analysis results are also saved for later review and adjustment. These medical report generation functions enhance the completeness and comprehensiveness of the medical report generation process.

[0181] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the steps or stages of other steps.

[0182] Based on the same inventive concept, this application also provides a medical report generation apparatus for implementing the medical report generation method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more embodiments of the medical report generation apparatus provided below can be found in the limitations of the medical report generation method described above, and will not be repeated here.

[0183] In one exemplary embodiment, such as Figure 11 As shown, a medical report generation device is provided, comprising: a first acquisition module 1102, a second acquisition module 1104, a first generation module 1106, and a second generation module 1108, wherein:

[0184] The first acquisition module 1102 is used to acquire medical images of the target object.

[0185] The second acquisition module is used to acquire stimulation analysis results of each contact point on the electrode implanted in the target object based on medical images.

[0186] The first generation module 1106 is used to generate a stimulation view corresponding to each contact point on the electrode based on the stimulation analysis results of the contact points.

[0187] The second generation module 1108 is used to generate a medical report of the target object based on the stimulation view of each touch point and the basic information of the target object.

[0188] In one embodiment, the medical image includes a first modality image and a second modality image, and the second acquisition module includes:

[0189] The first identification unit is used to identify the electrodes in the first modality image and obtain the electrode identification result;

[0190] The second recognition unit is used to recognize a preset region in the second modality image and obtain a region recognition result; the preset region includes multiple sub-regions;

[0191] The determination unit is used to determine the stimulation analysis results of each contact point on the electrode implanted on the target object based on the electrode identification results, the region identification results, and the configuration information of each contact point on the electrode.

[0192] In one embodiment, the determining unit is specifically configured to: determine the stimulation region of each contact on the electrode in a medical image based on the electrode identification result and the configuration information of each contact on the electrode; and for each contact on the electrode, determine the sub-region intersecting with the stimulation region of the contact in the medical image based on the stimulation region of the contact and the region identification result; determine the intersection region between the stimulation region of the contact and the sub-region intersecting with the stimulation region of the contact in the medical image; and generate the stimulation analysis result of the contact based on the electrode where the contact is located, the stimulation region of the contact, the stimulation volume of the stimulation region, the sub-region intersecting with the stimulation region of the contact, the identifier of the sub-region, the intersection region between the stimulation region of the contact and the intersecting sub-region, and the volume of the intersection region.

[0193] In one embodiment, the first generation module 1106 is specifically used to extract attention information corresponding to the touch point from the medical image to generate a stimulation view corresponding to the touch point; the attention information corresponding to the touch point includes at least part of the information in the stimulation analysis results of the touch point.

[0194] In one embodiment, the first generation module 1106 is specifically used to hide the non-interest information corresponding to the touch point in the medical image, and to extract the area image where the interest information corresponding to the touch point is located from the medical image after hiding the information, as the stimulation view corresponding to the touch point.

[0195] In one embodiment, the first generation module 1106 is specifically used to extract the region image where the attention information corresponding to the touch point is located from the medical image after the hiding process; and to enlarge the region image to obtain the stimulation view corresponding to the touch point.

[0196] In one embodiment, the device further includes:

[0197] The reconstruction module is used to reconstruct a 3D model of the target object based on medical images.

[0198] The first determining module is used to determine the display position of the three-dimensional model based on the implantation direction of the electrodes;

[0199] The module is used to adjust the position of the 3D model according to the display position, and add the adjusted 3D model to the stimulation view corresponding to each contact point on the electrode.

[0200] In one embodiment, the device further includes:

[0201] The display module is used to display an image containing electrodes on the current display interface;

[0202] The settings module is used to respond to user commands for setting the electrodes and display the settings interface on the current display screen.

[0203] The second determining module is used to determine the configuration information of each contact point on the electrode based on the stimulation parameters of each contact point on the electrode entered by the user on the setting interface.

[0204] In one embodiment, the second generation module 1108 includes:

[0205] The generation unit is used to generate and display an initial medical report of the target object based on the stimulation view of each touch point and the basic information of the target object when it receives a preview command triggered by the user on the current display interface.

[0206] The adjustment module is used to display the adjustment interface on the current display screen in response to the user's adjustment command for the target stimulus view in the initial medical report.

[0207] The update module is used to update the target stimulus view in the initial medical report based on the user's adjustment operations on the target stimulus view in the adjustment interface, and generate a medical report for the target object.

[0208] In one embodiment, the device further includes:

[0209] The export module is used to export medical reports upon receiving an export command triggered by the user on the current display interface, and to convert the stimulation views of each touchpoint in the medical report into preset image formats before exporting them.

[0210] The modules in the aforementioned medical report generation device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.

[0211] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 12 As shown, the computer device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a medical report generation method. The display unit is used to form a visually visible image and can be a display screen, projection device, or virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0212] Those skilled in the art will understand that Figure 12 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0213] In one exemplary embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the medical report generation method in any of the above embodiments.

[0214] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the medical report generation method in any of the above embodiments.

[0215] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the medical report generation method in any of the above embodiments.

[0216] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0217] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0218] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0219] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for generating medical reports, characterized in that, The method includes: Acquire medical images of the target object; Based on the medical images, the stimulation analysis results of each contact point on the electrodes implanted in the target object are obtained; For each contact point on the electrode, a stimulation view corresponding to the contact point is generated based on the stimulation analysis results of the contact point; A medical report for the target object is generated based on the stimulation views of each of the touch points and the basic information of the target object.

2. The method according to claim 1, characterized in that, The medical images include a first modality image and a second modality image. The step of obtaining stimulation analysis results for each contact point on the electrode implanted in the target object based on the medical images includes: The electrodes in the first modality image are identified to obtain the electrode identification results; A preset region in the second modality image is identified to obtain a region identification result; the preset region includes multiple sub-regions; Based on the electrode identification results, the region identification results, and the configuration information of each contact point on the electrode, the stimulation analysis results of each contact point on the electrode implanted in the target object are determined.

3. The method according to claim 2, characterized in that, The step of determining the stimulation analysis results of each contact point on the electrode implanted in the target object based on the electrode identification results, the region identification results, and the configuration information of each contact point on the electrode includes: Based on the electrode identification results and the configuration information of each contact point on the electrode, the stimulation area of ​​each contact point on the electrode is determined in the medical image; For each contact point on the electrode, based on the stimulation area of ​​the contact point and the area identification result, a sub-region intersecting with the stimulation area of ​​the contact point is determined in the medical image; In the medical image, determine the intersection region between the stimulation region of the contact point and the sub-regions that intersect with the stimulation region of the contact point; The stimulation analysis results of the contact are generated based on the electrode where the contact is located, the stimulation area of ​​the contact, the stimulation volume of the stimulation area, the sub-region that intersects with the stimulation area of ​​the contact, the identifier of the sub-region, the intersection area between the stimulation area of ​​the contact and the intersecting sub-region, and the volume of the intersection area.

4. The method according to claim 3, characterized in that, The generation of a stimulation view corresponding to the touch point based on the stimulation analysis results of the touch point includes: Attention information corresponding to the touch point is extracted from the medical image to generate a stimulation view corresponding to the touch point; the attention information corresponding to the touch point includes at least part of the information in the stimulation analysis results of the touch point.

5. The method according to claim 4, characterized in that, The step of extracting attention information corresponding to the touch point from the medical image to generate a stimulation view corresponding to the touch point includes: The non-interested information corresponding to the touch point in the medical image is hidden, and the area where the interest information corresponding to the touch point is located is extracted from the medical image after the hiding process, as the stimulation view corresponding to the touch point.

6. The method according to claim 4, characterized in that, The step of extracting the region image containing the attention information corresponding to the touch point from the hidden medical image as the stimulation view corresponding to the touch point includes: Extract the area image containing the attention information corresponding to the touch point from the medical image after the hiding process; The image of the area is magnified to obtain the stimulation view corresponding to the touch point.

7. The method according to claim 4, characterized in that, The method further includes: A three-dimensional model of the target object is reconstructed based on the medical image; The display positioning of the three-dimensional model is determined based on the implantation direction of the electrodes; The three-dimensional model is positioned according to the displayed positioning, and the adjusted three-dimensional model is added to the stimulation view corresponding to each contact point on the electrode.

8. The method according to claim 2, characterized in that, The method further includes: Display an image containing the electrodes on the current screen; In response to the user's setting command for the electrode, a setting interface is displayed on the current display interface; Based on the stimulation parameters of each contact point on the electrode entered by the user on the settings interface, the configuration information of each contact point on the electrode is determined.

9. The method according to claim 1, characterized in that, The step of generating a medical report for the target object based on the stimulation views of each of the touch points and the basic information of the target object includes: Upon receiving a preview command triggered by the user on the current display interface, an initial medical report of the target object is generated and displayed based on the stimulation view of each touch point and the basic information of the target object; In response to the user's instruction to adjust the target stimulus view in the initial medical report, an adjustment interface is displayed on the current display interface; Based on the user's adjustment operation on the target stimulus view in the adjustment interface, the target stimulus view in the initial medical report is updated to generate a medical report for the target object.

10. The method according to claim 1, characterized in that, The method further includes: Upon receiving an export command triggered by the user on the current display interface, the medical report is exported, and the stimulation views of each touch point in the medical report are converted into preset image formats before being exported.

11. A medical report generation device, characterized in that, The device includes: The first acquisition module is used to acquire medical images of the target object; The second acquisition module is used to acquire stimulation analysis results of each contact point on the electrode implanted in the target object based on the medical image; The first generation module is used to generate a stimulation view corresponding to each contact point on the electrode based on the stimulation analysis results of the contact points; The second generation module is used to generate a medical report for the target object based on the stimulation view of each of the touch points and the basic information of the target object.

12. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 10.

Images