Surgical field presentation methods, apparatuses, devices, and media

Abstract

The embodiment of the application discloses a surgical field display method, device, equipment and medium, wherein the method comprises: acquiring a preset modality three-dimensional image and a three-dimensional ultrasound image of a preset region of interest, which displays preset tumor marker information; in response to an image fusion instruction, fusing the preset modality three-dimensional image and the three-dimensional ultrasound image to obtain an initial fusion effect image; in response to an image adjustment instruction of a user on the initial fusion effect image, adjusting the image display effect to obtain and display a target fusion effect image. The technical scheme of the embodiment of the application can display the surgical field intuitively and stereoscopically, so that the doctor can obtain more comprehensive and accurate structural morphological information and position information of the tumor, which is beneficial to assisting the doctor in positioning and diagnosing the lesion.

Description

Technical Field

[0001] The present invention relates to the field of medical image processing technology, and in particular to a method, apparatus, device and medium for displaying surgical field of view. Background Technology

[0002] Most biopsy procedures are performed manually, where doctors use a standard ultrasound probe to guide the needle to the target location for puncture. Currently, there is a technique that uses a fusion of MRI (Magnetic Resonance Imaging) and ultrasound images. This allows for targeted puncture by selecting a point on the MRI image and performing the puncture at the corresponding location on the ultrasound image.

[0003] However, in the process of realizing this invention, it was found that at least the following technical problems exist in the prior art:

[0004] MRI images can only determine the presence of lesions suspected of being cancerous from an imaging perspective. The accuracy depends on the doctor's understanding of MRI images and is not universally applicable. Summary of the Invention

[0005] This invention provides a method, apparatus, device, and medium for displaying a surgical field of view, enabling image overlay display. This allows for a more intuitive and three-dimensional display of the surgical field of view, providing surgeons with more comprehensive and accurate information on the structure, morphology, and location of tumors, thus assisting in the localization and diagnosis of lesions. In a first aspect, this invention provides a method for displaying a surgical field of view, comprising:

[0006] Acquire a preset modal 3D image and 3D ultrasound image displaying preset tumor marker information within a preset region of interest;

[0007] In response to the image fusion command, the preset modal 3D image and 3D ultrasound image are fused to obtain the initial fused image;

[0008] In response to the user's image adjustment command for the initial blended image, the image display effect is adjusted to obtain and display the target blended image.

[0009] Secondly, embodiments of the present invention also provide a surgical field display device, the device comprising:

[0010] The image data acquisition module is used to acquire a preset modal 3D image and a 3D ultrasound image displaying preset tumor marker information in a preset region of interest;

[0011] The image fusion module is used to fuse a preset modal 3D image and a 3D ultrasound image in response to an image fusion command to obtain an initial fusion effect image;

[0012] The image adjustment and display module is used to adjust the image display effect in response to the user's image adjustment command for the initial blended image, and to obtain and display the target blended image.

[0013] Thirdly, embodiments of the present invention also provide a computer device, the computer device comprising:

[0014] One or more processors;

[0015] Memory, used to store one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the surgical field display method as provided in any embodiment of the present invention.

[0017] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the surgical field display method as provided in any embodiment of the present invention.

[0018] The embodiments of the above invention have the following advantages or beneficial effects:

[0019] This invention involves acquiring a preset modal 3D image and a 3D ultrasound image displaying preset tumor marker information within a preset region of interest; fusing the preset modal 3D image and the 3D ultrasound image in response to an image fusion command to obtain an initial fused image; and adjusting the image display effect in response to a user's image adjustment command for the initial fused image to obtain and display a target fused image. This technical solution provides a clear and three-dimensional view of the surgical field, enabling doctors to obtain more comprehensive and accurate information about the tumor's structure, morphology, and location, thus assisting doctors in lesion localization and diagnosis. Attached Figure Description

[0020] Figure 1 This is a flowchart of a surgical field display method provided in an embodiment of the present invention;

[0021] Figure 2 This is a surgical field of view display diagram provided by an embodiment of the present invention;

[0022] Figure 3 This is a structural block diagram of a surgical field display device provided in an embodiment of the present invention;

[0023] Figure 4 This is a structural block diagram of a computer device provided in an embodiment of the present invention. Detailed Implementation

[0024] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.

[0025] Figure 1 This is a flowchart illustrating a surgical field display method according to an embodiment of the present invention. This embodiment is applicable to surgical field display scenarios, particularly for prostate surgery. The method can be executed by a surgical field display device, which can be implemented in software and / or hardware and integrated into a computer device with application development capabilities.

[0026] like Figure 1 As shown, the surgical field display method in this embodiment includes the following steps:

[0027] S110. Obtain a preset modal 3D image and a 3D ultrasound image displaying preset tumor marker information in a preset region of interest.

[0028] The preset region of interest is the area where the patient will undergo surgery. It can be an area that can be detected by ultrasound probes and endoscopes, or an area suspected of containing a tumor, such as the prostate, esophagus, and pleural cavity.

[0029] Tumor markers are chemical substances that reflect the presence of tumors. They may be absent from normal adult tissues and found only in embryonic tissues, or their concentration in tumor tissues may be significantly higher than in normal tissues. Their presence or quantitative changes can indicate the nature of the tumor, thereby providing insights into tumor histogenesis, cell differentiation, and cell function, aiding in tumor diagnosis, classification, prognosis, and treatment guidance. Examples include tumor metabolic information and tumor cell composition information. Displaying tumor marker information through images is an image modality that reflects the likelihood of a tumor. Preset tumor marker information can be obtained through positron emission tomography (PET) or other methods.

[0030] The pre-modal 3D image overlaid with preset tumor marker information can be any clinically acquireable medical image reflecting tissue structure and other information. For example, it can include 3D images from positron emission tomography-computed tomography (PET-CT) scans and 3D images from positron emission tomography (PET) and magnetic resonance imaging (MRI) scans. The 3D image includes multi-dimensional scale information, and presenting it directly to the user in a stereoscopic display during surgery allows the user to obtain more comprehensive and accurate structural and morphological information about the area to be operated on.

[0031] PET-CT integrates PET and CT, providing detailed molecular information on the function and metabolism of tumor lesions via PET, while CT provides precise anatomical localization of the lesions. By highly accurately fusing the molecular, genetic, receptor, cellular, and functional information obtained from PET with the anatomical information obtained from CT, a single imaging session can acquire tomographic images of the entire body from all directions. It is characterized by its sensitivity, accuracy, specificity, and precise localization, making it one of the best clinical methods for diagnosing and guiding the treatment of various diseases.

[0032] PET-MRI can perform PET and MRI scans simultaneously, enabling imaging of disease cells that have spread throughout tissues. It provides more detailed information about tumor anatomy, with high sensitivity and accuracy, and is valuable for the early detection and diagnosis of many diseases, especially tumors.

[0033] Preset modal 3D images can be obtained by the user through a medical imaging device before surgery, or by reading preset modal 3D images of the area to be operated on previously taken by the patient from a database.

[0034] Three-dimensional ultrasound images are acquired through a three-dimensional ultrasound probe. The acoustic components of the probe can rotate around an axis to reconstruct the acquired ultrasound images into three-dimensional ultrasound images. The images have a strong sense of stereoscopic effect and clearly and intuitively display the three-dimensional structure of the area to be operated on, as well as the dynamic and real-time observation of the three-dimensional structure.

[0035] Before surgery, the user can obtain PET-CT images of the area to be operated on using a positron emission tomography (PET) scanner, or PET-MRI images of the same area using a positron emission tomography (PET) scanner and a magnetic resonance imaging (MRI) scanner. At the same time, a three-dimensional ultrasound image of the area can be obtained using a three-dimensional ultrasound probe. Alternatively, a three-dimensional ultrasound image can be obtained first, followed by a PET-CT or PET-MRI image.

[0036] S120, In response to the image fusion command, the preset modal 3D image and the 3D ultrasound image are fused to obtain the initial fusion effect image.

[0037] Furthermore, the process of fusing a preset modal 3D image and a 3D ultrasound image in response to an image fusion instruction includes: inputting the image data of the preset modal 3D image and the image data of the 3D ultrasound image into a preset image fusion algorithm for image fusion according to the image fusion instruction.

[0038] The image fusion command can be a command sent by the user, such as by clicking the screen or pressing a button.

[0039] The image data of the preset modal three-dimensional image can be image data of PET-CT or PET-MRI images of the area of ​​the patient to be operated on. For example, it can include: the location of suspected tumor lesions, the morphology and structure of the tumor, and the number of tumors.

[0040] The preset image fusion algorithm can automatically fuse images based on pixel similarity calculations in MRI and 3D ultrasound images. Alternatively, it can utilize three or more pairs of markers with characteristic locations selected by the user in a preset modality of 3D and 3D ultrasound images, performing registration based on the position and angle of the markers to ensure spatial consistency. After fusion, tumor marker information is also fused with the 3D ultrasound image.

[0041] Understandably, when a user sends an image fusion command by clicking the screen or pressing a button, the image data of the PET-CT or PET-MRI image of the area to be operated on and the image data of the 3D ultrasound image are input into a preset image fusion algorithm according to the image fusion command. The PET-CT or PET-MRI image is registered with the 3D ultrasound image to ensure that the image meets the consistency in time and space. The image information, especially the tumor marker information, is automatically fused to obtain the initial fused image.

[0042] S130: In response to the user's image adjustment command for the initial blended effect image, adjust the image display effect to obtain and display the target blended effect image.

[0043] Among them, the image adjustment command can be a command sent by the user to process the initial blended image. For example, the user sends the image adjustment command by clicking the screen or pressing a button.

[0044] The target fusion effect image is the final effect image obtained after image adjustment instructions. Users can use the target fusion effect image to clearly see the location information of the tumor lesion.

[0045] Specifically, adjusting the image display effect in response to the user's image adjustment command for the initial fusion effect image may include: hiding the preset modal 3D image information in the initial fusion effect image and displaying the preset tumor marker information in pseudo-color.

[0046] The basic principle of pseudo-color display is to match each gray level of a black-and-white or monochrome image to a point in a color space, thereby mapping the monochrome image into a color image. Different colors are assigned to different gray levels in a black-and-white image. Given different mapping functions, a grayscale image can be converted into different pseudo-color images.

[0047] Specifically, adjusting the image display effect in response to the user's image adjustment command for the initial fusion effect image may also include: hiding the image information in the positron emission tomography scan image information of the preset modality 3D image that does not contain preset tumor marker information.

[0048] The initial fusion image already includes image information of preset tumor markers in the preset region of interest. In order to display the tumor lesions more clearly and intuitively, it is necessary to hide the parts of the image that do not contain preset tumor marker information. Therefore, the image display effect needs to be adjusted by the user issuing an image adjustment command for the initial fusion image.

[0049] Optionally, adjusting the image display effect in response to the user's image adjustment command for the initial fusion effect image may include: adjusting the window width and / or window level of the initial fusion effect image displaying preset tumor marker information.

[0050] Users can adjust the window width and / or window level of the initial fusion image displaying preset tumor marker information by inputting the window width and / or window level. The advantage of this setting is that it makes the image of the lesion in the area to be operated on by the user clearer.

[0051] Understandably, in the initial fusion image, the PET-MRI and PEI-CT image information is hidden. By assigning color values ​​to grayscale values, the grayscale images of tumor lesions in the obtained PET-MRI and PEI-CT images are converted into color images, improving the user's ability to distinguish image details and achieving the purpose of image enhancement. Furthermore, by adjusting the window width and / or window level of the image of the prostate region lesion to be operated on, the target fusion image can be obtained and displayed. The user can use the target fusion image to clearly identify the location information of the prostate tumor lesion, which can be used to guide puncture during prostate surgery.

[0052] In this embodiment of the invention, a preset modal 3D image and a 3D ultrasound image displaying preset tumor marker information are acquired within a preset region of interest. In response to an image fusion command, the preset modal 3D image and the 3D ultrasound image are fused to obtain an initial fused image. In response to a user's image adjustment command for the initial fused image, the image display effect is adjusted to obtain and display a target fused image. This allows for a direct and three-dimensional display of the surgical field of view, enabling doctors to obtain more comprehensive and accurate information about the tumor's structure, morphology, and location, thus assisting doctors in lesion localization and diagnosis.

[0053] In a specific example of a prostate biopsy surgical field of view, such as Figure 2 This is a surgical field of view display diagram provided by an embodiment of the present invention.

[0054] Specifically, the steps to obtain the corresponding surgical field diagram are as follows:

[0055] 1. First, import / scan the 3D images of the patient's prostate region containing PSMA (prostate-specific membrane antigen) PET-CT or PET-MRI. Then, use the 3D probe built into the urinary ultrasound system to obtain a 3D ultrasound image of the patient's prostate region. Alternatively, you can obtain the 3D ultrasound image first and then import the PET-CT / PET-MRI image.

[0056] PSMA PET-CT is an imaging examination for prostate cancer. It is a relatively accurate PET / CT examination and a significant method for the early detection of prostate cancer. PSMA combines PET and CT images, allowing it to detect even small lesions of prostate cancer, thus providing a more comprehensive and accurate diagnosis. PSMA is more accurate and precise than prostate MRI alone, detecting early prostate lesions, as well as metastases to surrounding lymph nodes and other organs, such as bone and lung metastases.

[0057] 2. The doctor issues an image fusion command by clicking on the interactive interface of the operating terminal to obtain the initial fusion effect image.

[0058] Specifically, when the acquired 3D image is a PET-CT image, a point-selection fusion method is used to select at least three pairs of points at the same location in both the PET-CT and 3D ultrasound images. The algorithm automatically fuses the PET-CT and 3D ultrasound images together based on these points. When the acquired image is a PET-MRI image, an automatic fusion method is used to fuse the PET-MRI and 3D ultrasound images. The fused image is the initial fusion result image.

[0059] 3. The doctor issues image adjustment commands by clicking the screen to adjust the initial fusion effect image to obtain the target fusion effect image.

[0060] Specifically, the initial fusion image is displayed, the PET-CT / PET-MRI images are turned off, the initial fusion image is set to pseudo-color display, the window level and window width of the initial fusion image are adjusted, and the black pixels of the initial fusion image are set to transparent to obtain the target fusion image with the suspected prostate cancer location marked.

[0061] 4. Doctors can use the target fusion effect image to guide prostate puncture.

[0062] Figure 3 This is a structural block diagram of a surgical field display device provided in an embodiment of the present invention. This embodiment is applicable to the display of surgical field. The device can be implemented by software and / or hardware and integrated into a computer terminal device with application development capabilities.

[0063] like Figure 3 As shown, the surgical field display device includes: an image data acquisition module 210, an image fusion module 220, and an image adjustment and display module 230.

[0064] The image data acquisition module 210 is used to acquire a preset modal three-dimensional image and a three-dimensional ultrasound image displaying preset tumor marker information in a preset region of interest; the image fusion module 220 is used to fuse the preset modal three-dimensional image and the three-dimensional ultrasound image in response to an image fusion command to obtain an initial fusion effect image; the image adjustment and display module 230 is used to adjust the image display effect in response to a user's image adjustment command for the initial fusion effect image to obtain and display the target fusion effect image.

[0065] In this embodiment of the invention, a preset modal three-dimensional image and a three-dimensional ultrasound image displaying preset tumor marker information are acquired in a preset region of interest; in response to an image fusion command, the preset modal three-dimensional image and the three-dimensional ultrasound image are fused to obtain an initial fused image; in response to a user's image adjustment command for the initial fused image, the image display effect is adjusted to obtain and display a target fused image. The technical solution of this embodiment of the invention can intuitively and three-dimensionally display the surgical field of view, enabling doctors to obtain more comprehensive and accurate information on the structural morphology and location of the tumor, which is beneficial for assisting doctors in lesion localization and diagnosis. Optionally, the image adjustment and display module 230 is specifically used for:

[0066] The preset modal 3D image information in the initial fusion effect image is hidden, and the preset tumor marker information is displayed in pseudo-color.

[0067] Optionally, the image adjustment and display module 230 can also be used for:

[0068] Adjust the window width and / or window level for displaying preset tumor marker information.

[0069] Optionally, the preset modal 3D images include: positron emission tomography (PET) scan 3D images and positron emission tomography (PET) and magnetic resonance imaging (MRI) scan 3D images.

[0070] Optionally, the image adjustment and display module 230 can also be used for:

[0071] Image information that does not contain preset tumor marker information in the positron emission tomography scan image information of the preset modality 3D image.

[0072] Optionally, the image fusion module 220 is specifically used for:

[0073] According to the image fusion instruction, the image data of the preset modal 3D image and the image data of the 3D ultrasound image are input into the preset image fusion algorithm for image fusion.

[0074] Optionally, the preset region of interest is the prostate region to be operated on.

[0075] The surgical field display device provided in the embodiments of the present invention can execute the surgical field display method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0076] Figure 4 This is a structural block diagram of a computer device provided in an embodiment of the present invention. Figure 4 A block diagram of an exemplary computer device 12 suitable for implementing embodiments of the present invention is shown. Figure 4 The computer device 12 shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present invention. The computer device 12 can be any terminal device with computing capabilities, such as intelligent controllers, computers, mobile phones, and other terminal devices.

[0077] like Figure 4 As shown, the computer device 12 is represented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing unit 16).

[0078] Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0079] Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0080] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (…). Figure 4 Not shown; usually referred to as a "hard drive"). Although Figure 4 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0081] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of the present invention.

[0082] Computer device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and / or with any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 22. Furthermore, computer device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be understood that, although... Figure 4 As not shown, it can be used in conjunction with computer device 12 with other hardware and / or software modules, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0083] Processing unit 16 executes various functional applications and data processing by running programs stored in system memory 28, such as implementing the surgical field display method provided in this embodiment, which includes:

[0084] Acquire a preset modal 3D image and 3D ultrasound image displaying preset tumor marker information within a preset region of interest;

[0085] In response to the image fusion command, the preset modal 3D image and 3D ultrasound image are fused to obtain the initial fused image;

[0086] In response to the user's image adjustment command for the initial blended image, the image display effect is adjusted to obtain and display the target blended image.

[0087] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the surgical field display method as provided in any embodiment of this invention.

[0088] Acquire a preset modal 3D image and 3D ultrasound image displaying preset tumor marker information within a preset region of interest;

[0089] In response to the image fusion command, the preset modal 3D image and 3D ultrasound image are fused to obtain the initial fused image;

[0090] In response to the user's image adjustment command for the initial blended image, the image display effect is adjusted to obtain and display the target blended image.

[0091] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0092] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0093] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0094] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or computer. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0095] Those skilled in the art will understand that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby allowing them to be stored in a storage device for execution by a computing device, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0096] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A surgical field display device, characterized in that, include: The image data acquisition module is used to acquire a preset modal three-dimensional image and a three-dimensional ultrasound image displaying preset tumor marker information in a preset region of interest, wherein the preset modal three-dimensional image is a magnetic resonance imaging image; An image fusion module is used to respond to an image fusion command by inputting the image data of the preset modal 3D image and the image data of the 3D ultrasound image into a preset image fusion algorithm for image fusion to obtain an initial fusion effect image. The preset image fusion algorithm automatically fuses the images based on the similarity calculation of pixels in the magnetic resonance imaging image and the 3D ultrasound image. The image adjustment and display module is used to adjust the image display effect in response to the user's image adjustment command on the initial fusion effect image, and to obtain and display the target fusion effect image; The image adjustment and display module is specifically used for: The preset modal 3D image information in the initial fusion effect image is hidden, and the preset tumor marker information is displayed in pseudo-color.

2. The apparatus according to claim 1, characterized in that, The image adjustment and display module is also used for: Adjust the window width and / or window level for displaying the preset tumor marker information.

3. The apparatus according to any one of claims 1-2, characterized in that, The preset modal 3D image includes: Positron emission tomography (PET) scans of 3D images and positron emission tomography (PET) scans of 3D images with magnetic resonance imaging (MRI).

4. The apparatus according to claim 3, characterized in that, The image adjustment and display module is also used for: The image information in the positron emission tomography scan of the preset modality 3D image that does not contain the preset tumor marker information is hidden.

5. The apparatus according to claim 1, characterized in that, The image fusion module is specifically used for: According to the image fusion instruction, the image data of the preset modal 3D image and the image data of the 3D ultrasound image are input into the preset image fusion algorithm for image fusion.

6. The apparatus according to claim 1, characterized in that, The preset region of interest is the prostate region to be surgically operated on.

Images