Image registration method and device

Abstract

An image registration method and device are provided. The image registration method includes: obtaining a first medical image and a second medical image of a target object to be registered (201); outputting a first target observation image to a display device based on the first medical image and the second medical image, so that the first medical image and the second medical image are alternately displayed on the display device (202); and performing image registration on the target object based on the first target observation image (203). Since an operator can manually adjust the image position synchronously during the alternating display of the first medical image and the second medical image, time for image adjustment is saved. In addition, the alternating display of the first medical image and the second medical image makes it easy for the operator to observe whether the first medical image and the second medical image are aligned, without the need to repeatedly adjust the transparency, thus saving time for image registration and improving the efficiency of image registration.

Description

Technical Field

[0001] The present application relates to the field of medical technology, and in particular to an image registration method and device. Background Art

[0002] Image registration is the process of spatially matching two images. To register image A to image B, image B is used as the reference image and image A as the floating image, resulting in the deformation field that aligns image A to image B. Medical image registration technology is fundamental to medical image processing and plays a crucial role in image information fusion, auxiliary diagnosis, surgical planning, and basic medical research.

[0003] There are multiple ways to manually register two images, allowing the operator to choose a preferred method. In one image display method, the two images are displayed as a superimposed image, and a slider is used to adjust the image transparency to enhance the display of one image. For example, when registering a computed tomography (CT) image with a cone-beam computed tomography (CBCT) image, when the slider is moved to the far left, the CT image is displayed (with the CBCT image being completely transparent), and when the slider is moved to the far right, the CBCT image is displayed (with the CT image being completely transparent).

[0004] When configuring images in this display mode, the operator needs to continuously drag the slider (adjust the transparency from 0% to 100% or from 100% to 0%) to observe whether the two images are aligned. If not, manually adjust the images and then repeat the above process until the two images are completely aligned.

[0005] As can be seen from the above, in the image registration under the image display mode in the related art, the operator needs to adjust the transparency and the image position separately, which takes a long time and has low image registration efficiency. Summary of the Invention

[0006] The present application provides an image registration method and device, which saves time and improves the efficiency of image registration.

[0007] In one aspect, the present application provides an image registration method, comprising:

[0008] Acquire a first medical image and a second medical image of a target object to be registered;

[0009] outputting a first target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;

[0010] Perform image registration on the target object according to the first target observation image.

[0011] In some embodiments of the present application, outputting a first target observation image to a display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes:

[0012] Get the preset image output time interval;

[0013] According to the image output time interval, the first medical image and the second medical image are sequentially output to the display device as first target observation images, so that the first medical image and the second medical image are alternately displayed on the display device.

[0014] In some embodiments of the present application, the first target observation image is a dynamic image, and outputting the first target observation image to a display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes:

[0015] Obtaining a preset number of image frames of the first target observation image;

[0016] determining, based on the number of image frames, a first number of first medical images and a second number of second medical images required to generate the first target observation image;

[0017] synthesizing the first target observation image according to the first number of first medical images and the second number of second medical images;

[0018] The first target observation image is output to a display device, so that the first medical image and the second medical image are alternately displayed on the display device.

[0019] In some embodiments of the present application, synthesizing the first target observation image according to the first number of first medical images and the second number of second medical images includes:

[0020] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image according to a preset quantity interval strategy.

[0021] In some embodiments of the present application, the first number and the second number are the same, and synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity interval strategy includes:

[0022] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image at equal intervals.

[0023] In some embodiments of the present application, the second number is greater than the first number, and synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity interval strategy includes:

[0024] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image in an increasing spacing manner.

[0025] In some embodiments of the present application, synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner includes:

[0026] Based on a preset first initial spacing and a preset spacing common ratio, determining a plurality of second medical images corresponding to the number of each first medical image in a manner of geometrically increasing spacing;

[0027] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0028] In some embodiments of the present application, synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner includes:

[0029] Based on a preset second initial spacing and a preset spacing tolerance, determining a plurality of second medical images corresponding to the number of each first medical image in an arithmetic increasing manner of spacing;

[0030] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0031] In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and performing image registration on the target object according to the first target observation image includes:

[0032] Obtaining a frame rate adjustment instruction from the user to adjust the frame rate of the target observation image;

[0033] According to the frame rate adjustment instruction, the frame rate of the target observation image is adjusted to a second frame rate, and the first target observation image after the frame rate adjustment is output;

[0034] Image registration is performed on the target object based on the first target observation image after the frame rate adjustment.

[0035] In some embodiments of the present application, after performing image registration on the target object based on the first target observation image, the method further includes:

[0036] obtaining a position adjustment instruction for the first medical image and / or the second medical image;

[0037] outputting the first target observation image after position adjustment according to the position adjustment instruction;

[0038] Image registration is performed on the target object based on the first target observation image after the position adjustment.

[0039] In some embodiments of the present application, the method further comprises:

[0040] After each acquisition of a position adjustment instruction for the first medical image or the second medical image, time information of the current position adjustment instruction is collected; and the target observation image corresponding to the time information is saved to form a set of target observation images at different times.

[0041] In some embodiments of the present application, the method further comprises:

[0042] Acquire a registration history backtracking instruction for the target object, wherein the registration history backtracking instruction includes backtracking time information;

[0043] Obtaining a retrospective target observation image corresponding to the retrospective time information in the target observation image set;

[0044] The retrospective target observation image is output to the display device for display.

[0045] In some embodiments of the present application, outputting a first target observation image to a display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes:

[0046] A first target observation image is output to a first display window of a display device according to the first medical image and the second medical image, so that the first medical image and the second medical image are alternately displayed in the first display window.

[0047] In some embodiments of the present application, the method further comprises:

[0048] Acquire a third medical image of the target object to be registered, where the third medical image is a medical image of a different type from the first medical image or a medical image of the same type captured at a different time;

[0049] outputting a second target observation image to a second display window of a display device according to the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in the second display window;

[0050] performing image registration on the target object according to the first target observation image and the second target observation image;

[0051] The first display window and the second display window are two different display windows of the same display interface of the display device.

[0052] In some embodiments of the present application, the method further comprises:

[0053] Acquiring a fourth medical image and a fifth medical image of the target object to be registered, where the fourth medical image is a medical image of a different type than the fifth medical image or is a medical image of the same type captured at different times, and the fourth medical image, the fifth medical image, the first medical image, and the second medical image are all different;

[0054] outputting a third target observation image to a third display window of a display device according to the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in the third display window;

[0055] performing image registration on the target object according to the first target observation image and the third target observation image;

[0056] The first display window and the third display window are two different display windows of the same display interface of the display device.

[0057] In some embodiments of the present application, the method further comprises:

[0058] obtaining a replacement instruction for the first medical image;

[0059] acquiring, based on the replacement instruction, a sixth medical image of the target object, the sixth medical image being of the same type as the first medical image;

[0060] outputting a fourth target observation image to a display device according to the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device;

[0061] Based on the fourth target observation image, image registration is performed on the target object.

[0062] On the other hand, the present application also provides an image registration method, the image registration method comprising:

[0063] Display the image registration interface for target object registration;

[0064] The first medical image and the second medical image of the target object to be registered are alternately displayed on the image registration interface.

[0065] In some embodiments of the present application, the alternately displaying the first medical image and the second medical image of the target object to be registered on the image registration interface includes:

[0066] The first medical image and the second medical image of the target object to be registered are alternately displayed on the image registration interface at a preset image output time interval.

[0067] In some embodiments of the present application, the image registration interface includes a first display window and a second display window, and alternatingly displaying the first medical image and the second medical image of the target object to be registered on the image registration interface includes:

[0068] The first display window alternately displays the first medical image and the second medical image of the target object to be registered.

[0069] A third medical image and the first medical image are alternately displayed in the second display window, where the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time.

[0070] On the other hand, the present application further provides an image registration device, comprising:

[0071] An acquisition module, configured to acquire a first medical image and a second medical image of a target object to be registered;

[0072] an output module, configured to output a first target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;

[0073] A registration module is used to perform image registration on the target object according to the first target observation image.

[0074] In some embodiments of the present application, the output module is specifically used to:

[0075] Get the preset image output time interval;

[0076] According to the image output time interval, the first medical image and the second medical image are sequentially output to the display device as first target observation images, so that the first medical image and the second medical image are alternately displayed on the display device.

[0077] In some embodiments of the present application, the first target observation image is a dynamic image, and the output module is specifically configured to:

[0078] Obtaining a preset number of image frames of the first target observation image;

[0079] determining, based on the number of image frames, a first number of first medical images and a second number of second medical images required to generate the first target observation image;

[0080] synthesizing the first target observation image according to the first number of first medical images and the second number of second medical images;

[0081] The first target observation image is output to a display device, so that the first medical image and the second medical image are alternately displayed on the display device.

[0082] In some embodiments of the present application, the output module is specifically used to:

[0083] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image according to a preset quantity interval strategy.

[0084] In some embodiments of the present application, the first number and the second number are the same, and the output module is specifically used to: synthesize the first number of first medical images and the second number of second medical images into the first target observation image at equal intervals.

[0085] In some embodiments of the present application, the second number is greater than the first number, and the output module is specifically configured to:

[0086] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image in an increasing spacing manner.

[0087] In some embodiments of the present application, the output module is specifically used to:

[0088] Based on a preset first initial spacing and a preset spacing common ratio, determining a plurality of second medical images corresponding to the number of each first medical image in a manner of geometrically increasing spacing;

[0089] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0090] In some embodiments of the present application, the output module is specifically used to:

[0091] Based on a preset second initial spacing and a preset spacing tolerance, determining a plurality of second medical images corresponding to the number of each first medical image in an arithmetic increasing manner of spacing;

[0092] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0093] In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and the registration module is specifically configured to:

[0094] Obtaining a frame rate adjustment instruction from the user to adjust the frame rate of the target observation image;

[0095] According to the frame rate adjustment instruction, the frame rate of the target observation image is adjusted to a second frame rate, and the first target observation image after the frame rate adjustment is output;

[0096] Image registration is performed on the target object based on the first target observation image after the frame rate adjustment.

[0097] In some embodiments of the present application, the registration module is further configured to:

[0098] After performing image registration on the target object according to the first target observation image, obtaining a position adjustment instruction for the first medical image and / or the second medical image;

[0099] outputting the first target observation image after position adjustment according to the position adjustment instruction;

[0100] Image registration is performed on the target object based on the first target observation image after the position adjustment.

[0101] In some embodiments of the present application, the apparatus further includes a backtracking module, which is configured to:

[0102] After each acquisition of a position adjustment instruction for the first medical image or the second medical image, time information of the current position adjustment instruction is collected; and the target observation image corresponding to the time information is saved to form a set of target observation images at different times.

[0103] In some embodiments of the present application, the backtracking module is further configured to:

[0104] Acquire a registration history backtracking instruction for the target object, wherein the registration history backtracking instruction includes backtracking time information;

[0105] Obtaining a retrospective target observation image corresponding to the retrospective time information in the target observation image set;

[0106] The retrospective target observation image is output to the display device for display.

[0107] In some embodiments of the present application, the output module is specifically used to:

[0108] A second target observation image is output to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image in a first display window of the display device.

[0109] In some embodiments of the present application,

[0110] The acquisition module is further configured to acquire a third medical image of the target object to be registered, wherein the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time;

[0111] The output module is further configured to output a second target observation image to a display device based on the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in a second display window of the display device;

[0112] The registration module is further configured to perform image registration on the target object based on the first target observation image and the second target observation image;

[0113] The first display window and the second display window are two different display windows of the same display interface of the display device.

[0114] In some embodiments of the present application,

[0115] The acquisition module is further configured to acquire a fourth medical image and a fifth medical image of the target object to be registered, wherein the fourth medical image is a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time;

[0116] The output module is further configured to output a third target observation image to a display device based on the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in a third display window of the display device;

[0117] The registration module is further configured to perform image registration on the target object based on the first target observation image and the third target observation image;

[0118] The first display window and the third display window are two different display windows of the same display interface of the display device.

[0119] In some embodiments of the present application,

[0120] The acquisition module is further configured to acquire a sixth medical image of the target object, where the sixth medical image and the first medical image are of the same type;

[0121] The output module is further configured to output a fourth target observation image to a display device based on the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device;

[0122] The registration module is further configured to perform image registration on the target object based on the fourth target observation image.

[0123] On the other hand, the present application also provides an image display device, comprising:

[0124] A display module is used to display an image registration interface for target object registration; after receiving a target observation image input by an electronic device, a first medical image and a second medical image of the target object to be registered are alternately displayed on the image registration interface at a preset time interval, where the target observation image is an image output by the electronic device based on the first medical image and the second medical image.

[0125] On the other hand, the present application further provides an electronic device, comprising:

[0126] one or more processors;

[0127] Memory; and

[0128] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps in the above-mentioned image registration method.

[0129] On the other hand, the present application also provides a computer-readable storage medium having a computer program stored thereon, and the computer program is loaded by a processor to execute the steps in the image registration method.

[0130] In the present application, a first target observation image that alternately displays a first medical image and a second medical image is output to a display device. Since the operator can manually adjust the image position synchronously during the alternating display of the first medical image and the second medical image, the time for image adjustment is saved. In addition, the alternating display of the first medical image and the second medical image makes it easy for the operator to observe whether the first medical image and the second medical image are aligned without repeatedly adjusting the transparency, which saves the time for image registration and improves the efficiency of image registration. BRIEF DESCRIPTION OF THE DRAWINGS

[0131] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0132] Figure 1 is a scene diagram of the image registration system provided in an embodiment of the present application;

[0133] Figure 2 This is a flow chart of an embodiment of the image registration method provided in the embodiment of the present application;

[0134] Figure 3 This is a flow chart of an embodiment of step 202 in the embodiment of the present application;

[0135] Figure 4 This is a flow chart of an embodiment of step 203 in the embodiment of the present application;

[0136] Figure 5 1 is a schematic structural diagram of an embodiment of an image registration device in an embodiment of the present application;

[0137] Figure 6 It is a schematic diagram of the structure of an embodiment of an electronic device in the embodiment of the present application. DETAILED DESCRIPTION

[0138] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0139] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present application, "multiple" means two or more, unless otherwise clearly and specifically defined.

[0140] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0141] The embodiments of the present application provide an image registration method and device, which are described in detail below.

[0142] See also Figure 1 , Figure 1 This is a scene diagram of the image registration system provided in an embodiment of the present application. The image registration system may include an image acquisition device 100 and an electronic device 200. The image acquisition device 100 and the electronic device 200 are connected to a network. The electronic device 200 is integrated with an image registration device, such as Figure 1 In the electronic device, the image acquisition device 100 can acquire medical images of the human body and output them to the access electronic device 200.

[0143] In the embodiment of the present application, the electronic device 200 is mainly used to obtain a first medical image and a second medical image of a target object to be registered; output a target observation image to a display device based on the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device; and perform image registration on the target object based on the first target observation image.

[0144] In the embodiment of the present application, the image acquisition device 100 may be a CT device, a CBCT device, or other medical imaging device, such as an ultrasound device (e.g., a B-ultrasound device or a color ultrasound device), a magnetic resonance imaging (MRI) device, etc., and the specific details are not limited here. In a specific application scenario, the first medical image is an image generated by a CBCT device in a radiotherapy device, and the second medical image may be an image generated by a CT device, a CBCT device, or other medical imaging device (e.g., an ultrasound device or an MRI device).

[0145] In the embodiments of the present application, the electronic device 200 may be a device including receiving and transmitting hardware, i.e., a device having receiving and transmitting hardware capable of performing bidirectional communication over a bidirectional communication link. Such a device may include a cellular or other communication device having a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. The specific electronic device 200 may be a desktop terminal or a mobile terminal. The electronic device 200 may also be a mobile phone, a tablet computer, a laptop computer, etc.

[0146] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer electronic devices shown in, or electronic device network connection relationships, such as Figure 1 Only one electronic device and one image acquisition device are shown. It can be understood that the image registration system can also include one or more other electronic devices, or / and one or more other image acquisition devices connected to the electronic device network. Specifically, for example, one electronic device 200 is connected to multiple image acquisition devices 100, that is, one electronic device 200 displays medical images acquired by multiple image acquisition devices 100, or one image acquisition device 100 is connected to multiple electronic devices 200, that is, the image acquired by one image acquisition device 100 is output to multiple electronic devices 200 for display. The specific details are not limited here.

[0147] In addition, if Figure 1As shown, the image registration system may further include a memory 300 for storing data, such as medical image data, for example, medical image data acquired by the image acquisition device 100 .

[0148] It should be noted that Figure 1 The scene diagram of the image registration system shown is only an example. The image registration system and scene described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the image registration system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0149] First, an embodiment of the present application provides an image registration method, including: acquiring a first medical image and a second medical image of a target object to be registered; outputting a first target observation image to a display device based on the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device; and performing image registration on the target object based on the first target observation image.

[0150] like Figure 2 FIG. 1 is a flow chart of an embodiment of an image registration method according to an embodiment of the present application, wherein the image registration method includes:

[0151] 201. Acquire a first medical image and a second medical image of a target object to be registered.

[0152] 202. Output a first target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device.

[0153] 203. Perform image registration on the target object according to the first target observation image.

[0154] In this embodiment, a first medical image and a second medical image of a target object to be registered are obtained; a first target observation image is output to a display device based on the first medical image and the second medical image, so that the first medical image and the second medical image are alternately displayed on the display device; and image registration of the target object is performed based on the first target observation image. In this application, the first target observation image that alternately displays the first medical image and the second medical image is output to a display device. Since the operator can manually adjust the image position synchronously during the alternating display of the first medical image and the second medical image, the time for image adjustment is saved. In addition, the alternating display of the first medical image and the second medical image makes it easy for the operator to observe whether the first medical image and the second medical image are aligned, without the need to repeatedly adjust the transparency, which saves the time for image registration and improves the efficiency of image registration.

[0155] In step 201, the target object can be a tissue or organ of the human body, such as the head, or organs such as the lungs and liver. The first medical image and the second medical image are both medical images of the target object, that is, medical images of the same tissue or organ, for example, both are medical images of the user's brain.

[0156] Specifically, the first medical image and the second medical image can both be two-dimensional or three-dimensional images, and can both be CBCT images, CT images, ultrasound images (B-ultrasound images or color ultrasound images), magnetic resonance imaging images, etc., without limitation herein. Furthermore, the first medical image and the second medical image can be medical images of the same type, for example, both the first medical image and the second medical image are CBCT images, or they can be different types, for example, the first medical image is a CBCT image and the second medical image is a CT image, etc., without limitation herein.

[0157] Both the first medical image and the second medical image can be acquired in real time by an image acquisition device, or one of the first medical image and the second medical image can be acquired by an image acquisition device, and the other can be a historical medical image of the target object. Of course, both can be historical medical images. The specific use can be based on the actual scenario and is not limited here.

[0158] In addition, in image registration, one image is generally used as a reference image and the other as a floating image, also known as a primary image and a secondary image. In the embodiment of the present application, the first medical image can be a primary image or a secondary image, and correspondingly, the second medical image can also be a primary image or a secondary image, which is not limited here.

[0159] In step 202, the first target observation image can be an image output alternately by the first medical image and the second medical image, or it can be a dynamic image synthesized by the first medical image and the second medical image. At this time, there are also multiple ways to output the first target observation image to the display device based on the first medical image and the second medical image in step 202, which are explained below with examples.

[0160] (1) The first target observation image may be an image output alternately of the first medical image and the second medical image.

[0161] At this time, outputting the first target observation image to the display device based on the first medical image and the second medical image includes: obtaining a preset image output time interval; and outputting the first medical image and the second medical image as the first target observation image to the display device in sequence according to the image output time interval.

[0162] The first target observation image of the alternating output of the first medical image and the second medical image is output to the corresponding interface of the display device for display. The first medical image and the second medical image are interactively displayed according to the image output time interval. The operator can adjust the position of the first medical image and / or the second medical image while observing the displayed alternating images (adjustment and display are almost real-time) until the first medical image and the second medical image are completely aligned. Compared with the existing image registration method, the embodiment of the present application allows the operator to manually adjust the image position synchronously during the switching of the alternating images, saving time for image adjustment. In addition, the operator can easily observe whether the first medical image and the second medical image are aligned without repeatedly adjusting the transparency, saving time for image registration and improving the efficiency of image registration.

[0163] Among them, the image output time interval is the time interval for switching output between the first medical image and the second medical image. The image output time interval can be pre-set as needed. The interval time can be 0.25 seconds, 0.5 seconds or 1 second, etc., and it can be unset or the default value, for example, the default value is 0.25 seconds, etc.

[0164] In one embodiment of setting the image output time interval in the present application, an "auto switch" button can be set on the image registration interface of the display device. For example, it can be set after adjusting the slider bar for the transparency of the medical image. When the "auto switch" button is triggered, a drop-down list is displayed. The drop-down list displays multiple options for the image output interval time to be selected, such as 0.25 seconds, 0.5 seconds or 1 second. For example, after the operator selects the interval time, the first target observation image under the image output interval will begin to be displayed in the image registration interface.

[0165] Alternatively, an "Auto Switch" checkbox can be set on the image registration interface of the display device. Once checked, the first target observation image will begin to be displayed within the image registration interface. The image output time interval can be a default value or can be set using a "Switch Time" adjustment bar, a "Switch Time Setting" button, or other methods. It should be noted that in the embodiments of the present application, the interface display method for setting the image output time interval can be varied and is not limited thereto.

[0166] (2) The first target observation image is a dynamic image

[0167] The first target observation image can be an existing dynamic image format, such as a GIF image, or a new dynamic image format that will appear in the future. Here, it only needs to be a dynamic image and there is no specific limitation.

[0168] At this time, if Figure 3 As shown, the step 202 of outputting the first target observation image to the display device according to the first medical image and the second medical image may further include:

[0169] 301. Obtain a preset number of image frames of a first target observation image.

[0170] 302. Determine, based on the number of image frames, a first number of first medical images and a second number of second medical images required to generate the first target observation image.

[0171] 303. Synthesize the first target observation image according to the first number of first medical images and the second number of second medical images.

[0172] The generated dynamic image (first target observation image) is output to the corresponding interface of the display device for display. The first medical image and the second medical image are interactively displayed at a preset time interval. The operator can adjust the position of the first medical image and / or the second medical image while observing the displayed dynamic image (adjustment and display are almost real-time) until the first medical image and the second medical image are completely aligned. Compared with the existing method, the technical solution of the present application allows the operator to manually adjust the image position synchronously during the dynamic image display process, saving time for image adjustment. In addition, through this solution, the operator can easily observe whether the main image and the secondary image are aligned without repeatedly adjusting the transparency, saving time for image registration and improving the efficiency of image registration.

[0173] Similarly, in one embodiment, an "auto switch" button can be set on the image registration interface of the display device. For example, it can be set after adjusting the slider bar for the transparency of the medical image. When the "auto switch" button is triggered, a drop-down list is displayed. The drop-down list displays multiple options for the image output interval time to be selected, such as 0.25 seconds, 0.5 seconds or 1 second. For example, after the operator selects the interval time, the dynamic image under the image output interval will begin to be displayed in the image registration interface.

[0174] In another embodiment, an "auto switch" checkbox can be set in the image registration interface of the display device. Once checked, the dynamic image can be displayed in the image registration interface. The image output time interval can be a default value or can be set using the "switch time" adjustment bar, the "switch time setting" button, etc. It should be noted that in the embodiments of the present application, the interface display method for setting the image output time interval can be varied and is not limited.

[0175] In some embodiments of the present application, synthesizing the first target observation image based on the first number of first medical images and the second number of second medical images includes: synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity interval strategy.

[0176] Among them, the first number and the second number may be the same or different. When the first number and the second number are the same, synthesizing the first target observation image based on the first number of first medical images and the second number of second medical images may include: synthesizing the first number of first medical images and the second number of second medical images into the first target observation image at equal intervals.

[0177] Among them, the spacing described in the embodiment of the present application can be the spacing between two first medical images, or the spacing between two second medical images. It can be set according to the actual usage scenario and is not limited.

[0178] Specifically, for example, in the first target observation image 121212, 1 represents the first medical image, 2 represents the second medical image, and the first medical image and the second medical image are spaced at an equal interval of 1 to form the first target observation image. The first target observation image is a dynamic image composed of three first medical images and three second medical images. Another example is the first target observation image 11221122, which indicates that the first medical image and the second medical image are spaced at an equal interval of 2 to form the first target observation image.

[0179] Since the first medical image has one main image and one secondary image, and the main image does not change as a reference image, the number of frames of the secondary image in the dynamic image can be more. Therefore, in other embodiments of the present application, when the first medical image is the main image, the second number is greater than the first number, and the secondary image can be effectively observed as a floating image.

[0180] In one embodiment, when the second number is greater than the first number, synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity spacing strategy may include: synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner.

[0181] Specifically, the first target observation image is synthesized by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner, including: based on a preset first initial spacing and a preset spacing common ratio, determining a plurality of second medical images corresponding to the number of each first medical image in an increasing spacing manner; and synthesizing the first target observation image in sequence by pairing each first medical image and its corresponding plurality of second medical images.

[0182] For example, the first target observation image is 12122122221, where the initial spacing between the two first medical images is 1, that is, one second medical image, and the spacing between the two first medical images is 1, 2, and 4, increasing in geometric proportion.

[0183] In another embodiment, synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner includes: determining, based on a preset second initial spacing and a preset spacing tolerance, a plurality of second medical images corresponding to the number of each first medical image in an arithmetic increasing spacing manner; and synthesizing the first target observation image in sequence by pairing each first medical image with its corresponding plurality of second medical images.

[0184] For example, the first target observation image is 1212212221, where the initial spacing between the two first medical images is 1, that is, one second medical image, and the spacing between the two first medical images is 1, 2, and 3, respectively, increasing in an arithmetical progression.

[0185] For dynamic images, there is also a frame rate, that is, the number of image frames displayed per second. For example, the target observation image is composed of 6 images (3 first medical images and 3 second medical images), and the frame rate is 2 frames / s, that is, the target observation image can be dynamically displayed for 3 seconds (subsequently displayed in a cycle), and one first medical image and one second medical image are displayed per second.

[0186] In an embodiment of the present application, the synthetic frame rate of the first target observation image can be a pre-set frame rate, for example, the frame rate of the first target observation image is a first frame rate, and the synthetic frame rate can be adjusted subsequently as needed. Specifically, performing image registration on the target object based on the first target observation image can include: obtaining a frame rate adjustment instruction from the user to adjust the frame rate of the first target observation image; adjusting the frame rate of the first target observation image to a second frame rate according to the frame rate adjustment instruction, and outputting the first target observation image after the frame rate adjustment; and performing image registration on the target object based on the first target observation image after the frame rate adjustment.

[0187] For example, the second frame rate is 3 frames / second, and the frame rate of the first target observation image is adjusted from the first frame rate to the second frame rate, that is, the number of image frames of the first target observation image is the same, but the frame rate can be adjusted from 2 frames / s to 3 frames / s.

[0188] In some embodiments of the present application, during the image registration process, the image can be position-adjusted and registered. Specifically, Figure 4 As shown, performing image registration on the target object according to the first target observation image may include:

[0189] 401. Obtain a position adjustment instruction for a first medical image and / or a second medical image.

[0190] The registration adjustment instruction may include position adjustment information for the first medical image, for example, adjusting the first distance to the left, such as 1 mm. The position adjustment instruction may be a position adjustment instruction for the first medical image or a position adjustment instruction for the second medical image. Alternatively, the position adjustment instruction may include two pieces of position adjustment information: one for the first medical image (used to adjust the position of the first medical image) and one for the second medical image. The specific details are not limited here.

[0191] 402. Output the first target observation image after position adjustment according to the position adjustment instruction.

[0192] 403. Perform image registration on the target object based on the position-adjusted first target observation image.

[0193] In this embodiment, the position of the medical image can be adjusted in real time to generate a first target observation image after the position is adjusted in real time, which is convenient for subsequent registration.

[0194] In some embodiments of the present application, during the image registration process, when a medical image does not meet the requirements, a new medical image may be acquired to replace the previous medical image for re-registration. For example, when the first medical image needs to be replaced, the image registration method further includes: obtaining a replacement instruction for the first medical image; based on the replacement instruction, obtaining a sixth medical image of the target object, wherein the sixth medical image is of the same type as the first medical image; outputting a fourth target observation image to a display device based on the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device; and performing image registration on the target object based on the fourth target observation image. The sixth medical image is the image that replaces the second medical image for image registration.

[0195] In some embodiments of the present application, the target observation images in each adjustment process of the image registration can also be saved for use in subsequent medical disputes or other scenarios requiring retrospective image registration.

[0196] Specifically, in some embodiments of the present application, the image registration method may further include: after each acquisition of a position adjustment instruction for the first or second medical image, collecting time information for the current position adjustment instruction; and saving the target observation image corresponding to the time information to form a set of target observation images at different times. That is, each time a registration adjustment is made, the target observation image at the current registration time is saved. Ultimately, after registration is completed, a set of target observation images at different times is formed, facilitating subsequent review of the registration record.

[0197] Furthermore, the image registration method may also include a backtracking step. Specifically, the image registration method may further include: obtaining a registration history backtracking instruction for the target object, the registration history backtracking instruction including backtracking time information; obtaining the backtracked target observation image corresponding to the backtracking time information in the target observation image set; and outputting the backtracked target observation image to the display device for display. Specifically, a backtracking control may be displayed on the image registration interface of the display device. After the user clicks the backtracking control, a backtracking time input box or selection box may be displayed to determine the backtracking time. After the user determines the backtracking time, a registration history backtracking instruction is generated. Based on the backtracking time information, the backtracked target observation image may be obtained from the target observation image set saved in the above embodiment.

[0198] In addition, in an embodiment of the present application, one or more sets of target observation images can be output to a display device, and one or more display windows can be set in the image registration interface of the display device to display these multiple sets of target observation images.

[0199] When the image registration interface of the display device includes a first display window, outputting the second target observation image to the display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes: outputting the second target observation image to the display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image in the first display window of the display device. That is, the first medical image and the second medical image are alternately displayed in the first display window of the display device.

[0200] The image registration interface of the display device may further include a second display window. The first display window and the second display window are different. The first display window and the second display window may be arranged side by side vertically or side by side left to right. The sizes of the first display window and the second display window may be the same or different, and may be specifically set according to the actual application scenario.

[0201] It should be noted that, in the embodiment of the present application, when the image registration interface of the display device includes multiple display windows, there are multiple ways to implement the images displayed in the multiple display windows, which are described below with examples:

[0202] 1. Two sets of target observation images displayed in multiple display windows have the same medical image

[0203] Specifically, based on the first medical image and the second medical image, the two target observation images output by the first medical image and the third medical image both use the first medical image as a reference benchmark.

[0204] At this time, in a specific embodiment, the image registration method further includes:

[0205] (1) Obtain a third medical image of the target object to be registered.

[0206] The third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time.

[0207] In this embodiment, the first medical image can be a reference medical image (or primary image), and the second and third medical images can be floating images (or secondary images). In this case, the two sets of target observation images use the same reference medical image to facilitate mutual verification.

[0208] (2) Outputting a second target observation image to a display device based on the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in a second display window of the display device.

[0209] The first display window and the second display window are two different display windows of the same display interface of the display device.

[0210] (3) Performing image registration on the target object based on the first target observation image and the second target observation image.

[0211] In this embodiment, the first medical image is combined with two different medical images: the second medical image and the third medical image to output the first target observation image and the second target observation image to two different display windows of the display device. The two display windows can form two dynamic registration screens for user reference.

[0212] 2. The two sets of target observation images displayed in multiple display windows do not have a common medical image display, which is a reference for two dimensions.

[0213] Specifically, two target observation images are output based on the first medical image and the second medical image, the fourth medical image and the fifth medical image, wherein the fourth medical image is a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are all different.

[0214] At this time, the image registration method further includes:

[0215] (1) Obtain a fourth medical image and a fifth medical image of the target object to be registered.

[0216] The fourth medical image is a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time.

[0217] (2) Outputting a third target observation image to a display device based on the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in a third display window of the display device.

[0218] The first display window and the third display window are two different display windows of the same display interface of the display device.

[0219] (3) Performing image registration on the target object based on the first target observation image and the third target observation image.

[0220] It should be noted that the above embodiment only describes the image registration interface of the display device as an example to display two display windows. It can be understood that in actual applications, multiple display windows can be displayed. For example, the first display window, the second display window and the third display window described in the above embodiment can be displayed at the same time. The specific details are not limited here.

[0221] In addition, the medical images described in the embodiments of the present application, such as the fourth medical image, the fifth medical image, and the sixth medical image, can all refer to the first medical image and the second medical image described in the aforementioned embodiments. In terms of dimension, they can all be two-dimensional images or three-dimensional images. In terms of image type, they can all be CBCT images, CT images, ultrasound images (B-ultrasound images or color ultrasound images), magnetic resonance imaging images, etc., which are not specifically limited here.

[0222] An embodiment of the present application also provides an image display method, which is applied to a display device. The method may include: displaying an image registration interface for target object registration; and alternately displaying a first medical image and a second medical image of the target object to be registered on the image registration interface.

[0223] In the embodiment of the present application, the first medical image and the second medical image are alternately displayed on a display device. Since the operator can manually adjust the image position synchronously during the alternating display of the medical images, the time for image adjustment is saved. In addition, the alternating display of the medical images makes it easy for the operator to observe whether the first medical image and the second medical image are aligned without the need to repeatedly adjust the transparency, which saves the time for image registration and improves the efficiency of image registration.

[0224] The alternately displaying the first medical image and the second medical image of the target object to be registered on the image registration interface includes: alternately displaying the first medical image and the second medical image of the target object to be registered on the image registration interface at a preset image output time interval.

[0225] An "auto switch" button can be set on the image registration interface of the display device. For example, it can be set after the slider bar for adjusting the transparency of the medical image. When the "auto switch" button is triggered, a drop-down list is displayed. The drop-down list displays multiple options for the image output interval time to be selected, such as 0.25 seconds, 0.5 seconds or 1 second. For example, after the operator selects the interval time, that is, determines the preset time interval, the first medical image and the second medical image of the target object to be registered will begin to be displayed alternately in the image registration interface.

[0226] Furthermore, the image registration interface includes a first display window and a second display window, and the alternating display of the first medical image and the second medical image of the target object to be registered in the image registration interface includes: alternatingly displaying the first medical image and the second medical image of the target object to be registered in the first display window; alternatingly displaying a third medical image and the first medical image in the second display window, wherein the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time.

[0227] Furthermore, the image registration interface includes a third display window, and the first medical image and the second medical image of the target object to be registered are alternately displayed in the image registration interface, including: alternatingly displaying a fourth medical image and a fifth medical image in the third display window, the fourth medical image being a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are all different.

[0228] Furthermore, the image registration interface of the display device may also include an image saving control for allowing the user to manually click to save the target observation image corresponding to the medical image currently displayed alternately. In addition, the image registration interface of the display device may also include a position adjustment control for adjusting the two medical images to be registered, such as the first medical image and the second medical image. The method further includes: when obtaining the time information of the user clicking the position adjustment control, collecting the time information of the click of the position adjustment control; saving the target observation image corresponding to the time information to form a set of target observation images at different times.

[0229] Furthermore, a backtracking control may be displayed on the image registration interface of the display device. After the user clicks the backtracking control, a backtracking time input box or selection box may be displayed to determine the backtracking time. After the user determines the backtracking time, a registration history backtracking instruction is generated. Based on the backtracking time information, the backtracked target observation image may be obtained from the target observation image set saved in the above embodiment.

[0230] Specifically, the image display method may further include a backtracking step. Specifically, the image registration method may further include: obtaining a registration history backtracking instruction generated by a user clicking the backtracking control, the registration history backtracking instruction including backtracking time information; obtaining a backtracked target observation image corresponding to the backtracking time information in the target observation image set; and displaying the backtracked target observation image on the image registration interface.

[0231] Furthermore, the image registration interface includes a first display window and a second display window, and the image display method may also include: when the first target observation image and the second target observation image are acquired, displaying the first target observation image in the first display window of the image registration interface to alternately display the first medical image and the second medical image, and displaying the second target observation image in the second display window of the image registration interface to alternately display the first medical image and the third medical image, wherein the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time.

[0232] Furthermore, the image display method may also include: when the first target observation image and the third target observation image are acquired, displaying the first target observation image in the first display window of the image registration interface to alternately display the first medical image and the second medical image, and displaying the third target observation image in the second display window of the image registration interface to alternately display the fourth medical image and the fifth medical image, wherein the fourth medical image is a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are all different.

[0233] In order to better implement the image registration method in the embodiment of the present application, based on the image registration method, the embodiment of the present application also provides an image registration device, such as Figure 5 As shown, the image registration device 500 includes:

[0234] An acquisition module 501 is configured to acquire a first medical image and a second medical image of a target object to be registered;

[0235] an output module 502 configured to output a first target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;

[0236] The registration module 503 is configured to perform image registration on the target object according to the first target observation image.

[0237] In the present application, the first medical image and the second medical image of the target object to be registered are acquired by the acquisition module 501; the output module 502 outputs the target observation image to the display device based on the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device; the registration module 503 performs image registration on the target object based on the first target observation image. In the present application, the target observation image that alternately displays the first medical image and the second medical image is output to the display device. Since the operator can manually adjust the image position synchronously during the alternating display of the images in the target observation image, the time for image adjustment is saved. In addition, the alternating display of the target observation image makes it easy for the operator to observe whether the first medical image and the second medical image are aligned, without the need to repeatedly adjust the transparency, which saves the time for image registration and improves the efficiency of image registration.

[0238] In some embodiments of the present application, the output module 502 is specifically configured to:

[0239] Get the preset image output time interval;

[0240] According to the image output time interval, the first medical image and the second medical image are sequentially output to the display device as first target observation images, so that the first medical image and the second medical image are alternately displayed on the display device.

[0241] In some embodiments of the present application, the first target observation image is a dynamic image, and the output module 502 is specifically configured to:

[0242] Obtaining a preset number of image frames of the first target observation image;

[0243] determining, based on the number of image frames, a first number of first medical images and a second number of second medical images required to generate the first target observation image;

[0244] synthesizing the first target observation image according to the first number of first medical images and the second number of second medical images;

[0245] The first target observation image is output to a display device, so that the first medical image and the second medical image are alternately displayed on the display device.

[0246] In some embodiments of the present application, the output module 502 is specifically configured to:

[0247] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image according to a preset quantity interval strategy.

[0248] In some embodiments of the present application, the first number and the second number are the same, and the output module is specifically used to: synthesize the first number of first medical images and the second number of second medical images into the first target observation image at equal intervals.

[0249] In some embodiments of the present application, the second number is greater than the first number, and the output module is specifically configured to:

[0250] The first number of first medical images and the second number of second medical images are synthesized into the first target observation image in an increasing spacing manner.

[0251] In some embodiments of the present application, the output module 502 is specifically configured to:

[0252] Based on a preset first initial spacing and a preset spacing common ratio, determining a plurality of second medical images corresponding to the number of each first medical image in a manner of geometrically increasing spacing;

[0253] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0254] In some embodiments of the present application, the output module 502 is specifically configured to:

[0255] Based on a preset second initial spacing and a preset spacing tolerance, determining a plurality of second medical images corresponding to the number of each first medical image in an arithmetic increasing manner of spacing;

[0256] The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

[0257] In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and the registration module 503 is specifically configured to:

[0258] Obtaining a frame rate adjustment instruction from the user to adjust the frame rate of the target observation image;

[0259] According to the frame rate adjustment instruction, the frame rate of the target observation image is adjusted to a second frame rate, and the first target observation image after the frame rate adjustment is output;

[0260] Image registration is performed on the target object based on the first target observation image after the frame rate adjustment.

[0261] In some embodiments of the present application, the registration module 503 is further configured to:

[0262] After performing image registration on the target object according to the first target observation image, obtaining a position adjustment instruction for the first medical image and / or the second medical image;

[0263] outputting the first target observation image after position adjustment according to the position adjustment instruction;

[0264] Image registration is performed on the target object based on the first target observation image after the position adjustment.

[0265] In some embodiments of the present application, the apparatus further includes a backtracking module, which is configured to:

[0266] After each acquisition of a position adjustment instruction for the first medical image or the second medical image, time information of the current position adjustment instruction is collected; and the target observation image corresponding to the time information is saved to form a set of target observation images at different times.

[0267] In some embodiments of the present application, the backtracking module is further configured to:

[0268] Acquire a registration history backtracking instruction for the target object, wherein the registration history backtracking instruction includes backtracking time information;

[0269] Obtaining a retrospective target observation image corresponding to the retrospective time information in the target observation image set;

[0270] The retrospective target observation image is output to the display device for display.

[0271] In some embodiments of the present application, the output module 502 is specifically configured to:

[0272] A second target observation image is output to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image in a first display window of the display device.

[0273] In some embodiments of the present application,

[0274] The acquisition module 501 is further configured to acquire a third medical image of the target object to be registered, wherein the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time;

[0275] The output module 502 is further configured to output a second target observation image to a display device based on the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in a second display window of the display device;

[0276] The registration module 503 is further configured to perform image registration on the target object according to the first target observation image and the second target observation image;

[0277] The first display window and the second display window are two different display windows of the same display interface of the display device.

[0278] In some embodiments of the present application,

[0279] The acquisition module 501 is further configured to acquire a fourth medical image and a fifth medical image of the target object to be registered, wherein the fourth medical image is a medical image of a different type from the fifth medical image or a medical image of the same type taken at a different time;

[0280] The output module 502 is further configured to output a third target observation image to a display device based on the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in a third display window of the display device;

[0281] The registration module 503 is further configured to perform image registration on the target object according to the first target observation image and the third target observation image;

[0282] The first display window and the third display window are two different display windows of the same display interface of the display device.

[0283] In some embodiments of the present application,

[0284] The acquisition module 501 is further configured to acquire a sixth medical image of the target object, where the sixth medical image and the first medical image are of the same type;

[0285] The output module 502 is further configured to output a fourth target observation image to a display device based on the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device;

[0286] The registration module 503 is further configured to perform image registration on the target object based on the fourth target observation image.

[0287] The present application also provides an image display device, comprising:

[0288] A display module is used to display an image registration interface for target object registration; after receiving a target observation image input by an electronic device, a first medical image and a second medical image of the target object to be registered are alternately displayed on the image registration interface at a preset time interval, where the target observation image is an image output by the electronic device based on the first medical image and the second medical image.

[0289] In the embodiment of the present application, the first medical image and the second medical image are alternately displayed on the display device. Since the operator can manually adjust the image position synchronously during the alternating display of the images in the target observation image, the time for image adjustment is saved. In addition, the alternating display of the target observation image makes it easy for the operator to observe whether the first medical image and the second medical image are aligned without the need to repeatedly adjust the transparency, which saves the time for image registration and improves the efficiency of image registration.

[0290] An embodiment of the present application further provides an electronic device, which integrates any one of the image registration devices provided in the embodiments of the present application, and the electronic device includes:

[0291] one or more processors;

[0292] Memory;

[0293] and one or more applications, wherein the one or more applications are stored in the memory and are configured to cause the processor to execute the steps of the image registration method described in any of the above-mentioned image registration method embodiments.

[0294] The present application also provides an electronic device that integrates any of the image registration methods provided in the present application. Figure 6 , which shows a schematic diagram of the structure of the electronic device involved in the embodiment of the present application, specifically:

[0295] The electronic device may include one or more processing core processors 601, one or more computer-readable storage media memories 602, a power supply 603, an input unit 604 and other components. Those skilled in the art will understand that Figure 6 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently.

[0296] Processor 601 is the control center of the electronic device, connecting the various parts of the entire electronic device using various interfaces and lines. By running or executing software programs and / or modules stored in memory 602 and accessing data stored in memory 602, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, processor 601 may include one or more processing cores; preferably, processor 601 may integrate an application processor and a modem processor, wherein the application processor primarily processes the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 601.

[0297] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0298] The electronic device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 603 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0299] The electronic device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0300] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602 to implement various functions as follows:

[0301] Acquire a first medical image and a second medical image of a target object to be registered;

[0302] outputting a target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;

[0303] Perform image registration on the target object according to the first target observation image.

[0304] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0305] To this end, an embodiment of the present application provides a computer-readable storage medium, which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of any of the image registration methods provided in the embodiments of the present application. For example, the computer program loaded by the processor may execute the following steps:

[0306] Acquire a first medical image and a second medical image of a target object to be registered;

[0307] outputting a target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;

[0308] Perform image registration on the target object according to the first target observation image.

[0309] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above and will not be repeated here.

[0310] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to implement as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments and will not be repeated here.

[0311] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0312] The above is a detailed introduction to an image registration method and device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, based on the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An image registration method, characterized in that: The image registration method comprises: Acquire a first medical image and a second medical image of a target object to be registered; Outputting a first target observation image to a display device based on the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device; wherein the first target observation image is an image alternately output from the first medical image and the second medical image, or a dynamic image synthesized from the first medical image and the second medical image; performing image registration on the target object according to the first target observation image; The performing image registration on the target object according to the first target observation image includes: Obtaining a position adjustment instruction for the first medical image and / or the second medical image; outputting the first target observation image after position adjustment according to the position adjustment instruction; Image registration is performed on the target object based on the first target observation image after the position adjustment.

2. The image registration method according to claim 1, wherein: Outputting a first target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes: Get the preset image output time interval; According to the image output time interval, the first medical image and the second medical image are sequentially output to the display device as first target observation images, so that the first medical image and the second medical image are alternately displayed on the display device.

3. The image registration method according to claim 1, wherein: The first target observation image is a dynamic image, and the step of outputting the first target observation image to a display device based on the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes: Obtaining a preset number of image frames of the first target observation image; determining, based on the number of image frames, a first number of first medical images and a second number of second medical images required to generate the first target observation image; synthesizing the first target observation image based on the first number of first medical images and the second number of second medical images; The first target observation image is output to a display device, so that the first medical image and the second medical image are alternately displayed on the display device.

4. The image registration method according to claim 3, wherein: The synthesizing the first target observation image according to the first number of first medical images and the second number of second medical images includes: The first number of first medical images and the second number of second medical images are synthesized into the first target observation image according to a preset quantity interval strategy.

5. The image registration method according to claim 4, characterized in that: The first number and the second number are the same, and synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity interval strategy includes: The first number of first medical images and the second number of second medical images are synthesized into the first target observation image at equal intervals.

6. The image registration method according to claim 4, characterized in that: The second number is greater than the first number, and synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images according to a preset quantity interval strategy includes: The first number of first medical images and the second number of second medical images are synthesized into the first target observation image in an increasing spacing manner.

7. The image registration method according to claim 6, characterized in that: The synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner includes: Based on a preset first initial spacing and a preset spacing common ratio, determining a plurality of second medical images corresponding to each first medical image in a manner of geometrically increasing spacing; The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

8. The image registration method according to claim 6, characterized in that: The synthesizing the first target observation image by combining the first number of first medical images and the second number of second medical images in an increasing spacing manner includes: Based on a preset second initial spacing and a preset spacing tolerance, determining a plurality of second medical images corresponding to each first medical image in an arithmetic increasing manner of spacing; The first target observation image is synthesized in sequence according to pairing each first medical image with its corresponding plurality of second medical images.

9. The image registration method according to claim 3, characterized in that: The frame rate of the first target observation image is a first frame rate, and performing image registration on the target object according to the first target observation image includes: Obtaining a frame rate adjustment instruction from the user to adjust the frame rate of the target observation image; According to the frame rate adjustment instruction, the frame rate of the target observation image is adjusted to a second frame rate, and the first target observation image after the frame rate adjustment is output; Image registration is performed on the target object based on the first target observation image after the frame rate adjustment.

10. The image registration method according to claim 1, wherein: The method further comprises: After each acquisition of the position adjustment instruction for the first medical image or the second medical image, collecting time information of the current position adjustment instruction; The target observation image corresponding to the time information is saved to form a set of target observation images at different times.

11. The image registration method according to claim 10, characterized in that: The method further comprises: Acquire a registration history backtracking instruction for the target object, wherein the registration history backtracking instruction includes backtracking time information; Obtaining a retrospective target observation image corresponding to the retrospective time information in the target observation image set; The retrospective target observation image is output to the display device for display.

12. The image registration method according to claim 1, wherein: Outputting a first target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device includes: A first target observation image is output to a first display window of a display device according to the first medical image and the second medical image, so that the first medical image and the second medical image are alternately displayed in the first display window.

13. The image registration method according to claim 12, wherein: The method further comprises: Acquire a third medical image of the target object to be registered, where the third medical image is a medical image of a different type from the first medical image or a medical image of the same type captured at a different time; outputting a second target observation image to a second display window of a display device according to the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in the second display window; performing image registration on the target object according to the first target observation image and the second target observation image; The first display window and the second display window are two different display windows of the same display interface of the display device.

14. The image registration method according to claim 12, wherein: The method further comprises: Acquiring a fourth medical image and a fifth medical image of the target object to be registered, where the fourth medical image is a medical image of a different type than the fifth medical image or is a medical image of the same type captured at different times, and the fourth medical image, the fifth medical image, the first medical image, and the second medical image are all different; outputting a third target observation image to a third display window of a display device according to the fourth medical image and the fifth medical image, so as to alternately display the fourth medical image and the fifth medical image in the third display window; performing image registration on the target object according to the first target observation image and the third target observation image; The first display window and the third display window are two different display windows of the same display interface of the display device.

15. The image registration method according to claim 1, wherein: The method further comprises: obtaining a replacement instruction for the first medical image; acquiring, based on the replacement instruction, a sixth medical image of the target object to be registered, the sixth medical image being of the same type as the first medical image; outputting a fourth target observation image to a display device according to the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device; Based on the fourth target observation image, image registration is performed on the target object.

16. An image display method, characterized in that: The method comprises: Acquire a first target observation image, where the first target observation image is an image alternately outputted from a first medical image and a second medical image of the target object to be calibrated, or a dynamic image synthesized from the first medical image and the second medical image; Display the image registration interface for target object registration; Based on the first target observation image, alternately displaying the first medical image and the second medical image on the image registration interface; Acquire a first target observation image after position adjustment, where the first target observation image after position adjustment is an observation image regenerated according to the position adjustment instruction for the first medical image and / or the second medical image; Image registration is performed on the target object based on the first target observation image after the position adjustment.

17. The image display method according to claim 16, wherein the alternately displaying the first medical image and the second medical image on the image registration interface comprises: The first medical image and the second medical image are alternately displayed on the image registration interface at a preset image output time interval.

18. The image display method according to claim 16, wherein the image registration interface comprises a first display window and a second display window, and the alternately displaying the first medical image and the second medical image on the image registration interface comprises: alternately displaying the first medical image and the second medical image in the first display window; A third medical image and the first medical image are alternately displayed in the second display window, where the third medical image is a medical image of a different type from the first medical image or a medical image of the same type taken at a different time.

19. An electronic device, characterized in that: The electronic device comprises: one or more processors; Memory; and One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the image registration method according to any one of claims 1 to 18.

Images