Method and system for projecting incision markings onto a patient
By using a movable gantry and an adjustable laser to project virtual markers in fluoroscopic images in medical imaging systems, the problem of difficulty in marking the incision position on the patient's body surface in the prior art is solved, and the position of the spine vertebrae of obese patients is achieved Visualization of accurate labeling and surgical preparation.
Patent Information
- Application Number
- CN202080006509.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-24
- Filing Date
- 2020-09-22
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-09-22
AI Technical Summary
Existing medical imaging systems are difficult to mark the incision position directly on the patient's body surface before surgery, especially in areas that cannot be directly perceived, such as the spinal vertebrae position of obese patients, resulting in difficulty in positioning.
Using a movable gantry and a laser adjustable relative to the gantry, virtual marks set in the fluoroscopic image are projected onto the patient's surface, indicating the incision position through the laser beam, and external visualization is achieved.
No additional tools are required, and the area of interest can be accurately marked, simplified patient positioning, and improved the visualization of surgical preparation, avoiding direct perception of the spinal vertebrae position of obese patients.
Smart Images

Figure CN113164066B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method for projecting an incision marking onto a patient, a corresponding computer program, a program storage medium storing such a program, a computer executing such a program and a medical system comprising the aforementioned computer. Background Art
[0002] Medical imaging systems for obtaining fluoroscopic or X-ray images are often used to plan surgery or to verify information immediately prior to surgery. In the present document, the functionality of such medical imaging systems is extended by adding the ability to project incision markers onto a patient.
[0003] A medical imaging system typically includes an X-ray source that emits a conical X-ray beam, which can be selectively shaped using a collimator. The medical imaging system typically further includes a two-dimensional X-ray detector for detecting the X-ray beam after it passes through the patient. With such a medical imaging system, a two-dimensional fluoroscopic image can be captured. However, a medical imaging system may also include an X-ray source that emits a fan-shaped X-ray beam, and a linear X-ray detector corresponding to the fan-shaped X-ray beam. Such an imaging system captures a one-dimensional X-ray image, but a two-dimensional fluoroscopic image can be obtained by moving the medical imaging system relative to the patient and combining multiple one-dimensional X-ray images. The center of the X-ray beam is also referred to as the center beam of the medical imaging system. Summary of the invention
[0004] The invention can be used in the production process, for example, with a medical imaging system such as the Brainlab AG product Loop-X TM ) or any other suitable imaging system.
[0005] The following discloses various aspects, examples and exemplary steps of the invention and its embodiments.Different exemplary features of the invention can be combined according to the invention whenever technically suitable and feasible.
[0006] Brief description of the invention
[0007]
[0013] A brief description of specific features of the present invention is given below, which should not be construed as limiting the present invention to the features or combinations of features described in this section.
[0008] This document relates to a technique for projecting an incision mark onto a patient using a movable gantry carrying a medical imaging system and at least one laser adjustable relative to the gantry. The medical imaging system is used to capture a fluoroscopic image or an X-ray image of at least a portion of the patient. A virtual marker is then set in the captured image to indicate a point or area of interest, such as a point or at least one line indicating an incision. The point or area of interest is then indicated onto the patient surface using a laser so that the point or area of interest is visible from the outside. SUMMARY OF THE INVENTION
[0010] In this section, a description of general features of the present invention is given, for example, by reference to possible embodiments of the invention.
[0011] In general, the present invention achieves the above-mentioned objectives by, in a first aspect, providing a method for projecting an incision mark onto a patient using a medical imaging system, wherein the medical imaging system comprises a gantry and at least one laser adjustable relative to the gantry.
[0012] The method comprises the following steps: capturing a fluoroscopic image of at least a portion of a patient, in particular at least a portion of a bone structure of the patient, such as a spine of the patient. The medical imaging system is capable of capturing fluoroscopic images and thus comprises, for example, an X-ray source and an X-ray detector. In one embodiment, only a single fluoroscopic image is captured. The fluoroscopic image is then displayed on a display device.
[0013] Fluoroscopic images are taken from a viewing direction on the patient that represents the position of the medical imaging system relative to the patient. The viewing direction represents, for example, the direction of a line defined relative to the medical imaging system, such as a line coinciding with the center of an X-ray beam emitted by an X-ray source.
[0014] The method further comprises the step of setting a virtual marker in the fluoroscopic image, the virtual marker for example indicating a point or region of interest, such as a point or region to be treated by surgery or a point or region indicating an incision location.
[0015] The method further comprises the step of controlling at least one laser to project an incision mark onto the patient from a projection direction different from the viewing direction according to the virtual mark. In other words, the incision mark projected onto the patient indicates a position on the patient surface that corresponds to the position of the virtual mark in the fluoroscopic image.
[0016] In this document, the word "laser" refers to a device that generates a laser beam. This beam can have different shapes, such as a point (so that the laser beam is a straight line) or a fan (so that the laser beam covers a portion of a plane with a certain opening angle). This opening angle defines the angle between the two boundary lines of the laser beam.
[0017] The projection direction is the direction in which the incision mark is projected onto the patient. If the incision mark is a single light spot, the projection direction is usually equal to the direction of the laser beam. If the laser is fanned out to project a line onto the patient, the projection direction is, for example, the central axis of the fan. If the incision mark comprises two intersecting lines, such as a crosshair, the projection direction is, for example, the line connecting the intersection point and the origin of the laser beam (e.g., the laser source or the deflection mirror).
[0018] In one embodiment, the angle between the viewing direction and the projection direction is 90°, between 85° and 95°, between 80° and 100°, or between 70° and 110°.
[0019] If, for example, the viewing direction is transverse to the patient, so that the fluoroscopic image is acquired from the side of the patient, the incision marking is projected, for example, onto the back or front of the patient.
[0020] The laser is calibrated, for example, with a medical imaging system. This means that the position of the laser relative to the medical imaging system is known, which means that the position of the laser beam can be adjusted relative to the medical imaging system. This calibration can be obtained, for example, using phantoms or back-projections. If the direction of the laser relative to the imaging system is known, the direction of the laser relative to the imaging plane is also known.
[0021] The advantage of the method is that a point or region of interest can be marked in the patient image, which allows observation of the patient, and then the position corresponding to the point or region of interest can be indicated on the surface of the patient from different directions. The advantage is that no additional tools such as a marking pen and repeated irradiation are required, and the incision mark can be set in an image showing details of the imaged part of the patient, which details may not be discernible in an image taken from a projection direction.
[0022] Since the viewing direction of the medical imaging system is known when the fluoroscopic images are captured, the position of the imaging plane of the image detector, and therefore the position of the fluoroscopic images in the reference frame of the medical imaging system, is known. The position of the incision markers is then also defined in the reference frame of the medical imaging system. This means that there is no need to track or register the patient as long as the patient has the same position relative to the medical imaging system when the fluoroscopic images are captured and the incision markers are projected.
[0023] In one application, a fluoroscopic image shows at least a portion of a patient's spine, a vertebra or vertebrae may be marked in the fluoroscopic image, and the position of one or more selected vertebrae in the patient's body may be indicated by incision markings. The position of the vertebrae cannot be directly perceived from the outside, only the position of the spinous processes can be perceived in some cases, and in some cases it is not possible to directly perceive a portion of the spine, such as for obese patients. However, there is no general correlation between the position of a vertebra and its spinous process, so the actual position of the vertebrae cannot be determined. The present invention solves this problem.
[0024] In one embodiment, at least one laser projects an imaging marker onto the patient, wherein the imaging marker indicates an image location on the patient when a fluoroscopic image is captured. The imaging marker, for example, represents a central beam of an x-ray source. In other words, the imaging marker can be used to position the medical imaging system relative to the patient so that the patient is correctly positioned within the field of view of the medical imaging system. In this embodiment, the same laser can be used to project the imaging marker and subsequently project the incision marker.
[0025] In one embodiment, the initial virtual marker is overlaid on the fluoroscopic image, wherein the position of the initial virtual marker corresponds to the position of the imaging marker on the patient. This means that the imaging direction of the medical imaging system when capturing the fluoroscopic image is indicated in the fluoroscopic image. If the imaging marker indicates the central beam of the X-ray source, the initial virtual marker indicates the position of the central beam in the fluoroscopic image. The initial virtual marker, for example, indicates the longitudinal position of the imaging marker on the patient in the fluoroscopic image.
[0026] In one embodiment, the method further comprises the step of changing the position of the initial virtual marker to obtain the virtual marker. For example, the position is changed according to user input data representing the expected movement of the initial virtual marker. It can also be said that once the initial virtual marker is overlaid on the fluoroscopic image and the incision marker is projected according to the position of the virtual marker, the initial virtual marker becomes a virtual marker. Setting the virtual marker thus includes moving the initial virtual marker.
[0027] Typically, setting a virtual marker can be performed by moving (eg, dragging) the virtual marker in the fluoroscopic image, or further can be performed by clicking a point in the fluoroscopic image.
[0028] In another embodiment, a virtual marker can be set by indicating a structure (e.g., by selecting the structure from one or more structure lists). For example, a structure such as a bone landmark can be indicated. This structure is then automatically found in the fluoroscopic image, and the virtual marker is set accordingly. In another example, a list of bones shown in the fluoroscopic image is displayed, and the user selects one of the bones. In an optional second step, a list of landmarks and / or parts of the selected bones is displayed, and the user selects the landmark or part to which the virtual marker will be automatically set subsequently. The user can then modify the virtual marker that is automatically set.
[0029] In the above, a user making a selection involves receiving user input indicating a selection.
[0030] In one embodiment, controlling at least one laser involves at least one of: performing a linear displacement of at least one laser in a translational dimension; and performing a rotational displacement of a laser beam emitted by at least one laser about an axis. In one example, the linear displacement and / or the rotational displacement is relative to a gantry. The rotational displacement of the laser beam can be achieved, for example, using a mirror that is adjustable to modify the direction of the laser beam. An axis (about which the laser beam is displaced) is, for example, orthogonal to the direction of the laser beam or lies in the plane in which the laser beam lies.
[0031] With the displacement relative to the gantry, the incision markings can be projected to the correct location without moving the gantry relative to the patient.
[0032] In another embodiment, controlling at least one laser to project an incision mark involves rotating the laser, for example, about a vertical axis of the patient. The vertical axis is also referred to as the craniocaudal axis or the longitudinal axis. In one embodiment, the laser moves along a circular trajectory. The laser can be moved, for example, relative to a gantry, for example, inside a gantry, for example, on a track. The laser can be moved, for example, with an x-ray detector. If the laser is securely attached to the gantry, the gantry or a portion of the gantry carrying the laser performs the rotation. Rotating the laser is particularly useful if the laser used to project the imaging mark is also used to project the incision mark, because the projection of the incision mark is performed from a direction different from the imaging direction of the fluoroscopic image.
[0033] In one embodiment, a laser is attached to an X-ray detector. The laser source is positioned so that the incision mark can be projected from a projection direction, which then optionally involves rotating the X-ray detector around the patient, such as around the longitudinal axis of the patient, such as with or along the gantry. Then, starting from the position where the fluoroscopic image is captured using the X-ray detector, the X-ray detector is rotated, for example, by 90°, 85° to 95°, 80° to 100°, or 70° to 110°. The laser attached to the X-ray detector can mean a rigid attachment or an attachment in which the laser can be moved relative to the X-ray detector, such as along a track.
[0034] In one embodiment, the virtual marker is a point. Such a point can, for example, mark a single object within a patient. The point can be initially set, for example, using a graphical user interface, or the point can be an existing point that is moved within the fluoroscopic image. As described above, when the fluoroscopic image is captured, the existing point can indicate the center beam of the medical imaging system. The point can also be marked by a crosshair.
[0035] In this embodiment, at least one laser projects a dot or crosshair as an incision mark, for example. The dot or crosshair can mark a point suitable for an incision or a micro-cut, for example, to reach the point indicated by the virtual mark.
[0036] In one embodiment, the virtual marker indicates the vertical position of the spine. The vertical position means the position along the longitudinal axis of the patient. The virtual marker can, for example, indicate the start or end of an expected incision, which will be indicated by the incision marker.
[0037] In one embodiment, the light beam emitted by at least one laser is directed in the front-to-back direction of the patient. The laser beam is projected onto the patient's back, for example, and can thus indicate the vertical position on the spine represented by the virtual marker.
[0038] In one embodiment, the laser projects a line as an incision mark. This line is, for example, located in the patient's horizontal plane, which is also called the transverse plane.
[0039] The line can be obtained, for example, by spreading a point beam (eg using an optical prism) or by scanning the laser beam (eg using a movable mirror).
[0040] In one embodiment, the method further comprises the step of setting a second virtual marker in the fluoroscopic image. In one case, the first virtual marker indicates a first end of the intended incision and the second virtual marker indicates a second end of the intended incision. However, the second virtual marker can be used for any point of the region of interest. In this embodiment, another step is to control at least one laser to project a second incision marker according to the second virtual marker. This means that two incision markers are projected corresponding to the two virtual markers. However, three or more virtual markers can also be set, resulting in at least one laser projecting three or more incision markers.
[0041] The second incision mark can be projected by the same laser that projects the first incision mark, for example by using a mirror for deflecting the laser beam. However, a different laser can also be used to project the second incision mark.
[0042] In one embodiment, the method further comprises the steps of: changing the position of the virtual marker in the fluoroscopic image; controlling at least one laser according to the changed position of the virtual marker to adapt the position of the corresponding incision mark in real time. This means that the position of the virtual marker can be adjusted in the fluoroscopic image, and the effect of the changed position of the virtual marker can be immediately visualized on the patient surface.
[0043] The present invention further relates to a program that, when executed on a computer connected to a medical imaging system including a movable gantry and at least one laser adjustable relative to the gantry, causes the computer to perform the following steps: acquiring a fluoroscopic image of at least a portion of a spine of a patient; receiving user input representing a virtual marker in the fluoroscopic image; and outputting control parameters for controlling the at least one laser to project an incision marker onto the patient based on the virtual marker.
[0044] This procedure corresponds to the method described above and therefore achieves the same technical effect, but only in terms of data processing.
[0045] The invention further relates to a computer on which the above-mentioned program is stored and / or executed.
[0046] The invention further relates to a system comprising such a computer and a medical imaging system comprising a gantry and at least one laser adjustable relative to the gantry.
[0047] Still further, the present invention relates to a non-transitory computer-readable storage medium having the program stored thereon.
[0048] For example, the present invention does not involve or specifically does not comprise or encompass invasive procedures that represent substantial physical disturbances of the body, require specialized medical care, and even when performed with the required specialized care and care, may expose the body to significant health risks.
[0049] For example, the present invention does not include the step of performing an incision. More specifically, the present invention does not involve or specifically does not include or encompass any surgical or therapeutic activity. Instead, the present invention is directed to preparations that can be used for incisions. Only for this preparation, no surgical or therapeutic activity, in particular no surgical or therapeutic steps, are necessary or implied by practicing the present invention. Incision markings can be used, for example, as a marker where one draws a mark on the patient's skin using a pen or the like.
[0050] Use of equipment or system
[0051] The invention further relates to a device / system or any embodiment thereof for projecting incision markings onto a patient.
[0052] definition
[0053] Definitions of specific terms used in this disclosure are provided in this section and also constitute a part of this disclosure.
[0054] Computer-implemented method
[0055] The method according to the invention is, for example, a computer-implemented method for performing method steps or directing an entity to perform method steps as appropriate. For example, all steps or only some steps (i.e., less than the total number of steps) of the method according to the invention can be performed by a computer (e.g., at least one computer). An embodiment of the method implemented by a computer is the use of a computer to perform a data processing method. An embodiment of the method implemented by a computer is a method for operating a computer so that the computer is operated to perform one, more or all steps of the method.
[0056] The computer comprises, for example, at least one processor and, for example, at least one memory, in order to (technically) process data, for example electronically and / or optically process data. The processor is, for example, made of a semiconductor substance or composition, for example, at least partially n-type and / or p-type doped semiconductor, for example, at least one of type II, type III, type IV, type V, type VI semiconductor materials, for example (doped) silicon and / or gallium arsenide. The described calculation steps or determination steps are, for example, performed by a computer. The determination step or calculation step is, for example, a step of determining data within the framework of a technical method (for example, within the framework of a program). The computer is, for example, any type of data processing device, for example, an electronic data processing device. The computer can be a device that is generally regarded as a computer, such as a desktop personal computer, a laptop, a netbook, etc., but can also be any programmable device, such as a mobile phone or an embedded processor. The computer can, for example, include a "sub-computer" system (network), in which each sub-computer represents a computer by itself. The term "computer" includes cloud computers, such as cloud servers. The term "computer" includes server resources. The term "cloud computer" includes a cloud computer system, which includes, for example, a system of at least one cloud computer, and, for example, includes a plurality of operably interconnected cloud computers, such as a server cluster. Such a cloud computer is preferably connected to a wide area network such as the World Wide Web (WWW) and is located in a so-called cloud of computers all connected to the World Wide Web. Such infrastructure is used for "cloud computing", which describes those computing, software, data access and storage services that do not require the end user to know the physical location and / or configuration of the computer providing a particular service. For example, the term "cloud" is used metaphorically for the Internet (World Wide Web). For example, the cloud provides a computing infrastructure as a service (IaaS). A cloud computer can be used as a virtual host for an operating system and / or a data processing application for executing the method of the present invention. A cloud computer is, for example, provided by Amazon Web Services. TM) provided by Elastic Compute Cloud (EC2). The computer, for example, includes an interface to receive or output data and / or perform analog-to-digital conversion. The data, for example, represents physical properties and / or is generated from technical signals. The technical signal is generated, for example, by a (technical) detection device (for example, a device for detecting a marking device) and / or a (technical) analysis device (for example, a device for performing a (medical) imaging method), wherein the technical signal is, for example, an electrical signal or an optical signal. The technical signal, for example, represents data received or output by the computer. The computer is preferably operably coupled to a display device that allows information output by the computer to be displayed to, for example, a user. An example of a display device is a virtual reality device or an augmented reality device (also known as virtual reality glasses or augmented reality glasses), which can be used as "goggles" for navigation. A specific example of such augmented reality glasses is Google Glass (Google Glass, a trademark brand of Google, Inc.). The augmented reality device or virtual reality device can be used to input information into the computer through user interaction and to display information output by the computer. Another example of a display device is a standard computer monitor, for example including a liquid crystal display, which is operatively connected to a computer for receiving display control data from the computer to generate signals for displaying the image information content on the display device. A specific embodiment of such a computer monitor is a digital light box. An example of such a digital light box is the product of Brainlab AG The monitor may also be, for example, a handheld portable device, such as a smartphone or a personal digital assistant or a digital media player. The invention also relates to a computer program which, when run on a computer, causes the computer to perform one or more of the methods described herein, and / or a program storage medium (particularly in a non-transitory form) storing the program, and / or a computer comprising the above-mentioned program storage medium, and / or a (physical, e.g. electrical, e.g. technologically generated) signal wave, e.g. a digital signal wave, such as an electromagnetic carrier wave, which carries information representing a program (e.g. the aforementioned program, which e.g. comprises code means suitable for performing any or all of the method steps described herein).
[0057] Within the framework of the present invention, a computer program element may be embodied by hardware and / or software (this includes firmware, resident software, microcode, etc.). Within the framework of the present invention, a computer program element may take the form of a computer program product, which may be implemented by a computer-usable, e.g. computer-readable data storage medium, which includes computer-usable, e.g. computer-readable program instructions, the "code" or "computer program" embodied in the data storage medium being used on or in conjunction with an instruction execution system. Such a system may be a computer; a computer may be a data processing device comprising means for executing a computer program element and / or a program according to the present invention, e.g. a data processing device comprising a digital processor (central processing unit or CPU) executing the computer program element, and optionally a data processing device comprising a volatile memory (e.g. random access memory or RAM) for storing data used for and / or generated by executing the computer program element. Within the framework of the present invention, a computer-usable, e.g. computer-readable data storage medium may be any data storage medium that may contain, store, communicate, propagate or transmit programs for use on or in conjunction with those instruction execution systems, devices or apparatuses. Computer-usable, for example, computer-readable data storage media can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or apparatuses, or communication media such as the Internet. Computer-usable or computer-readable data storage media can even be, for example, paper or other suitable media on which the program can be printed, because the program can be captured electronically, for example, by optically scanning the paper or other suitable media, and then compiled, decoded or otherwise processed in an appropriate manner. The data storage medium is preferably a non-volatile data storage medium. The computer program product described herein and any software and / or hardware form various mechanisms for performing the functions of the present invention in the example embodiments. The computer and / or data processing device can, for example, include a guidance information device, which includes a mechanism for outputting guidance information. The guidance information can, for example, be output to the user visually by a visual indication mechanism (e.g., a monitor and / or a light) and / or audibly by an auditory indication mechanism (e.g., a speaker and / or a digital voice output device) and / or tactilely by a tactile indication mechanism (e.g., a vibration element or a vibration element incorporated into an instrument). For the purpose of this document, a computer is a technical computer, for example comprising technical components such as tangible components, for example mechanical components and / or electronic components. Any device mentioned in this document is a technical device and is for example a tangible device.
[0058] Get data
[0059] The expression "obtaining data" for example includes (within the framework of the computer-implemented method) a scenario in which data is determined by a computer-implemented method or program. Determining data for example includes measuring a physical quantity and transforming the measured value into data, such as digital data, and / or calculating (such as outputting) the data with the aid of a computer and for example within the framework of the method according to the invention. The "determining" step as described herein for example includes or consists of issuing a command to perform the determination described herein. For example, the step includes or consists of issuing a command to cause a computer (such as a remote computer, such as a remote server, such as in the cloud) to perform the determination. Alternatively or additionally, the "determining" step as described herein for example includes or consists of the following steps: receiving the result data of the determination described herein, such as receiving the result data from a remote computer (such as from a remote computer that causes it to perform the determination). The meaning of "obtaining data" also includes, for example, the following scenario: receiving or retrieving data by (such as inputting) a method or program implemented by a computer, such as from another program, a previous method step or a data storage medium, such as for further processing by a method or program implemented by a computer. The generation of the data to be acquired can, but does not have to be, part of the method according to the invention. Therefore, the expression "obtaining data" can also, for example, mean waiting to receive data and / or receiving data. The received data can be input, for example, via an interface. The expression "obtaining data" can also mean that a method or program implemented by a computer performs some steps in order to (actively) receive or retrieve data from a data source such as a data storage medium (e.g., ROM, RAM, database, hard disk drive, etc.) or via an interface (e.g., from another computer or network). The data obtained by the method or device of the present disclosure, respectively, can be obtained from a database located in a data storage device, which is operably connected to a computer for data transmission between the database and the computer, such as data transmission from a database to a computer. The computer obtains data for use as input in the "determine data" step. The determined data can be output to the same or another database for storage for subsequent use. The database or the database for implementing the disclosed method can be located in a network data storage device or a network server (e.g., a cloud data storage device or a cloud server) or a local data storage device (e.g., a mass storage device operably connected to at least one computer performing the disclosed method). The data can be "ready" by performing an additional step before the acquisition step. According to this additional step, data is generated for acquisition. For example, the data are detected or captured (eg, by an analysis device). Alternatively or additionally, the data are input according to an additional step, such as via an interface. For example, the generated data may be input (eg, into a computer).According to an additional step (which is performed before the acquisition step), the data can also be provided by performing an additional step of storing the data on a data storage medium (such as a ROM, RAM, CD and / or hard disk drive), so that the data are ready within the framework of the method or program according to the invention. Therefore, the step of "acquiring data" can also involve commanding the device to acquire and / or provide the data to be acquired. In particular, the acquisition step does not involve an invasive step, which represents a substantial physical interference with the body, requiring professional medical measures, and even if the required professional care and measures are taken when performed, the body may be exposed to significant health risks. In particular, the step of acquiring data, such as determining data, does not involve a surgical step, in particular does not involve a step of treating the human or animal body with surgery or therapy. In order to distinguish between the different data used by the present method, the data are denoted (i.e. referred to as) "XY data" etc. and are defined according to the information they describe, and then preferably referred to as "XY information" etc.
[0060] Landmarks
[0061] Landmarks are defining elements of body anatomical parts, which are always identical or highly similarly reproduced in the same body anatomical parts of multiple patients. Typical landmarks are, for example, the tip of the epicondyle of the femur or the transverse process and / or dorsal process of the vertebra. These points (main points or auxiliary points) can represent such landmarks. Landmarks located on typical anatomical structures of body parts (for example, on their surface) can also represent the structures. Landmarks can represent the entire anatomical structure, or they can represent only one point or a part thereof. Landmarks can also be located on anatomical structures, for example, which are protruding structures. An example of such anatomical structure is behind the iliac crest. Another example of a landmark is defined by the rim of the acetabulum, for example, defined by the center of the rim. In another example, a landmark represents the bottom or deepest point of the acetabulum, which is derived from multiple detection points. Therefore, a landmark can, for example, represent multiple detection points. As described above, landmarks can represent anatomical features defined on the basis of characteristic structures of body parts. In addition, landmarks can also represent anatomical features defined by the relative motion of two body parts, such as the rotation center of the femur when the acetabulum moves relative to the acetabulum. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] In the following, the present invention is described with reference to the accompanying drawings, which give a background description of the present invention and show specific embodiments of the present invention. However, the scope of the present invention is not limited to the specific features disclosed in the context of the accompanying drawings, in which:
[0063] Figure 1 A medical imaging system is shown;
[0064] Figure 2 showing details of a detector including a laser;
[0065] Figure 3 is a schematic diagram of a computer for implementing the method;
[0066] Figure 4 showing the workflow of the method;
[0067] Figure 5a A fluoroscopic image with two virtual markers is shown;
[0068] Figure 5b Shown is a lateral view of the patient with two incision marks. DETAILED DESCRIPTION
[0069] Figure 1 A medical imaging system 1 is schematically shown, comprising a gantry 2 carrying an X-ray source 3 and carrying an X-ray detector 4. The gantry 2 comprises a base and a ring, wherein at least the X-ray detector 4, but optionally also the X-ray source 3, is rotatable in the ring. The base 2 comprises wheels (not shown), with which the medical imaging system 1 can be located, for example, in an operating room. The ring can be tiltable relative to the base.
[0070] The X-ray source 3 emits an X-ray beam which radiographs a patient (not shown), is then detected using the detector 4, and is converted into a displayable image which can be recognized by humans.
[0071] Figure 2 An exploded view of the components of the X-ray detector 4 is shown. It includes a detector panel 7, which is defined as two dimensions by an X direction and a Y direction that are orthogonal to each other. Adjacent to the detector panel 7 are rails 6a, 6b and 6c, wherein rail 6a carries lasers 5a and 5b, rail 6b carries laser 5c, and rail 6c carries laser 5d. Each laser 5 emits a laser beam. In the current embodiment, each laser beam is a fan beam located on a specific plane. This plane is generally perpendicular to the direction in which the corresponding rail 6 extends. This means that the fan beams emitted by the lasers 5a and 5b are generally located in a plane spanned by the Y direction and the Z direction that is perpendicular to both the Y direction and the X direction, and the laser beams emitted by the lasers 5c and 5d are generally located in a plane spanned by the X direction and the Z direction. However, in this embodiment, the laser beam can be tilted relative to the plane, for example, using a pivotable mirror. The laser beams emitted by the lasers 5a and 5b can be rotated about the Y direction, and the beams emitted by the lasers 5c and 5d can be rotated about the X direction.
[0072] When capturing fluoroscopic images using the medical imaging system 1, the lasers 5 can be used to indicate the field of view of the medical imaging system. In one embodiment, the two lasers project crosshairs indicating the center beam of the medical imaging system 1. In another embodiment, the lasers 5 are controlled to emit their beams toward the X-ray source 3 so that the beams indicate the boundaries of the X-ray source 3.
[0073] Figure 3 A computer 8 connectable to a medical imaging system 1 is schematically shown. The computer 8 comprises a central processing unit 9, a memory 10 and an interface 11 for connecting the computer 8 to the medical imaging system 1. The computer 8 is connected to an input device 12, such as a keyboard and / or a mouse, and an output device 13, such as a monitor. The memory 10 stores instructions which, when executed by the central processing unit 9, implement the claimed method. The memory 10 may further store working data, such as fluoroscopic images obtained from the medical imaging system 1. The computer 8 is further configured to control the imaging device 1 via the interface 11, for example to control one or more lasers 5, or to activate actuators of the medical imaging system, for example for moving a base of the gantry 2 or rotating an X-ray source and / or an X-ray detector 4 within a ring of the gantry 2.
[0074] Figure 4 The general structure of the claimed method is shown.
[0075] Step S01 involves capturing an image of at least a portion of a patient using a medical imaging system 1. The fluoroscopic image is transmitted to a computer 8 and displayed on an output device 13. In step S02, using an input device 12, a user may set one or more virtual markers in the fluoroscopic image.
[0076] In step S03 , the computer 8 controls at least one of the lasers 5 according to the virtual mark set in step S02 to project an incision mark.
[0077] Figure 5a An exemplary transverse fluoroscopic image of a portion of a patient's spine taken from the transverse direction is shown. Arrow A indicates the longitudinal direction of the patient, and arrow B indicates the anterior-posterior direction of the patient. The transverse direction is perpendicular to the longitudinal direction and the anterior-posterior direction.
[0078] exist Figure 5a In the example of FIG. 1 , two virtual markers V1 and V2 are set from the perspective of a vertical line in a transverse fluoroscopic image. The two virtual markers V1 and V2 mark the start and end points of an area extending longitudinally of the patient, which area should be entered through an incision. It should be noted that the two endpoints can also be indicated by virtual markers in the shape of dots or any other suitable shape.
[0079] exist Figure 5aIn the example shown, the computer 8 controls the lasers 5a and 5b to project two parallel lines onto the patient's back corresponding to the positions of the virtual markers V1 and V2 in the fluoroscopic image. Figure 5b , which is a schematic rear view of the patient. The incision marks I1 and I2 are shown in FIG. 1 , which is a schematic rear view of the patient. The incision marks may have other shapes, such as a point, a dot, a crosshair or any other suitable shape. If necessary, the computer 8 instructs the medical navigation system to rotate the ring of the gantry 2 together with the X-ray detector 4, or the X-ray detector 4 along the gantry 2, so that the lasers 5a and 5b are in a position where they can emit their own laser beams to the back of the patient. Based on the positions of the corresponding number of virtual markers set in the transverse fluoroscopic image, only one or more than two incision marks may be projected onto the back or rearside of the patient.
[0080] Since the viewing direction of the fluoroscopic image on the patient is known (lateral in this case) and the laser 5 is calibrated relative to the gantry 2, the computer 8 can calculate the position of the laser 5 along the guide rail 6 and the angle at which the laser must emit the laser beam so that the laser line is projected at the correct position on the patient's surface.
[0081] In a modification or extension of the embodiment, the virtual marker V1 or V2 may be moved in the corresponding fluoroscopic image using the input device 12. If the position of the virtual marker in the fluoroscopic image is changed, the computer 8 guides the laser 5 to adapt the position of the laser line on the patient surface in real time.
Claims
1. A method for projecting an incision mark (I1, I2) onto a patient using a medical imaging system (1), the medical imaging system (1) comprising a gantry (2) and at least one laser (5) adjustable relative to the gantry (2), the method comprising the following steps: capturing a fluoroscopic image of at least a portion of a bone structure of the patient from a viewing direction on the patient, placing virtual markers (V1, V2) in the fluoroscopic image, and controlling the at least one laser (5) to project the incision marking (I1, I2) onto the patient from a projection direction different from the observation direction according to the virtual marking (V1, V2), The at least one laser (5) projects an imaging mark indicating an image position on the patient when the fluoroscopic image is captured, an initial virtual mark is overlaid on the fluoroscopic image, and the position of the initial virtual mark corresponds to the position of the imaging mark on the patient.
2. The method according to claim 1, wherein: The angle between the viewing direction and the projection direction is between 85° and 95°.
3. The method according to claim 1 or 2, further comprising the following steps: The position of the initial virtual marker is changed to obtain the virtual marker.
4. The method according to claim 1 or 2, wherein: The virtual marker is a point.
5. The method according to claim 3, wherein: The virtual marker is a point.
6. The method according to any one of claims 1, 2 and 5, wherein: The at least one laser (5) projects a dot or a crosshair as the incision mark (I1, I2).
7. The method according to claim 3, wherein: The at least one laser (5) projects a dot or a crosshair as the incision mark (I1, I2).
8. The method according to claim 4, wherein: The at least one laser (5) projects a dot or a crosshair as the incision mark (I1, I2).
9. The method according to any one of claims 1, 2, 5, 7, and 8, wherein: The bone structure includes at least a portion of a spinal column, and the virtual markers (V1, V2) indicate vertical locations on the spinal column.
10. The method according to claim 3, wherein: The bone structure includes at least a portion of a spinal column, and the virtual markers (V1, V2) indicate vertical locations on the spinal column.
11. The method according to claim 4, wherein: The bone structure includes at least a portion of a spinal column, and the virtual markers (V1, V2) indicate vertical locations on the spinal column.
12. The method according to claim 6, wherein: The bone structure includes at least a portion of a spinal column, and the virtual markers (V1, V2) indicate vertical locations on the spinal column.
13. The method according to claim 9, wherein: The laser (5) projects a line as the incision mark (I1, I2).
14. The method according to any one of claims 10 to 12, wherein: The laser (5) projects a line as the incision mark (I1, I2).
15. The method according to any one of claims 1, 2, 5, 7, 8, 10-13, further comprising the following steps: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
16. The method according to claim 3, further comprising the steps of: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
17. The method according to claim 4, further comprising the steps of: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
18. The method according to claim 6, further comprising the steps of: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
19. The method according to claim 9, further comprising the steps of: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
20. The method according to claim 14, further comprising the steps of: placing a second virtual marker in the fluoroscopic image, and The at least one laser (5) is controlled to project a second incision mark according to the second virtual mark.
21. The method according to any one of claims 1, 2, 5, 7, 8, 10-13, 16-20, further comprising the following steps: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
22. The method according to claim 3, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
23. The method according to claim 4, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
24. The method according to claim 6, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
25. The method according to claim 9, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
26. The method according to claim 14, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
27. The method according to claim 15, further comprising the steps of: changing the position of the virtual markers (V1, V2) in the fluoroscopic image, and The at least one laser (5) is controlled according to the changed position of the virtual mark (V1, V2) to adapt to the position of the corresponding incision mark (I1, I2) in real time.
28. A computer program product, wherein: A computer (8) is connected to a medical imaging system (1), the medical imaging system (1) comprising a gantry (2) and at least one laser (5) adjustable relative to the gantry (2), the computer program product, when running on the computer (8), causing the computer (8) to perform the following steps: acquiring a fluoroscopic image of at least a portion of a bone structure of the patient from a viewing direction on the patient, receiving user input representing a virtual marker (V1, V2) in the fluoroscopic image, and outputting control parameters for controlling the at least one laser (5) so as to project an incision mark (I1, I2) onto the patient from a projection direction different from the observation direction according to the virtual mark, The at least one laser (5) projects an imaging mark indicating an image position on the patient when the fluoroscopic image is captured, an initial virtual mark is overlaid on the fluoroscopic image, and the position of the initial virtual mark corresponds to the position of the imaging mark on the patient.
29. A computer (8) on which the computer program product according to claim 28 is stored and / or executed.
30. A system comprising a computer (8) according to claim 29 and a medical imaging system (1), wherein: The medical imaging system (1) comprises a gantry (2) and at least one laser (5) adjustable relative to the gantry (2).
31. A non-transitory computer-readable storage medium having stored thereon the computer program product of claim 28.
