Sampling method of relevant surface points of the subject
By determining the expected process and tissue type of the subject in the medical navigation system, verifying and screening surface points, the problems of surface point acquisition error and difficulty in handling coverage areas in the prior art are solved, and the accuracy of acquisition of surface geometry is improved .
Patent Information
- Application Number
- CN202080027746.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-04-10
- Filing Date
- 2020-04-09
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2040-04-09
AI Technical Summary
Existing medical navigation systems are prone to measurement errors when acquiring the subject's surface points, especially in the covered area (such as covered by hair) that are difficult to accurately obtain using a contactless method.
Improved acquisition of surface geometry by determining the expected process and tissue type of subjects, using registration devices to determine the location of surface points, and verifying relevant or non-related surface points based on tissue type, accepting relevant points and discarding non-related points, thereby improving the acquisition of surface geometry, using registration devices to determine the location of surface points, and verifying relevant or non-related surface points based on tissue type, accepting relevant points and discarding non-related points. .
Improve the accuracy and accuracy of surface geometry acquisition, especially in the processing of covered areas, ensuring the accuracy and reliability of medical navigation systems.
Smart Images

Figure CN113660912B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method for sampling relevant surface points of a subject for a medical navigation system, a registration device, a surgical navigation system for computer-assisted surgery, and a computer program. Background Art
[0002] Surface-based image registration is an established method for associating medical image data with anatomical regions of a patient. Surface geometry acquisition methods can be divided into contactless methods and contact-based methods. Contact-based methods are generally prone to measurement errors because points may be acquired above or below the actual surface. On the other hand, contactless methods generally cannot be used to acquire points on covered areas (e.g., covered by hair).
[0003] The present invention can be used in IGS (image guided surgery) workflow. Potential applications include spinal surgery, cranial surgery, ENT surgery, CMF surgery and laparoscopic surgery.
[0004] Aspects, examples and exemplary steps of the invention and its implementation are disclosed below.Different exemplary features of the invention can be combined in any technically advantageous and feasible manner according to the invention.
[0005] Exemplary brief description of the invention
[0006] In light of the prior art described above, it can be seen that it is an object of the present invention to provide an improved method for sampling relevant surface points of a subject by analysis of the subject's tissue type involving a medical navigation system.
[0007] In the following, a brief description of specific features of the present invention is given, which should not be understood as limiting the present invention to only the features or combinations of features described in this section.
[0008] A method for sampling relevant surface points of a subject for a medical navigation system is proposed.
[0009] In particular, from a plurality of surface points of a subject, relevant surface points are accepted and non-relevant surface points are discarded.One technical effect of the present invention is that surface geometry acquisition of a subject may be improved.
[0010] For this purpose, additional information of the surface points is acquired and the additional information is assigned to the respective surface point for verifying each surface point.
[0011] General Description of the Invention
[0012] In this section, a description of general features of the invention is given, for example by reference to possible embodiments of the invention.
[0013] This is achieved by the subject matter of the independent claims, wherein further embodiments are incorporated in the dependent claims and the following description.
[0014] The described embodiments similarly relate to methods for sampling relevant surface points of a subject for a medical navigation system, surgical navigation systems for computer-assisted surgery, and computer programs. Different combinations of multiple embodiments may produce synergistic effects, although they may not be described in detail below. In addition, it should be noted that all embodiments of the present invention regarding the method can be performed in the order of the steps explicitly described herein. However, this is not necessarily the only and required order of the steps of the method. Unless there is a clear contrary prompt below, the method presented herein can be performed in another order of the disclosed steps without departing from the corresponding method embodiment.
[0015] Technical terms are used in their ordinary sense. If certain terms are intended to convey a specific meaning, the definition of that term will be given in the context in which the term is used.
[0016] According to the present disclosure, a method for sampling relevant surface points of a subject of a medical navigation system is provided. The method comprises the following steps: determining a surface registration type for an expected process of the subject according to the expected process of the subject, wherein the surface registration type comprises at least one relevant tissue type of at least a portion of the subject. In addition, a registration device is used to determine the position of at least one surface point of the subject. The method also comprises identifying the tissue type of the subject at at least one determined surface point and verifying the at least one surface point according to the identified tissue type and the determined surface registration type of the expected process, thereby determining the position of at least one relevant surface point and / or at least one non-relevant surface point, wherein at least one relevant surface point is accepted and at least one non-relevant surface point is discarded.
[0017] In a preferred embodiment, the method is performed for each surface point. Alternatively, a plurality of surface points are determined, thus identifying the tissue type of the subject for each surface point, and then the validation step involves filtering the relevant surface points from the plurality of determined surface points. In this case, a step of associating the determined surface points with the identified tissue type of the subject at the corresponding surface point is required.
[0018] In a preferred embodiment, a plurality of frames (or in other words images) are taken during the sampling process, wherein for each frame at least one surface point of the subject is determined and the tissue type of the determined surface point is identified. In case a 3D scanner or a structured light scanner is used, more than one surface point of the subject may be determined for each frame.
[0019] In a preferred embodiment, tissue types include skin; bone; different tissues, in particular biological tissues, such as blood vessels, heart tissue, liver tissue and / or kidney tissue; and / or non-biological tissues, such as drapes (in particular surgical drapes), silicone incision drapes and / or table mats. The term "tissue type" as used herein can generally be related to a surface type.
[0020] In a preferred embodiment, the surface registration types include facial registration (particularly for neurosurgery), intranasal registration (particularly for ENT surgery), liver registration (particularly for laparoscopic surgery and / or open surgery), and / or bone surface registration (particularly for spinal surgery and / or orthopedic surgery).
[0021] Thus, for example, for facial registration and / or ENT surgery, the relevant tissue types include skin. In another example, for bone surface registration, the relevant tissue types include bone. According to another example, for liver registration, the relevant tissue types include liver tissue. For example, for intranasal registration, the relevant tissue types include mucosa.
[0022] The term "subject" as used herein includes human beings (particularly patients).
[0023] The term "surface point" as used herein may also be referred to as surface coordinate.
[0024] The term "relevant surface point" as used herein relates to a surface point that is verified to be relevant to a determined surface registration type. For example, a surface point with tissue type "bone" is a relevant surface point for spinal surgery. In another example, a surface point with tissue type "drape" is typically a non-relevant surface point.
[0025] The term "intended procedure" relates to a procedure and / or intervention, such as a surgery, that is intended to be performed on a subject, such as a patient.
[0026] Preferably, the method as described herein relates to a computer implemented medical method.
[0027] Therefore, only relevant surface data are acquired and non-relevant surface data do not distort the relevant dataset.
[0028] Thus, the acquisition of the surface geometry of the subject may be improved.
[0029] Computer-implemented methods
[0030] The method according to the present invention is, for example, a computer-implemented method. For example, all steps or only some steps (i.e., less than the total number of steps) of the method according to the present invention can be performed by a computer (e.g., at least one computer). An embodiment of the computer-implemented method is to use a computer to perform a data processing method. An embodiment of the computer-implemented method is a method for operating a computer so that the computer is operated to perform one step, more steps, or all steps of the method.
[0031] The computer comprises, for example, at least one processor and, for example, at least one memory, to process data (technically), for example, electronically and / or optically. The processor is, for example, made of a substance or composition that is a semiconductor (for example, an at least partially n-doped and / or p-doped semiconductor), which is, for example, at least one of a II semiconductor material, a III semiconductor material, an IV semiconductor material, a V semiconductor material, a VI semiconductor material, for example (doped) silicon and / or gallium arsenide. The described calculation steps or determination steps are, for example, performed by a computer. The determination step or calculation step is, for example, a step of determining data within the framework of a technical method (for example, within the framework of a program). A computer is, for example, any type of data processing device, for example, an electronic data processing device. A computer may be a device, such as a desktop PC, a laptop, a netbook, etc., which is generally considered to be a computer, but may also be any programmable device, such as a mobile phone or an embedded processor. A computer may, for example, include a system (network) of "sub-computers", wherein each sub-computer itself represents a computer. The term "computer" includes cloud computers, such as cloud servers. The term "cloud computer" includes a cloud computer system, which includes, for example, at least one cloud computer and, for example, a system of multiple operably interconnected cloud computers (such as server farms). Such a cloud computer is preferably connected to a wide area network such as the World Wide Web (WWW), and is located in a so-called computer cloud that is connected to the World Wide Web. Such an infrastructure is used for "cloud computing", which describes the calculation, software, data access and storage services that do not require end users to know the physical location and / or configuration of the computer that provides a specific service. For example, the term "cloud" is used as a metaphor for the Internet (World Wide Web) in this regard. For example, the cloud provides computing infrastructure as a service (IaaS). A cloud computer can be used as a virtual host for an operating system and / or data processing application for performing the method of the present invention. A cloud computer is, for example, an elastic computing cloud (EC2) provided by Amazon Web Services. A computer, for example, includes an interface for receiving data or outputting data and / or performing analog-to-digital conversion. The data, for example, represents physical properties and / or is generated by a technical signal. The technical signal is generated, for example, by means of a (technical) detection device (for example, a device for detecting a marking device) and / or a (technical) analysis device (for example, a device for performing a (medical) imaging method), wherein the technical signal is, for example, an electrical signal or an optical signal. The technical signal represents, for example, data received or output by a computer. The computer is preferably operably coupled to a display device that enables information output by the computer to be displayed to, for example, a user. An example of a display device is a virtual reality device or an augmented reality device (also referred to as virtual reality glasses or augmented reality glasses) that can be used as "goggles" for navigation. A specific example of such augmented reality glasses is Google Glass (trademark of Google Inc.).Augmented reality devices or virtual reality devices can be used to input information to a computer through user interaction, and can also be used to display information output by a computer. Another example of a display device would be a standard computer monitor, which includes, for example, a liquid crystal display, which is operably coupled to a computer for receiving display control data from the computer to generate a signal for displaying image information content on the display device. A specific embodiment of such a computer monitor is a digital light box. An example of such a digital light box is a buzzer (Buzz) of Bo Yi Lai Co., Ltd. The monitor can also be a monitor of a portable (e.g., handheld) device such as a smart phone or a personal digital assistant or a digital media player.
[0032] The present invention also relates to: a program which, when run on a computer, causes the computer to perform one or more or all of the method steps described herein; and / or a program storage medium on which the program is stored (especially in a non-transitory form); and / or a computer comprising the program storage medium; and / or a signal wave (e.g. a digital signal wave) (physical, e.g. electrical, e.g. technically generated) carrying information representing the program, the program (e.g. the program mentioned above), for example, comprising code means suitable for performing any or all of the method steps described herein.
[0033] Within the framework of the present invention, a computer program element may be implemented by hardware and / or software (this includes firmware, resident software, microcode, etc.). Within the framework of the present invention, a computer program element may take the form of a computer program product, which may be implemented by a computer-usable, e.g., computer-readable data storage medium, which includes computer-usable, e.g., computer-readable program instructions, the "code" or "computer program" implemented in the data storage medium being used on an instruction execution system or in combination with an instruction execution system. Such a system may be a computer; a computer may be a data processing device comprising means for executing a computer program element and / or a program according to the present invention, e.g. a data processing device comprising: a digital processor (central processing unit or CPU), which executes the computer program element; and an optional volatile memory (e.g., random access memory or RAM), which is used to store data for executing the computer program element and / or data generated by executing the computer program element. Within the framework of the present invention, a computer-usable, e.g., computer-readable data storage medium may be any data storage medium that may include, store, communicate, propagate or transmit a program for use on an instruction execution system, device or apparatus or in combination with an instruction execution system, device or apparatus. The computer-usable, for example, computer-readable data storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or apparatus or a propagation medium such as the Internet. The computer-usable or computer-readable data storage medium may even be, for example, paper or another suitable medium on which the program is printed, because the program may be electronically captured, for example, by optical scanning of paper or other suitable medium, and then compiled, interpreted or otherwise processed in a suitable manner. The data storage medium is preferably a non-volatile data storage medium. The computer program product described herein and any software and / or hardware form various devices for performing the functions of the present invention in the example embodiments. The computer and / or data processing device may, for example, include a guidance information device including a device for outputting guidance information. The guidance information may be output to the user, for example, visually by a visual indication device (e.g., a monitor and / or a light) and / or acoustically by an acoustic indication device (e.g., a speaker and / or a digital voice output device) and / or acoustically by a tactile indication device (e.g., a vibration element or a vibration element incorporated into an instrument). For the purposes of this document, a computer is a technical computer, for example comprising technical components, for example tangible components, for example mechanical components and / or electronic components. Any device so mentioned in this document is a technical device, for example a tangible device.
[0034] Get data
[0035] For example, the expression "obtaining data" (within the framework of a computer-implemented method) includes scenarios in which data is determined by a computer-implemented method or program. Determining data, for example, includes measuring a physical quantity and converting the measured value into data (e.g. digital data), and / or calculating (and, for example, outputting) data with the aid of a computer and, for example, within the framework of the method according to the invention. The meaning of "obtaining data" also includes, for example, receiving data or retrieving data by (e.g. inputting to) a computer-implemented method or program, for example from another program, a previous method step or a data storage medium, for example for further processing by a computer-implemented method or program. The generation of the data to be acquired may, but is not necessarily, be part of the method according to the invention. Therefore, the expression "obtaining data" may also, for example, mean waiting to receive data and / or receiving data. The received data may, for example, be input via an interface. The expression "obtaining data" may also mean that a computer-implemented method or program performs steps to (actively) receive or retrieve data from a data source, such as a data storage medium (e.g. ROM, RAM, database, hard drive, etc.) or via an interface (e.g., from another computer or network). The data obtained by the disclosed method or device respectively can be obtained from a database located in a data storage device, which is operably connected to a computer for data transmission between the database and the computer (e.g., from a database to a computer). The computer obtains data to be used as the input of the step of determining the data. The determined data can be output to the same database or another database again to store for later use. The database or database used to implement the disclosed method can be located on a network data storage device or a network server (e.g., a cloud data storage device or a cloud server) or a local data storage device (e.g., a mass storage device operably connected to at least one computer that performs the disclosed method). By performing an additional step before the acquisition step, the data can be made "ready to use". According to the additional step, data is generated in order to obtain. Data (e.g., by an analytical device) is, for example, detected or captured. Alternatively or additionally, data is input according to an additional step (e.g., via an interface). The generated data can, for example, be input (e.g., to a computer). According to an additional step (before the acquisition step), the data may also be provided by performing the following additional step: storing the data in a data storage medium (such as a ROM, RAM, CD and / or hard drive) so that the data are ready for use within the framework of the method or program according to the invention. Therefore, the step of "acquiring data" may also involve commanding a device to obtain and / or provide the data to be acquired. In particular, the acquisition step does not involve an invasive step, which represents a substantial physical interference with the body, requires professional medical experience to perform, and carries substantial health risks even when performed with the required professional care and expertise.In particular, the step of acquiring data (e.g. determining data) does not involve a surgical step, and in particular does not involve a step of treating the human or animal body using surgery or therapy. In order to distinguish between different data used by the present method, the data is represented as (i.e. referred to as) "XY data" or the like, and is defined according to the information that the data describes, which information is then preferably referred to as "XY information" or the like.
[0036] Registration
[0037] The n-dimensional image of the body is registered when image data points of images (CT, MR, etc.) stored in the navigation system are assigned to the spatial position of each point of an actual object in space (eg, a body part in an operating room).
[0038] Image Registration
[0039] Image registration is the process of transforming different sets of data into one coordinate system. The data can be multiple photos and / or data from different sensors, at different times or from different viewpoints. Image registration is used in computer vision, medical imaging, and for compiling and analyzing images and data from satellites. In order to be able to compare or integrate the data obtained from these different measurements, registration is required.
[0040] Markers
[0041] The function of the marker is to be detected by a marker detection device (e.g., a camera or an ultrasound receiver or an analysis device such as a CT or MRI device) so that its spatial position (i.e., its spatial orientation and / or alignment) can be determined. The detection device is, for example, part of a navigation system. The marker can be an active marker. An active marker can, for example, emit electromagnetic radiation and / or waves that can be in the infrared spectral range, the visible spectral range and / or the ultraviolet spectral range. However, the marker can also be a passive marker, i.e., it can, for example, reflect electromagnetic radiation in the infrared spectral range, the visible spectral range and / or the ultraviolet spectral range or can block x-ray radiation. To this end, the marker can be provided with a surface having corresponding reflective properties or can be made of metal to block x-ray radiation. The marker can also reflect and / or emit electromagnetic radiation and / or waves in the radio frequency range or at an ultrasonic wavelength. The marker preferably has a spherical shape and / or a sphere shape, and can therefore be referred to as a marker ball; however, the marker can also present an angular shape, such as a cube shape.
[0042] Marking equipment
[0043] The marking device may be, for example, a calibration star or an indicator or a single marker or a plurality of (separate) markers, which are preferably in a predetermined spatial relationship. The marking device comprises one, two, three or more markers, wherein two or more such markers are in a predetermined spatial relationship. The predetermined spatial relationship is, for example, known to the navigation system and is, for example, stored in a computer of the navigation system.
[0044] In another embodiment, the marking device includes an optical pattern, for example, on a two-dimensional surface. The optical pattern may include a plurality of geometric shapes, such as circles, rectangles, and / or triangles. The optical pattern may be identified in an image captured by a camera, and the position of the marking device relative to the camera may be determined based on the size of the pattern in the image, the orientation of the pattern in the image, and the distortion of the pattern in the image. This enables relative positions in up to three rotational dimensions and up to three translational dimensions to be determined from a single two-dimensional image.
[0045] The position of the marking device may be determined, for example, by a medical navigation system. If the marking device is attached to an object, such as a bone or a medical instrument, the position of the object may be determined based on the position of the marking device and the relative position between the marking device and the object. Determining this relative position is also referred to as registering the marking device and the object. The marking device or the object may be tracked, which means that the position of the marking device or the object is determined two or more times over time.
[0046] Marking holder
[0047] A marker holder is understood to mean an attachment device for a separate marker, which is used to attach the marker to an instrument, a part of the body and / or a holding element of a calibration star, wherein the marker can be attached so that the marker is stationary and advantageously so that the marker can be removed. The marker holder can be, for example, rod-shaped and / or cylindrical. A fastening device for the marker device (e.g. a latch mechanism) can be arranged at the end of the marker holder facing the marker and helps to place the marker device on the marker holder in a force-fit and / or form-fit manner.
[0048] Indicator
[0049] The indicator is a rod that includes one or more (advantageously, two) markers fastened thereto and can be used to measure individual coordinates on a part of the body, such as spatial coordinates (i.e., three-dimensional coordinates), wherein a user guides the indicator (e.g., an indicator portion having a defined and advantageously fixed position relative to at least one marker attached to the indicator) to a position corresponding to the coordinates, so that the position of the indicator can be determined by detecting the markers on the indicator using a surgical navigation system. The relative position between the markers of the indicator used to measure the coordinates and the indicator portion (e.g., the end of the indicator) is, for example, known. The surgical navigation system is then able to assign the position (of the three-dimensional coordinates) to a predetermined body structure, wherein the assignment can be performed automatically or by a user process.
[0050] Calibration Star
[0051] A "calibration star" is a device to which a plurality of markers (advantageously three markers) are attached, wherein the markers are (for example detachably) attached to the calibration star in such a way that the markers are stationary, thereby providing a known (and advantageously fixed) position of the markers relative to one another. For each calibration star used within the framework of the surgical navigation method, the position of the markers relative to one another can be individually different, so that the surgical navigation system can identify the corresponding calibration star based on the position of its markers relative to one another. Thus, the object to which the calibration star is attached (for example, an instrument and / or a part of the body) can then also be identified and / or distinguished accordingly. In the surgical navigation method, the calibration star is used to attach a plurality of markers to an object (for example, a bone or a medical device) in order to be able to detect the position of the object (i.e. its spatial position and / or alignment). Such a calibration star is characterized, for example, by a way of attaching to an object (e.g. a clamp and / or a line) and / or a retaining element and / or a marking holder, the retaining element ensuring the distance between the marker and the object (e.g. to facilitate visibility of the marker for a marking detection device), the marking holder being mechanically connected to the retaining element and the marker being connectable to the marking holder.
[0052] Navigation system
[0053] The present invention also relates to a navigation system for computer-assisted surgery. The navigation system preferably includes the above-mentioned computer for processing data provided by the computer-implemented method described in any one of the embodiments described herein. The navigation system preferably includes a detection device for detecting the position of detection points representing main points and auxiliary points to generate detection signals and provide the generated detection signals to the computer so that the computer can determine absolute main point data and absolute auxiliary point data based on the received detection signals. The detection points are, for example, points on the surface of an anatomical structure detected by an indicator, for example. In this way, the absolute point data can be provided to the computer. The navigation system also preferably includes a user interface for receiving calculation results (for example, the position of the main plane, the position of the auxiliary plane and / or the position of the standard plane) from the computer. The user interface provides the received data to the user as information. Examples of user interfaces include display devices such as monitors or speakers. The user interface can use any type of indication signal (for example, visual signals, audio signals and / or vibration signals). An example of a display device is an augmented reality device (also called augmented reality glasses) that can be used as so-called "goggles" for navigation. A specific example of such augmented reality glasses is Google Glass (a trademark of Google Inc.). The augmented reality device may be used to input information into the navigation system's computer through user interaction, and may also be used to display information output by the computer.
[0054] The present invention also relates to a navigation system for computer-assisted surgery, comprising:
[0055] A computer for processing absolute point data and relative point data;
[0056] a detection device for detecting positions of the main point and the auxiliary point to generate absolute point data, and providing the absolute point data to a computer;
[0057] a data interface for receiving relative point data and providing the relative point data to a computer; and
[0058] A user interface for receiving data from a computer to provide information to a user, wherein the received data is generated by the computer based on the results of a process performed by the computer.
[0059] Surgical navigation system
[0060] A navigation system (e.g. a surgical navigation system) is understood to mean a system that may include: at least one marking device; a transmitter that emits electromagnetic waves and / or radiation and / or ultrasound; a receiver that receives electromagnetic waves and / or radiation and / or ultrasound; and an electronic data processing device that is connected to the receiver and / or the transmitter, wherein the data processing device (e.g. a computer) for example comprises a processor (CPU) and a working memory and advantageously comprises an indication device for emitting indication signals (e.g. a visual indication device such as a monitor and / or an audio indication device such as a loudspeaker and / or a tactile indication device such as a vibrator) and a permanent data memory, wherein the data processing device processes the navigation data forwarded to it by the receiver and may advantageously output guidance information to a user via the indication device. The navigation data may be stored in the permanent data memory and, for example, compared with data previously stored in said memory.
[0061] Logo
[0062] A marker is a defining element of an anatomical part, and a marker is always the same or repeated with a high degree of similarity in the same anatomical part of multiple patients. Typical markers are, for example, the end of the epicondyle of the femur or the transverse process and / or dorsal process of the vertebra. Points (primary points or auxiliary points) can represent such markers. A marker located on a characteristic anatomical structure of a body part (e.g., on the surface) can also represent the structure. A marker can represent the entire anatomical structure or only represent a point or a part of the anatomical structure. A marker can, for example, also be located on an anatomical structure such as a protruding structure. An example of such an anatomical structure is the rear of the iliac crest. Another example of a marker is a marker defined by the edge of the acetabulum (e.g., by the center of the edge). In another example, a marker represents the bottom or deepest point of the acetabulum, which comes from multiple detection points. Therefore, a marker can, for example, represent multiple detection points. As mentioned above, a marker can represent an anatomical feature defined based on a characteristic structure of a body part. In addition, a marker can also represent an anatomical feature defined by the relative movement of two body parts, such as the rotation center of the femur when moving relative to the acetabulum.
[0063] Calibration
[0064] If determining the position means that the navigation system is informed of the position in the reference system of the navigation system, determining the position is referred to as calibration.
[0065] For example, the present invention does not involve or specifically include or encompass invasive procedures that would represent a substantial physical disturbance of the body, require specialized medical experience to perform, and would present substantial health risks even when performed with the required specialized care and expertise. For example, the present invention does not include the steps of positioning a medical implant to secure a medical implant to an anatomical structure, or securing a medical implant to an anatomical structure, or preparing an anatomical structure for securing a medical implant thereto. More specifically, the present invention does not involve or specifically include or encompass any surgical or therapeutic activity.
[0066] The preferred embodiments will be described in more detail below.
[0067] According to another exemplary embodiment of the invention, the step of determining the position of at least one surface point comprises determining a spatial position and / or orientation of the registration device relative to the subject and determining a distance between the registration device and a surface point of the subject.
[0068] In a preferred embodiment, the spatial position and / or orientation of the registration device is determined with 5 or 6 degrees of freedom.Preferably, the tracking device determines the spatial position and / or orientation of the registration device relative to the subject.
[0069] Preferably, the tracking system is configured to determine the spatial position and / or orientation of the registration device and the subject, thereby determining the relationship between the spatial position and / or orientation of the registration device and the subject. In other words, a reference point is determined, relative to which the spatial position and / or orientation of the registration device and the subject is determined. Therefore, the spatial position and / or orientation of the registration device with respect to the subject can be determined. The tracking system preferably includes all components necessary for tracking the registration device and the subject.
[0070] Thus, the acquisition of the surface geometry of the subject may be improved.
[0071] According to another exemplary embodiment of the present invention, the method comprises the step of identifying a tissue type of the subject, comprising determining a property measurement of the subject, and comparing the determined property measurement of the subject with predetermined property values associated with different tissue types.
[0072] The term "property measurement" refers to different characteristics of a subject that can be measured.
[0073] Thus, the acquisition of the surface geometry of the subject may be improved.
[0074] According to another exemplary embodiment of the present invention, the property measurement comprises radiation attenuation, color, spectral absorption, Raman spectroscopy and / or fluorescence.
[0075] Preferably, the color relates to the original color of the object, such as skin color or hair color. In addition, for example, green or blue are uncommon for human body surfaces, but are common for drapes used in medical technology. Thus, the color of a subject at a specific surface point can lead to the tissue type of the subject.
[0076] The characteristic measurement is preferably measured by a tissue type identification unit, which preferably also comprises a characteristic measurement unit configured to measure the characteristic measurement of the subject. The characteristic measurement unit preferably comprises: a camera (particularly for measuring color), a radiation detector (particularly for measuring the attenuation of radiation), a spectrometer (particularly for measuring spectral absorption), a Raman spectrometer (particularly for measuring Raman spectra), and / or a photometer (particularly for measuring fluorescence).
[0077] Thus, the acquisition of the surface geometry of the subject may be improved.
[0078] According to another exemplary embodiment of the present invention, the method comprises the following steps: determining at least one surface point of the subject, and for each surface point simultaneously performing identification of a tissue type of the subject at the at least one determined surface point.
[0079] Therefore, the step of associating tissue types to corresponding surface points is not required.
[0080] Thereby, the acquisition of the surface geometry of the subject may be simplified and thus improved.
[0081] According to another exemplary embodiment of the present invention, the method comprises the step of determining the position of at least one surface point of the subject by using a contactless tracking device.
[0082] Thus, the acquisition of the surface geometry of the subject may be improved.
[0083] According to another exemplary embodiment of the present invention, the method comprises the step of determining at least one surface point of the subject by using an optical tracking device.
[0084] Thus, the acquisition of the surface geometry of the subject may be improved.
[0085] According to another exemplary embodiment of the present invention, the method comprises the step of determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom by using at least one optical marker of the optical tracking device.
[0086] Preferably, the tracking device is a component of the registration device for tracking the registration device.
[0087] In a preferred embodiment, the method comprises the following steps: providing a light beam by an optical light source of an optical tracking system, reflecting the light beam at at least one light reflecting optical marker arranged at least at a registration device, and determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom based on the reflected light beam.
[0088] Preferably, the light beam is an infrared light beam.
[0089] Preferably, at least one optical marker is arranged at the registration device and at the subject, respectively.
[0090] Preferably, the optical light source defines a reference point relative to which the spatial position and / or orientation of the registration device and the subject is determined.
[0091] Thus, the acquisition of the surface geometry of the subject may be improved.
[0092] According to another exemplary embodiment of the invention, the method comprises the step of determining the position of at least one surface point of the subject by using an electromagnetic tracking device.
[0093] The tracking device is, for example, an electromagnetic tracking device comprising at least one electromagnetic sensor (in particular a coil and / or a chip) for tracking. Preferably, the electromagnetic sensor is arranged in the tracking device at an angle to the other sensors of the tracking device. In contrast to optical tracking, electromagnetic tracking does not rely on a visual connection to the subject. Therefore, electromagnetic tracking is particularly preferred for tracking of subjects in a prone position and / or the end of flexible instruments. This also applies if the subject is covered, in particular covered by a draft or when the subject is stained with blood.
[0094] Thus, the acquisition of the surface geometry of the subject may be improved.
[0095] According to another exemplary embodiment of the invention, the method comprises the step of determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom by using at least one electromagnetic sensor of the electromagnetic device, in particular a coil or a chip.
[0096] In a preferred embodiment, the method comprises the steps of providing a time-varying electromagnetic field by an electromagnetic field generator of an electromagnetic tracking system, and determining a spatial position and / or orientation of a registration device relative to a subject with at least 5 degrees of freedom based on the electromagnetic field. Preferably, the electromagnetic sensor is configured to detect changes in the electromagnetic field over time. For example, if the electromagnetic sensor comprises at least one coil, the time-varying electromagnetic field induces a time-varying current into the coil.
[0097] Preferably, at least one electromagnetic sensor is arranged at the registration device and at the subject, respectively.
[0098] Preferably, the electromagnetic field generator defines a reference point to which the spatial position and / or orientation of the registration device and the subject is determined.
[0099] Thus, the acquisition of the surface geometry of the subject may be improved.
[0100] According to another exemplary embodiment of the invention, the method comprises the step of determining the position of at least one surface point of the subject by using a magnetic tracking device.
[0101] Thus, the acquisition of the surface geometry of the subject may be improved.
[0102] According to another exemplary embodiment of the invention, the method comprises the step of determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom by using at least one magnetic sensor of the magnetic tracking device.
[0103] In a preferred embodiment, the method comprises the steps of providing a time-varying magnetic field by a magnetic field generator of a magnetic tracking system, and determining a spatial position and / or orientation of a registration device relative to a subject with at least 5 degrees of freedom based on the magnetic field. Preferably, the magnetic sensor is configured to detect changes in the magnetic field over time.
[0104] Preferably, the magnetic field generator comprises a permanent magnet and is configured to rotate the permanent magnet simultaneously around a first rotation axis and a second rotation axis to generate a time-varying magnetic field. The second rotation axis intersects the first rotation axis at an intersection offset from the center of mass of the permanent magnet.
[0105] Preferably, the magnetic sensor comprises a giant magnetoresistive sensor, an anisotropic magnetoresistive sensor or a Hall effect sensor.
[0106] Preferably, at least one magnetic sensor is arranged at the registration device and at the subject, respectively.
[0107] Preferably, the magnetic field generator defines a reference point to which the spatial position and / or orientation of the registration device and the subject is determined.
[0108] Thus, the acquisition of the surface geometry of the subject may be improved.
[0109] According to another exemplary embodiment of the present invention, the method comprises the step of determining the position of at least one surface point of the subject by using a video-based tracking device.
[0110] Thus, the acquisition of the surface geometry of the subject may be improved.
[0111] According to another exemplary embodiment of the present invention, the method comprises the step of determining the spatial position and / or orientation of the registration device relative to the subject in at least 5 degrees of freedom by using at least one video marker of the video based tracking device.
[0112] In a preferred embodiment, the method comprises the following steps: identifying video markers arranged at least at the registration device by a camera of a video-based tracking system, and determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom based on the video markers.
[0113] Preferably, the video marker is a barcode or a QR code.
[0114] Preferably, at least one video marker is arranged at the registration device and at the subject, respectively.
[0115] Preferably, the camera defines a reference point to which the spatial position and / or orientation of the registration device and the subject are determined.
[0116] Thus, the acquisition of the surface geometry of the subject may be improved.
[0117] According to another exemplary embodiment of the present invention, the method comprises the following step: performing surface matching registration based on the accepted relevant surface points, thereby registering the subject to the medical navigation device.
[0118] In a preferred embodiment, the medical navigation device has stored virtual image data of the subject, with which the relevant surface points are matched for surface matching registration. In addition, the medical navigation device has stored virtual image data of the registration device that is consistent with the tracked registration device. Therefore, if the matching is performed perfectly, the arrangement of the registration device to the subject in reality is consistent with the arrangement of the virtual image of the registration device to the virtual image of the subject.
[0119] Preferably, the surface matching registration is performed when a predetermined amount of relevant surface points have been accepted.
[0120] Thus, the acquisition of the surface geometry of the subject may be improved.
[0121] According to another exemplary embodiment of the invention, the method comprises the step of verifying the surface matching registration by comparing the real position of the registration device in the view of the subject with the virtual position of a virtual representation of the registration device in the view of the subject's image dataset.
[0122] In a preferred embodiment, the verification step is performed by a medical professional, such as a surgeon.
[0123] In a preferred embodiment, easily inspectable control points are used for verification. For example, the user compares the real position of the tip of the registration device (particularly the tip of a pen-shaped contact-based tracking device) relative to the subject with the virtual position of the tip of a virtual representation of the registration device (particularly the tip of a pen-shaped contact-based tracking device) relative to the subject's image dataset.
[0124] The image dataset of the subject is preferably a digital model of the subject, and further preferably the sampling method is predetermined.
[0125] The position of the registration device in real life is related to the position of the registration device compared to the physical anatomy of the subject, particularly the patient.
[0126] It should be clear that it is not necessary to acquire a specific surface point of the subject at a specific location (eg, the end of a registration device).
[0127] According to another exemplary embodiment of the present invention, the method comprises the step of determining the position of at least one surface point of the subject by using a contact-based tracking device.
[0128] Preferably, the contact-based tracking device extends from the registration device in the form of a pen, the contact-based tracking device having a distal end for contacting a surface of the subject.
[0129] In a preferred embodiment, contact-based position determination is preferably used to determine further surface points. Thus, surface points can be determined by contact-based position determination, which can hardly or not be determined at all by contactless position determination. For example, the position of the surface of the head can be determined relatively easily by contactless position determination. However, if parts of the head are covered with hair, contactless position determination may be unsuitable. In this case, contact-based position determination can be used to determine such surface points.
[0130] Preferably, the contact-based tracking device itself is capable of determining the tissue type of the subject at different surface points when in contact with the subject. For example, the contact-based tracking device may differentiate between bone and skin when in contact with the subject.
[0131] Thus, the acquisition of the surface geometry of the subject may be improved.
[0132] According to another exemplary embodiment of the present invention, the method comprises the following steps: switching between determining the position of at least one surface point using a contact-based tracking device and determining the position of at least one surface point using a contactless tracking device based on the determined distance between the registration device and the surface point of the subject.
[0133] In other words, contact-based position determination is automatically used when the registration device is in contact with a surface point.To prevent accidental contact-based position determination, the contact-based tracking device preferably needs to be within a predetermined distance from the subject for a predetermined time before contact-based position determination is activated.
[0134] Preferably, contact of the contact-based tracking device with the surface of the subject is detected by a contact sensor. If the contact sensor detects contact of the contact-based tracking device with the surface of the subject (particularly by detecting skin contact), determination of at least one surface point of the subject is triggered.
[0135] Thus, the acquisition of the surface geometry of the subject may be improved.
[0136] According to another aspect, a configuration device for registering a subject of a medical navigation system is provided. The registration device comprises: a tissue type identification unit configured to identify a tissue type of the subject at at least one surface point and a control device configured to determine a position of at least one surface point of the subject, thereby determining a surface registration type for an intended procedure on the subject according to the intended procedure, wherein the surface registration type comprises at least one relevant tissue type of at least a portion of the subject, and verifying at least one surface point according to the identified tissue type and the determined surface registration type of the intended procedure, thereby determining a position of at least one relevant surface point and / or at least one non-relevant surface point, wherein at least one relevant surface point is accepted and at least one non-relevant surface point is discarded.
[0137] The tissue type identification unit may alternatively be configured only to collect information about the tissue type, while the additional external unit is configured for identifying the tissue type based on the information collected by the tissue type identification unit.
[0138] Alternatively, the spatial position and / or orientation of the registration device may be determined by the robotic system.If a proximity sensor is attached to the distal end of the robotic actuator, the spatial position and / or orientation may be derived from the pose of the robotic system.
[0139] For example, the configuration device is implemented as a handheld device. In other examples, the registration device is implemented as an endoscope.
[0140] Preferably, the proximity sensor is a laser triangulation sensor.
[0141] Thus, the acquisition of the surface geometry of the subject may be improved.
[0142] According to another exemplary embodiment of the present invention, the registration device comprises: a tracking device configured to determine a spatial position and / or orientation of the registration device relative to the subject; and a proximity sensor configured to determine a distance between the registration device and at least one surface point of the subject. The control device is configured to determine the position of at least one surface point of the subject based on the determined spatial position and / or orientation and / or distance.
[0143] Preferably, the spatial position of the proximity sensor to the tracking device is known.
[0144] According to another exemplary embodiment of the present invention, the tracking device comprises a contactless tracking device configured for determining a position of at least one surface point of the subject.
[0145] Thus, the acquisition of the surface geometry of the subject may be improved.
[0146] According to another exemplary embodiment of the present invention, the tracking device comprises an optical tracking device.
[0147] Thus, the acquisition of the surface geometry of the subject may be improved.
[0148] According to another exemplary embodiment of the present invention, the optical tracking device comprises at least one optical marker configured for determining the spatial position and / or orientation of the registration device relative to the subject in at least 5 degrees of freedom.
[0149] Preferably, the optical tracking system comprises: an optical light source configured to provide a light beam; and at least one light reflecting marker, which is arranged at least at the patient and configured to reflect the light beam of the optical light source. Thus, at least one optical sensor is configured to determine the spatial position and / or orientation of the registration device relative to the subject based on the reflected light beam.
[0150] Thus, the acquisition of the surface geometry of the subject may be improved.
[0151] According to another exemplary embodiment of the present invention, the tracking device comprises an electromagnetic tracking device.
[0152] Thus, the acquisition of the surface geometry of the subject may be improved.
[0153] According to another exemplary embodiment of the present invention, the electromagnetic tracking device comprises at least one electromagnetic sensor configured for determining the spatial position and / or orientation of the registration device relative to the subject in at least 5 degrees of freedom.
[0154] Preferably, the electromagnetic tracking system comprises an electromagnetic field generator configured to generate a time-varying electromagnetic field.Therefore, at least one electromagnetic sensor (preferably an electromagnetic sensor array) is configured to determine the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom based on the electromagnetic field.
[0155] Thus, the acquisition of the surface geometry of the subject may be improved.
[0156] According to another exemplary embodiment of the invention, the tracking device comprises a magnetic tracking device.
[0157] Thus, the acquisition of the surface geometry of the subject may be improved.
[0158] According to another exemplary embodiment of the invention, the magnetic tracking device comprises at least one magnetic sensor (preferably a magnetic sensor array) configured for determining the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom.
[0159] Preferably, the magnetic tracking system comprises a magnetic field generator configured for generating a time-varying magnetic field.Thereby, the at least one magnetic sensor is configured for determining the spatial position and / or orientation of the registration device relative to the subject in at least 5 degrees of freedom based on the magnetic field.
[0160] Preferably, the magnetic field generator comprises a permanent magnet and is configured to rotate the permanent magnet simultaneously around a first rotation axis and a second rotation axis. The second rotation axis intersects the first rotation axis at an intersection offset from the center of mass of the permanent magnet.
[0161] Thus, the acquisition of the surface geometry of the subject may be improved.
[0162] According to another exemplary embodiment of the present invention, the tracking device comprises a video-based tracking device.
[0163] Thus, the acquisition of the surface geometry of the subject may be improved.
[0164] According to another exemplary embodiment of the present invention, the video-based tracking device comprises at least one video sensor configured for determining a spatial position and / or orientation of the registration device relative to the subject in at least 5 degrees of freedom.
[0165] Preferably, the video-based tracking system comprises at least one scannable marker arranged at the registration device.Therefore, at least one video sensor is configured to determine the spatial position and / or orientation of the registration device relative to the subject with at least 5 degrees of freedom based on the scannable marker.
[0166] Thus, the acquisition of the surface geometry of the subject may be improved.
[0167] According to another exemplary embodiment of the invention, the electromagnetic tracking device comprises at least one sensor, in particular a coil and / or a chip, configured for determining the spatial position of the registration device relative to the subject in at least 5 degrees of freedom.
[0168] Thus, the acquisition of the surface geometry of the subject may be improved.
[0169] According to another exemplary embodiment of the present invention, the tracking device comprises a contact-based tracking device, preferably an indicator, further preferably the tracking device comprises in addition to the contactless tracking device a contact-based tracking device, the contact-based tracking device being configured for determining the position of at least one surface point of the subject.
[0170] The contact-based tracking device preferably comprises a soft contact.
[0171] In a preferred embodiment, the contact-based tracking device is configured for identifying a tissue type of the determined at least one surface point.
[0172] Therefore, a tracking and registration device is provided, which has means for contactless tracking and contact-based tracking.
[0173] Thus, the acquisition of the surface geometry of the subject may be improved.
[0174] According to a further exemplary embodiment of the invention, the control device is configured for verifying the surface matching registration by comparing a real position of the registration device relative to the subject with a virtual position of a virtual representation of the registration device relative to the image dataset of the subject.
[0175] Preferably, the surface matching registration is automatically verified. Preferably, after the matching process is completed, the subject is brought into contact with the contact-based tracking device for verification. In one embodiment, the verification of the surface matching registration is based on the measured pressure applied to the end of the contact-based tracking device. In the case where the virtual representation of the registration device meets the virtual position of the image data set of the subject at the contact point, the pressure applied to the end of the contact-based tracking device is determined. It is expected that when the surface matching registration is accurate, the end of the contact-based tracking device is in contact with the subject. Therefore, a small force or pressure should be measurable at the end of the contact-based tracking device.
[0176] Therefore, the measured pressure applied to the end of the contact-based tracking device is compared with a predetermined force range, preferably with a lower boundary of zero. If it is determined that no force is applied to the end of the contact-based tracking device, or in other words, the contact-based tracking device is not in contact with the subject in real life, the surface matching registration is automatically not verified. If it is determined that a force greater than the force range is applied to the end of the contact-based tracking device, or in other words, the contact-based tracking device is not only in contact with the subject, but also presses against the subject's skin in real life, the surface matching registration is not verified. However, verification is preferably required. Therefore, if it is determined that the force measured at the end of the contact-based tracking device is within the predetermined force range, the surface matching registration is automatically verified.
[0177] In other words, the control device is configured to: determine a force applied to the end of the contact-based tracking device; determine that a virtual position of a virtual representation of a registration device relative to an image dataset of a subject meets at a contact point; compare the force applied to the end of the contact-based tracking device to a predetermined force range; and verify surface matching registration if the determined force is within the force range, and not verify surface matching registration if the determined force is not within the force range.
[0178] Furthermore, the control device preferably checks a predetermined minimum amount of time for which the registration device is held in the position to be verified and a predetermined minimum amount of comparison contact points before verifying or not verifying the surface matching registration.
[0179] Alternatively, a medical professional (such as a surgeon) verifies the surface matching registration. In this case, it is also preferred that the registration device only allows manual verification by the medical professional if it is determined that the contact-based tracking device is in contact with the subject in real life, for example by determining that a force is applied to the end of the contact-based tracking device as a result of keeping the contact-based tracking device in contact with the subject in real life.
[0180] Thus, the acquisition of the surface geometry of the subject may be improved.
[0181] According to another exemplary embodiment of the present invention, the control device is configured for performing a surface matching registration based on the accepted relevant surface points, thereby registering the subject with the medical navigation device.
[0182] Thus, the acquisition of the surface geometry of the subject may be improved.
[0183] According to another exemplary embodiment of the present invention, the control unit is configured to: switch between determining the position of at least one surface point using a contact-based tracking device and determining the position of at least one surface point using a contactless tracking device, depending on the determined distance between the registration device and the surface point of the subject.
[0184] Thus, the acquisition of the surface geometry of the subject may be improved.
[0185] According to another aspect of the present invention, there is provided a surgical navigation system for computer-assisted surgery, the system comprising a registration device as described herein.
[0186] According to the present disclosure, a computer program is provided, which, when the computer program is run on a computer or loaded into a computer, causes the computer to perform the method steps of the method as described herein. In addition, a program storage medium having the program stored thereon is provided. In addition, a computer comprising at least one processor and a memory and / or a program storage medium is provided, wherein the program is run on the computer or loaded into the memory of the computer. A signal wave or a digital signal wave carrying information representing the program is provided. A data stream representing the program is provided.
[0187] For example, the program mentioned above, the program for example includes a code device suitable for executing any or all steps in the steps of the method according to the first aspect. The computer program stored on the disk is a data file, and when the file is read and sent, the file becomes a data stream in the form of a (physical, such as electrical, such as technically generated) signal. The signal can be implemented as a signal wave described herein. For example, the signal (such as a signal wave) is constructed to be transmitted via a computer network (such as a LAN, WLAN, WAN, such as the Internet). Therefore, the present invention according to the second aspect may alternatively or additionally relate to a data stream representing the program mentioned above.
[0188] In another aspect, the present invention relates to a non-transitory computer readable program storage medium having stored thereon a program as described herein. BRIEF DESCRIPTION OF THE DRAWINGS
[0189] In the following, the present invention is described with reference to the accompanying drawings, which give a background description and show specific embodiments of the present invention. However, the scope of the present invention is not limited to the specific features disclosed in the context of the accompanying drawings, in which
[0190] Figure 1 A flow chart schematically illustrates an embodiment of the method of the present invention;
[0191] Figure 2 schematically shows a registration device arranged in front of a subject;
[0192] Figure 3 schematically shows a virtual representation of a registration device arranged in front of an image dataset of a subject;
[0193] Figure 4A flow chart schematically showing an embodiment of the method of the present invention; and
[0194] Figure 5 A registration device is schematically shown. DETAILED DESCRIPTION
[0195] Figure 1 Schematically shows a flow chart of an embodiment of a method for sampling relevant surface points of a subject 20 of a medical navigation system. In step Z1, a surface registration type R for an intended procedure P is determined based on the intended procedure P of the subject. For example, the intended procedure P is a neurosurgery. Therefore, the surface registration type R is determined as a face registration.
[0196] In step Z2, the user, in particular a medical professional, aims the registration device 10 for registering the subject 20 at the subject 20. In this case, the subject 20 is the anatomical structure of the patient. At the beginning, a contactless point acquisition process is performed to determine the positions of a plurality of surface points 21, 22 of the subject 20. The determination of the surface points 21, 22 is performed, for example, by continuous measurement, preferably as long as the user presses a button on the registration device 10. The measurement process determines a plurality of frames of the subject 20.
[0197] In step Z3, for each determined frame, the following measurements are performed. First, the spatial position X and / or orientation O of the registration device 10 relative to the subject 20 is determined. Preferably, the spatial position X and / or orientation O is determined with 5 to 6 degrees of freedom. Secondly, the distance d between the registration device 10 and the measured surface points 21, 22 on the subject 20 is determined. Thirdly, a measurable characteristic (referred to as a characteristic measurement) of the subject surface (in particular, each measured surface point 21, 22) is determined. For example, the color of the subject 20 at a specific surface point 21, 22 is such a characteristic measurement. In this case, the measurable characteristic is measured by a camera device (not shown).
[0198] In step Z4 , the surface points 21 , 22 (in particular surface coordinates) are calculated by combining the spatial position X and / or orientation O of the registration device 10 with the distance d from the registration device 10 to the subject 20 .
[0199] In step Z5, a tissue type T of the surface of the subject is determined for each of the measured surface points 21, 22 based on the determined characteristic measurement. For example, if the measured surface point 21, 22 is associated with a characteristic measurement of green, the identified tissue type T is a surgical drape. Such an association is preferably performed based on comparing the value of the measured characteristic measurement with the value of a characteristic measurement that is known to be stored in association.
[0200] In step Z6 , the surface points 21 , 22 are linked to a tissue type T determined on the basis of the property measurements associated with the surface points 21 , 22 .
[0201] In step Z7, the surface points 21, 22 are verified. Depending on the intended procedure P (in particular the determined registration type R), non-relevant surface points 22 that are considered to be irrelevant to the intended procedure P are discarded, and relevant surface points that are considered to be relevant to the intended procedure P are accepted. For example, in case the intended procedure P is neurosurgery, the surface registration type R is determined to be facial registration. Therefore, the relevant tissue type is skin. Based on the colors of the measured surface points 21, 22, one of the surface points 21, 22 with skin color is associated with the tissue type skin and is therefore determined to be the relevant surface point 21. The other of the surface points 21, 22 is associated with brown. Therefore, the tissue type T of the surface point is determined to be hair that is irrelevant to the intended procedure P. Such a surface point is considered to be a non-relevant surface point 22 and is discarded.
[0202] In step Z8, it is determined whether further surface points 21, 22 are needed to better acquire the subject 20. If more surface points 21, 22 are needed, the method jumps to step Z9. Otherwise, the method jumps to step Z10.
[0203] In step Z9, additional surface points 21, 22 are acquired by means of contact-based point acquisition. In this case, areas of the patient's face covered by hair can be circumvented by contact-based point acquisition and thus determined directly. The measurement of the surface points 21, 22 is triggered manually, for example by pressing a button on the registration device 10 and / or automatically by tissue contact.
[0204] In step Z10, a surface matching registration is performed to register the subject 20 with the medical navigation device. The medical navigation device has stored an image dataset 40 of the subject 20 as a virtual representation of the subject 20. This image dataset 40 is matched to the measured relevant surface points 21. Thus, the registration device 10 tracked by the tracking device 11a, 11b is matched to the virtual representation 30 of the registration device.
[0205] In step Z11, the surface matching registration is verified. The position of the registration device 10 is compared with the position of the virtual representation 30 of the registration device relative to the image data set 40. For example, the end 12 of the registration device 10 is held against the tip of the nose of the subject 20. Ideally, the virtual representation 30 of the registration device is in contact with the tip of the nose in the image data set 40. The user can then determine whether the matching process is accurate enough for the intended process P.
[0206] Figure 2The registration device 10 is schematically shown arranged in front of a subject 20. The subject 20 is a head 23 of a patient having hair 24. The head 23 of the subject 20 should be sampled for a medical navigation system.
[0207] Therefore, a registration device 10 is used. The registration device 10 comprises a tracking device 11, a proximity sensor 13, a control device (not shown) and a tissue type identification unit (not shown).
[0208] The tracking device 11 comprises a contactless tracking device 11a, which in this case is an electromagnetic tracking device with at least one coil C1, and a contact-based tracking device 11b, which in this case is a pen-shaped pointer with at least one coil C2. The coils C1, C2 allow five-point free tracking, in other words, the determination of the spatial position X and / or orientation O of the registration device 10. The contact-based tracking device 11b comprises a tip 12.
[0209] The proximity sensor 13 comprises a laser 13 a and a CCD sensor 13 b and is configured to determine a distance d between the registration device 10 and different surface points 21 , 22 of the subject 20 .
[0210] It can be seen that the surface points associated with the hair 24 can be considered as non-relevant surface points 22 and should not be considered during sampling of the relevant surface of the subject 20. On the other hand, the surface points associated with the head 23 should be considered as relevant surface points 21 and should be considered during sampling of the relevant surface of the subject 20.
[0211] Figure 3 Schematically, a virtual representation 30 of a registration device 10 is shown arranged in front of an image dataset 40 of a subject 20. The representation is consistent with the data stored in the medical navigation system. Compared to a real subject 20 with a head 23 and hair 24, the image dataset 40 of the subject 20 only comprises information relevant to the intended process P (in this case the head 23). Ideally, the sampling of the subject 20 only comprises relevant surface points 21 of the subject 20. Thus, the accuracy of the surface matching registration can be improved.
[0212] To verify the surface matching registration, the position of the tip 32 of the representation 30 of the registration device 10 compared to the position of the stored image dataset 40 should be consistent with the position of the tip 12 of the registration device 10 compared to the position of the subject 20 .
[0213] Figure 4A flow chart of a method for sampling relevant surface points of a subject 20 for a medical navigation system is schematically shown. The method comprises a step S1 for determining a surface registration type for an expected procedure on a subject according to the expected procedure, wherein the surface registration type comprises at least one relevant tissue type of at least part of the subject. In step S2, at least one surface point 21, 22 of the subject 20 is determined using a registration device 10. Next, in step S3, the tissue type of the subject 20 is identified at the determined at least one surface point 21, 22. In step S4, the at least one surface point 21, 22 is verified according to the identified tissue type and the determined surface registration type of the expected procedure, thereby determining the position of at least one relevant surface point 21 and / or at least one non-relevant surface point 22, wherein at least one relevant surface point 21 is accepted and at least one non-relevant surface point 22 is discarded.
[0214] Figure 5 Schematically shown is a registration device 10. The registration device 10 for registering a subject 20 of a medical navigation system comprises a tracking device 11, a proximity sensor 13, a tissue type identification unit 14 and a control device 15.
[0215] The tracking device 11 is configured for determining a spatial position X and / or an orientation O of the registration device relative to the subject 20, and is configured for providing the spatial position X and / or the orientation O to the control device 15. The proximity sensor 13 is configured for determining a distance d between the registration device 10 and at least one surface point 21, 22 of the subject 20, and is configured for providing the distance d to the control device 15. The tissue type identification unit 14 is configured for identifying a tissue type T of the subject 20 at at least one surface point 21, 22, and is configured for providing the tissue type T to the control device 15. In addition, the control device 15 is provided with an intended procedure P, in other words, an intervention is planned to be performed on the subject 20 and medical navigation is required for it.
[0216] The control device 15 is configured to: determine the position of at least one surface point 21, 22 of the subject 20 based on the determined spatial position X and / or orientation O and / or distance d, determine the surface registration type R for the expected process P on the subject 20 based on the expected process P (wherein the surface registration type R includes at least one relevant tissue type of at least a portion of the subject 20), and verify at least one surface point 21, 22 based on the identified tissue type T and the determined surface registration type R of the expected process P, thereby determining the position of at least one relevant surface point 21 and / or at least one non-relevant surface point 22, wherein at least one relevant surface point 21 is accepted and at least one non-relevant surface point 22 is discarded.
[0217] The control device 15 preferably comprises a determination unit 15a and a decision unit 15b. The determination unit 15a is configured to determine at least one surface point 21, 22 of the subject 20 according to the determined spatial position X and / or orientation O and / or distance d, and to determine a surface registration type R for the expected process P according to the expected process P of the subject 20. Therefore, the determination unit 15a provides the tissue type T, the at least one surface point 21, 22 and the registration type R to the decision unit 15b. The decision unit 15b is configured to verify the at least one surface point 21, 22 according to the identified tissue type T and the determined surface registration type R of the expected process P, thereby determining the position of at least one relevant surface point 21 and / or at least one non-relevant surface point 22, wherein at least one relevant surface point 21 is accepted and at least one non-relevant surface point 22 is discarded.
Claims
1. A method for sampling relevant surface points of a subject (20) for a medical navigation system, the method comprising the following steps: determining a surface registration type for the expected procedure (P) based on the expected procedure (P) of the subject (20), wherein the surface registration type includes at least one relevant tissue type of at least a portion of the subject (20); determining the position of at least one surface point (21, 22) of the subject (20) using a registration device (10); identifying a tissue type of the subject (20) at at least one determined surface point (21, 22); and The at least one surface point (21, 22) is verified based on the identified tissue type and the determined surface registration type of the intended process (P), thereby determining the position of at least one relevant surface point (21) and / or at least one non-relevant surface point (22), wherein the at least one relevant surface point (21) is accepted and the at least one non-relevant surface point (22) is discarded.
2. The method according to claim 1, wherein Determining the position of the at least one surface point (21, 22) comprises: The spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) is determined, and the distance (d) between the registration device (10) and the surface point (21, 22) of the subject (20) is determined.
3. The method according to any one of claims 1 or 2, wherein Identifying the tissue type of the subject (20) comprises: A property measurement of the subject (20) is determined and the determined property measurement of the subject (20) is compared to predetermined property values associated with different tissue types.
4. The method according to claim 3, wherein The property measurements include radiation attenuation, color, spectral absorption, Raman spectroscopy and / or fluorescence.
5. The method according to claim 1 or 2, wherein For each surface point (21, 22), the following are simultaneously performed: determining the position of at least one surface point (21, 22) of the subject (20) and identifying the tissue type of the subject (20) at the determined at least one surface point (21, 22).
6. The method according to claim 1 or 2, comprising the following steps: The position of the at least one surface point (21, 22) of the subject (20) is determined by using a contactless tracking device (11a).
7. The method according to claim 6, comprising the steps of: The position of the at least one surface point (21, 22) of the subject (20) is determined by using an optical tracking device.
8. The method according to claim 7, comprising the steps of: By using at least one optical marker of the optical tracking device, the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) is determined with at least 5 degrees of freedom.
9. The method according to claim 6, comprising the steps of: The position of the at least one surface point (21, 22) of the subject (20) is determined by using an electromagnetic tracking device.
10. The method according to claim 9, comprising the steps of: By using at least one electromagnetic sensor of the electromagnetic tracking device, the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) is determined with at least five degrees of freedom.
11. The method according to claim 10, wherein: The electromagnetic sensor is a coil or a chip.
12. The method according to claim 6, comprising the steps of: The position of the at least one surface point (21, 22) of the subject (20) is determined by using a magnetic tracking device.
13. The method according to claim 12, comprising the steps of: By using at least one magnetic sensor of the magnetic tracking device, the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) is determined with at least five degrees of freedom.
14. The method according to claim 13, wherein: The magnetic sensor is a chip.
15. The method according to claim 6, comprising the steps of: The position of the at least one surface point (21, 22) of the subject (20) is determined by using a video-based tracking device.
16. The method according to claim 15, comprising the steps of: The spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) is determined with at least five degrees of freedom by using at least one video marker of the video-based tracking device.
17. The method according to claim 1 or 2, comprising the steps of: Surface matching registration is performed based on the accepted relevant surface points (21) to register the subject (20) with the medical navigation device.
18. The method according to claim 17, comprising the steps of: The surface matching registration is verified by comparing the real position of the registration device (10) relative to the subject (20) with the virtual position of the virtual representation (30) of the registration device (10) relative to an image dataset (40) of the subject (20).
19. The method according to claim 1 or 2, comprising the steps of: The position of the at least one surface point (21, 22) of the subject (20) is determined by using a contact-based tracking device (11b).
20. The method according to claim 2, comprising the steps of: Based on a determined distance (d) between the registration device (10) and a surface point (21, 22) of the subject (20), switching is performed between determining the position of the at least one surface point (21, 22) using a contact-based tracking device (11b) and determining the position of the at least one surface point (21, 22) using a contactless tracking device (11a).
21. A registration device (10) for registering a subject (20) of a medical navigation system, comprising: a tracking device (11) configured to determine a spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20); a proximity sensor (13) configured to determine a distance (d) between the registration device (10) and at least one surface point (21, 22) of the subject (20); a tissue type identification unit (14) configured to identify a tissue type (T) of the subject (20) at the at least one surface point (21, 22); as well as A control device (15) is configured to: determine the position of at least one surface point (21, 22) of the subject (20) based on the determined spatial position (X) and / or orientation (O) and / or distance (d); determine a surface registration type (R) for the expected process (P) based on the expected process (P) of the subject (20), wherein the surface registration type (R) includes at least one relevant tissue type of at least part of the subject (20); and verify the at least one surface point (21, 22) based on the identified tissue type (T) and the determined surface registration type (R) of the expected process (P), thereby determining the position of at least one relevant surface point (21) and / or at least one non-relevant surface point (22), wherein the at least one relevant surface point (21) is accepted and the at least one non-relevant surface point (22) is discarded.
22. The registration device of claim 21, wherein The tracking device (11) comprises a contactless tracking device (11a) configured to determine the position of the at least one surface point (21, 22) of the subject.
23. The registration device of claim 22, wherein The contactless tracking device comprises an optical tracking device configured to determine the position of the at least one surface point (21, 22) of the subject (20).
24. The registration device of claim 23, wherein The optical tracking device comprises: At least one optical marker is configured to determine the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) with at least 5 degrees of freedom.
25. The registration device of claim 22, wherein The tracking device comprises an electromagnetic tracking device configured to determine the position of the at least one surface point (21, 22) of the subject (20).
26. The registration device of claim 25, wherein The electromagnetic tracking device comprises: At least one electromagnetic sensor is configured to determine the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) with at least five degrees of freedom.
27. The registration device according to claim 26, wherein: The electromagnetic sensor is a coil or a chip.
28. The registration device of claim 22, wherein The tracking device comprises a magnetic tracking device configured to determine the position of the at least one surface point (21, 22) of the subject (20).
29. The registration device of claim 28, wherein The magnetic tracking device comprises At least one magnetic sensor is configured to determine the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) with at least 5 degrees of freedom.
30. The registration device according to claim 29, wherein: The magnetic sensor is a chip.
31. The registration device of claim 22, wherein The tracking device comprises a video-based tracking device configured to determine the position of the at least one surface point (21, 22) of the subject (20).
32. The registration device of claim 31, wherein The video-based tracking device includes: At least one video marker is configured to determine the spatial position (X) and / or orientation (O) of the registration device (10) relative to the subject (20) with at least 5 degrees of freedom.
33. A registration device according to any one of claims 21 to 32, wherein The tracking device (11) comprises a contact-based tracking device (11b) configured to determine the position of the at least one surface point (21, 22) of the subject (20).
34. A registration device according to any one of claims 21 to 32, wherein The control device (15) is configured to verify the surface matching registration by comparing the real position of the registration device (10) relative to the subject (20) with the virtual position of the virtual representation (30) of the registration device (10) relative to the image data set (40) of the subject (20).
35. A registration device according to any one of claims 21 to 32, wherein The control device (15) is configured to perform surface matching registration based on the accepted relevant surface points (21) to register the subject (20) with the medical navigation device.
36. A registration device according to any one of claims 21 to 32, wherein The control device (15) is configured to switch between determining the position of at least one surface point (21, 22) using a contact-based tracking device (11b) and determining the position of at least one surface point (21, 22) using a contactless tracking device (11a) based on a determined distance (d) between the registration device (10) and a surface point (21, 22) of the subject (20).
37. A surgical navigation system for computer-assisted surgery, the surgical navigation system comprising a registration device according to any one of claims 21 to 36.
38. A computer program product comprising a computer program which, when run on or loaded onto a computer, causes the computer to perform the steps of the method according to any one of claims 1 to 20; and / or a program storage medium on which the computer program is stored; and / or a computer comprising at least one of a memory and the program storage medium and at least one processor, wherein: The computer program is run on a computer or loaded into a memory of the computer; and / or a signal wave carrying information representing said computer program; and / or a data flow representing the computer program.
Citation Information
Patent Citations
Registration of a magnetic tracking system with an imaging device
CN107918925A
Optical sampling of surface points for medical navigation
US20150150645A1
Method for assisting the positioning of a medical structure on the basis of two-dimensional image data
US20170193674A1
Robotic navigation of robotic surgical systems
US20180200002A1
Method and System for Registering a Patient with a 3D Image Using a Robot
US20190005661A1
