Optical Tracking Marker
The optical tracking marker with a checkerboard pattern addresses the challenge of tracking larger medical devices by providing precise spatial orientation and visibility, enabling 6DOF tracking for devices up to 1 cm in diameter.
Patent Information
- Application Number
- JP2024532381
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-10
- Filing Date
- 2022-12-05
- Publication Date
- 2024-12-09
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing optical tracking systems struggle to accurately track medical devices with diameters larger than a needle, as they lack the capability to provide precise spatial orientation and identification for larger equipment.
A marker for optical tracking with a pattern of optically distinguishable segments, featuring alternating rectangles arranged in a two-dimensional pattern, providing distinct directional information and suitable for attachment to devices with diameters greater than 1 cm, utilizing a checkerboard-like design to enable 6DOF tracking.
The marker allows for precise 6DOF tracking of larger medical devices by ensuring visibility and orientation detection, even when only a portion of the pattern is visible, enhancing tracking accuracy and applicability to a wider range of medical instruments.
Smart Images

Figure 2024545489000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to markers for optical tracking of medical devices and optical tracking systems for medical devices. [Background technology]
[0002] Optical tracking systems can be used during surgery, for example for navigation, tracking or documentation purposes, and have become commonplace in the medical industry. Summary of the Invention [Problem to be solved by the invention]
[0003] Navigation systems can provide real-time information on the position of surgical instruments relative to a subject. This can be useful, for example, during minimally invasive image-guided interventions that are increasingly replacing open surgical procedures. Optical tracking can use patterns detectable via optical cameras that allow the determination of the spatial orientation of a device to which a marker is attached. For example, an intervention needle with a shaft diameter of only a few millimeters can be provided with a coding pattern that can be tracked by a visible light camera. There has been an increasing need to track devices larger than needles.
[0004] Therefore, there may be a need to provide optical tracking suitable for a wider variety of instruments and devices. [Means for solving the problem]
[0005] The object of the present invention is solved by the subject matter of the independent claims, further embodiments are incorporated in the dependent claims. It is noted that the below described aspects of the invention also apply to markers for optical tracking of medical devices and to optical tracking systems for medical devices.
[0006] According to the present invention, a marker for optical tracking of a medical device is provided. The marker has a pattern with a plurality of at least a first type and a second type of optically distinguishable segments. The first type of optically distinguishable segments have a first optical characteristic and the second type of optically distinguishable segments have a second optical characteristic. The first optical characteristic and the second optical characteristic are distinguishably different from each other to a designated optical camera-based tracking device. The segments are provided as squares arranged in a two-dimensional alternating pattern. Each square has two first opposing sides that are parallel to each other and two second opposing sides that are not parallel to each other. The first opposing sides of all the squares are arranged in an aligned manner that defines at least three parallel primary grid lines.
[0007] The effect is to provide a marker pattern that allows identification of the spatial orientation of the markers, the markers being suitable for attachment to larger diameter devices.
[0008] According to one example, at least six parallel primary grid lines are provided.
[0009] According to one example, the rectangles arranged in a two-dimensional alternating pattern are alternating such that one segment of the first and second type is followed by another segment of the second type and the first type.
[0010] According to one example, rectangles are placed such that their vertices intersect with each other, and the edges of the rectangles form a grid.
[0011] According to one example, segments of the same type do not have mutual second sides adjacent to each other, and further, adjacent segments that have a common side are of different types.
[0012] According to one example, the pattern is asymmetric in that at least the pattern segments provide clear directional information with respect to the longitudinal extension of the marker.
[0013] According to one example, the pattern is configured in a generally tubular shape having a longitudinal axis, and at least three parallel primary grid lines are aligned with the longitudinal axis.
[0014] According to one example, when the pattern is arranged in a closed tubular shape, second opposing sides disposed within the pattern define at least one plane disposed at an angle relative to the longitudinal axis.
[0015] According to one example, the pattern is configured in the shape of an open tube having a longitudinal axis and an open cross-section, with at least three parallel primary grid lines aligned with the longitudinal axis.
[0016] In one embodiment, a generally tubular or open tube having an open cross section is provided with varying diameter. In one example, the open cross section is provided as a C-shaped cross section.
[0017] According to one example, a second opposing side in every square pattern forms at least one secondary grid line, and further, when laid flat and unfolded, the at least one secondary grid line is oriented transverse to at least three parallel primary grid lines.
[0018] Additionally or alternatively, in one embodiment the secondary grid lines are provided as at least one of the following group: curved, wavy, or broken lines with at least two segments.
[0019] In another embodiment, additionally or alternatively, at least one secondary grid line is provided non-parallel to the outer boundary of the pattern.
[0020] Additionally or alternatively provided is an embodiment in which at least one secondary grid line is non-perpendicular to one of the at least three parallel primary grid lines at an intersection with the one of the at least three parallel primary grid lines.
[0021] According to one example, a body structure carrying a pattern is provided. In one embodiment, the body structure is i) a tubular structure having the pattern disposed on an exterior of the tubular structure, the axis of the tubular structure forming the longitudinal axis of the marker. In another embodiment, the body structure is ii) a single curved open shell structure having the pattern disposed on a convex exterior or a concave interior of the shell structure.
[0022] The axis of curvature forms the longitudinal axis of the marker.
[0023] Additionally, at least three parallel primary grid lines may be positioned in alignment with the longitudinal axis of the marker.
[0024] According to one example, the pattern includes at least one edge band disposed along a boundary section extending across the primary grid lines, the at least one edge band having one of the first optical characteristic and the second optical characteristic as a main optical characteristic.
[0025] The at least one edgeband is positioned such that each of the primary gridlines terminates in a portion of the edgeband having the main optical property.
[0026] In one embodiment, the pattern has a first edge band along a boundary section on one side of the pattern and a second edge band along a boundary section on the other side of the pattern, the first edge band having a first optical property and the second edge band having a second optical property.
[0027] According to the present invention, there is also provided a medical device having a body structure and a marker for optical tracking, the marker being attached to the body structure. Further, at least one marker is provided as a marker for optical tracking of the medical device according to one of the previous embodiments.
[0028] According to the present invention, there is further provided an optical tracking system for a medical device. The system comprises at least one marker and at least one optical camera-based tracking device. The at least one marker is provided as a marker for optical tracking of the medical device according to one of the previous embodiments. The optical camera-based tracking device is configured to detect the first optical property and the second optical property and provide image data for further image data processing steps.
[0029] Markers can be used, for example, to track devices and parts in hospital operating rooms. A field of use is in augmented reality surgical navigation devices. Markers can be used, for example, to track bone probes, awls, or screwdrivers when placing pedicle screws during minimally invasive spine surgery. Markers can be used on pedicle screws, beams, and supports.
[0030] According to one embodiment, a marker is provided that enables 6DOF (degrees of freedom) optical tracking of instruments, e.g., having diameters greater than 1 cm. The marker uses a checkered pattern wrapped around a cylinder, where the size of the squares varies across the pattern to facilitate 6-DOF tracking.
[0031] According to one embodiment, the pattern is based on a checkered pattern. The checkered pattern is suitable for use in computer vision applications. According to one embodiment, the pattern is aligned such that the lines formed by the pattern along one of its dimensions are parallel to the central axis of the device to be tracked. These lines remain straight under (perspective) projection from any angle. This allows the new pattern to be used for larger instruments.
[0032] For example, the base shape of the marker is a cylinder. In one example, a regular cylinder is provided for sliding the marker over the tip of the instrument to attach it. In another example, the marker is provided as a partial cylinder for attachment from the side.
[0033] For example, a square varies in size across the marker, removing any rotational symmetry, thus allowing 6-DOF tracking. For a closed cylinder, the pattern is defined using two planes that are not perpendicular to the central axis of the cone, but at a slight angle. This gives a continuous variation around the marker. For an open cylinder, the pattern does not need to be continuous (circumferentially). In one example, the size of the middle segments varies from smallest on one side of the opening to largest on the other side of the opening.
[0034] In one embodiment, special bands are placed at the top and bottom of the marker and have smaller squares than the rest of the marker. The parts of these bands that are close to the straight lines of the pattern are all black on one side of the marker and all white on the other side. This is used to determine the orientation of the marker and removes any symmetry across the central axis of the cylinder.
[0035] In one embodiment, between the direction-encoding portions of the bands at both ends, a binary pattern is encoded using inverted black and white squares, respectively. The binary pattern is an ID value that is encoded using error correction techniques and padding bits. In one embodiment, this pattern is repeated three times around the marker, since typically only a portion of the marker is visible to the tracking system. The pattern is constructed such that the original ID value can be reconstructed if at least one third of the pattern is visible.
[0036] According to one embodiment, a pattern is provided that includes a checkered pattern with squares of various sizes, optionally a unique ID encoded on the end of the marker, and further optionally a cylindrical shape, which can be a partial cylinder to aid in attaching the marker to a device. The pattern is provided for devices having a diameter greater than about 1 centimeter.
[0037] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
[0038] Exemplary embodiments of the exemplary invention will now be described with reference to the accompanying drawings. [Brief description of the drawings]
[0039] [Figure 1] FIG. 1 illustrates an example of a marker for optical tracking of a medical device as a closed cylinder. [Diagram 2] FIG. 2 shows the marker design of FIG. 1 in an unfolded 2D view. [Diagram 3] 1 is a perspective view showing an example of a marker having an open tube shape, i.e., an open cylinder. [Figure 4] FIG. 13 is a perspective view showing another example of a marker. [Diagram 5] FIG. 5 shows the marker design of FIG. 4 in an unfolded 2D view. [Figure 6] FIG. 13 is a perspective view showing a further example of a marker. [Figure 7] FIG. 5 shows the marker design of FIG. 4 in an unfolded 2D view. [Figure 8] FIG. 13 shows further example markers in an exploded view. [Figure 9] FIG. 1 illustrates an example of an optical tracking system for a medical device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0040] Certain embodiments will now be described in detail with reference to the accompanying drawings. In the following description, like reference numbers in the drawings are used for like components in different drawings. Matters defined in this specification, such as detailed configurations and components, are provided to aid in a comprehensive understanding of the exemplary embodiments. Also, well-known functions or configurations will not be described in detail since they would obscure the embodiments with unnecessary details. Furthermore, expressions such as "at least one of," when preceding a list of components, modify the entire list of components and do not modify individual components of the list.
[0041] FIG. 1 shows an example of a marker 10 for optical tracking of a medical device in a perspective view. The marker 10 has a pattern 12 having at least a first type 14 and a second type 16 of a plurality of optically distinguishable segments. The optically distinguishable segments of the first type 14 have a first optical characteristic. The optically distinguishable segments of the second type 16 have a second optical characteristic. The first optical characteristic and the second optical characteristic are distinguishably different from each other to a designated optical camera-based tracking device. The segments are provided as squares 18 arranged in a two-dimensional alternating pattern 20. Each of the squares 18 has two first opposing sides 22 that are parallel to each other and two second opposing sides 24 that are not parallel to each other. Thus, the squares 18 have four vertices 26 as corners. The first opposing sides 22 of all the squares 18 are arranged in an aligned manner to define at least three parallel primary grid lines 28.
[0042] In the example of FIG. 1, the first optical characteristic, i.e. the optically distinguishable segments of a first type 14, are white, and the second optical characteristic, i.e. the optically distinguishable segments of a second type 16, are black.
[0043] In another example, the first optical characteristic, i.e., the optically distinguishable segments of a first type 14, is a first color and the second optical characteristic, i.e., the optically distinguishable segments of a second type 16, is a second color.
[0044] First opposing side 22 and second opposing side 24 may also be referred to as first and second opposing edges.
[0045] In one example, there are at least six parallel primary grid lines 28. For example, the six parallel primary grid lines 28 are spaced at 60° intervals.
[0046] Having at least six parallel primary grid lines 28 ensures that even a single camera can see a minimal amount of the pattern. The pattern should have a sufficient number of parallel primary grid lines 28 so that the camera system can triangulate at least three of the parallel primary grid lines in any orientation. The number of lines in the pattern will, of course, vary depending on the camera system setup.
[0047] In one example, an even number of parallel primary grid lines 28 are provided, which results in a chessboard pattern when having a closed tubular shape, which when placed around a tubular shaft provides the advantage that at least two of the circumferential blocks are visible, i.e. detectable, to the camera.
[0048] In one example, the parallel primary grid lines 28 have a fixed distance from one another and are regularly displaced circumferentially when disposed on, for example, a tubular shaft.
[0049] In another example, the parallel primary grid lines 28 are provided having varying distances relative to one another, for example being non-regularly displaced in the circumferential direction.
[0050] In one example, a camera system is provided such that a full 360 degrees of the marker is visible by at least two cameras, in such a case three parallel lines are sufficient.
[0051] In one example, the camera system is configured for a 120 degree view. Additionally, at least nine parallel primary grid lines are provided.
[0052] In another example, 12 parallel primary grid lines are provided which have some margin and allow for an easier and more robust method of ID encoding.
[0053] As mentioned above, an even number is provided to avoid two segments of the same color being next to each other (at boundary sections that would coincide when wrapped around).
[0054] In one example, the rectangles arranged in a two-dimensional alternating pattern are arranged such that one segment of the first and second types is followed by the other segment of the second type and the first type, respectively.
[0055] As shown in one embodiment in FIG. 1, the rectangles 18 are arranged such that their vertices 26 intersect with one another and the edges (first opposing sides 22) of the rectangles form a grid.
[0056] Thus, segments of the same type, also called blocks, only contact each other through vertices 26, i.e., corners. In one example, segments of the same type do not have mutual second edges adjacent to each other. In other words, adjacent segments that have a common edge line are of different types. A segment of a first type is positioned adjacent to a segment of a second type, and vice versa.
[0057] In one example, the vertices 26 of adjacent quadrilaterals 18 intersect with each other at a single point.
[0058] In one example, segments of the same type do not have mutual second edges adjacent to each other. Furthermore, adjacent segments that have a common edge line are of different types.
[0059] The term "pattern" relates to a repeating arrangement of geometrically distinct parts of a surface, the parts being arranged in such a way that they follow a general concept, i.e. a pattern concept, but at least some of the parts are different from the other parts.
[0060] The term "optical property" relates to the optical appearance of a part. This includes parameters such as color or brightness, but may also relate to roughness or reflectance properties. In one example, the first and second optical properties are provided as black and white (or at least light and dark gray), or as complementary colors.
[0061] The term "optically discernible" refers to a property that can be detected by optical means, such as a camera. The term "optically" refers to the visible light spectrum, i.e. the range of light waves that are visible to the human eye, but also to the infrared and ultraviolet light wave ranges.
[0062] The term "camera-based tracker" refers to a device that has optical (visible, infrared, and ultraviolet) sensors that can be used to track patterns. Tracking refers to providing image data that can be used for image processing steps where patterns are detected for further analysis steps.
[0063] In the context of this application, the term "quadangle" refers to a segment of a marker pattern having four corners and four connecting sides. In one example, the sides are straight lines that define a quadrangle in its geometrical sense. In one example, one or two sides are curved or polygonal lines, i.e., non-straight lines, that define a quasi-quadangle in a broader sense, i.e., in its expanded sense applied in the present context. However, in the present context, the term quadrangle relates to all different deviations as well as quadrangles having four corners and four connecting sides. Thus, the term "quadangle" refers to a polygon having four edges and four vertices. However, in the present context, the term "quadangle" relates to a geometric shape having a surface area with at least four corners and four edges. In one example, exactly four corners are provided. In one embodiment, all four edges of the quadrangle are straight lines, i.e., linear lines. In another embodiment, two of the parallel sides are straight, i.e., linear lines, while at least one of the other two sides has a curved shape, i.e., a non-linear side. In one example, at least one of the two non-parallel sides provides a convex outer contour of a quadrangle. In one example, both non-parallel sides provide a convex outer contour of a quadrangle. In another example, at least one of the two non-parallel sides provides a concave outer contour of a quadrangle. In one example, both non-parallel sides provide a concave outer contour of a quadrangle. In another example, one of the non-parallel sides provides a convex outer contour of a quadrangle and the other of the non-parallel sides provides a concave outer contour of a quadrangle.
[0064] 1, the pattern 12 is arranged in a tubular shape having a longitudinal axis 30. At least three parallel primary grid lines 28 are aligned with the longitudinal axis 30.
[0065] In this example, the pattern 12 is arranged in a tubular shape with a closed cross section in Fig. 1. The tubular shape can also be referred to as a closed tubular shape, for example a closed cylinder, e.g. having an O-shaped cross section or a circular cross section.
[0066] For example, when the pattern is disposed in a tubular shape, second opposing sides disposed within the pattern define at least one plane that is disposed at an angle relative to the longitudinal axis.
[0067] The term "in the pattern" refers to adjacent quadrilaterals, i.e., opposing sides that face the other opposing side of the next pattern segment.
[0068] The sides not facing the pattern segment but forming the outer edge of the pattern may also form a plane, for example transverse to the longitudinal axis, for example perpendicular to the longitudinal axis.
[0069] In one example, the pattern is arranged in a round cross-sectional tubular shape that may be circular or non-circular, for example, elliptical, or has an elliptical cross-section.
[0070] In another example, the patterns are arranged in a rectangular tubular shape, for example having a rectangular or square cross section.
[0071] In another example, the patterns are arranged in a polygonal manner, for example having a polygonal cross section.
[0072] In another example, the pattern is arranged in a circular tubular shape.
[0073] In one example, the second opposing sides disposed in the pattern define at least two planes from which at least one is disposed at an angle relative to the longitudinal axis.
[0074] In another example, at least two planes are defined, one disposed at an angle to the longitudinal axis and one disposed perpendicular to the longitudinal axis.
[0075] In other examples, at least two planes are defined, at least two of which are disposed at an angle relative to the longitudinal axis.
[0076] As an example, the two planes are arranged parallel to each other.
[0077] As another example, the two planes are disposed at an angle to each other.
[0078] In another embodiment (not shown in detail), two parallel sides are straight, i.e. linear lines, while at least one of the other two sides has a polygonal shape, i.e. has a side that includes two or more linear line segments. In such a case, a "quadrilateral" as used in this context has four so-called primary corners and one so-called secondary corner.
[0079] A vertex or corner refers to the point where two edges meet.
[0080] A two-dimensional alternating pattern forms a kind of chessboard pattern, but only one direction of the grid lines is straight and parallel. It should be noted that the term "pattern" is used in reference to the configuration of segments. In this case, at least parts of the segments are different from each other, in particular parts of adjacent segments are different from each other, i.e. parts of adjacent segments are different from each other. Thus, in this context, the term pattern is usually used for a structure that refers to the repetition of the same segments and shows the concept as a general order, but with a characteristic difference of at least some of the segments. Although adjacent segments are different from each other, they, i.e. their shape and size, can be repeated in the structure of the pattern in a staggered manner, i.e. with one or more segments between equal segments.
[0081] The term "optically distinguishable segments" refers to different surface areas of a pattern. Optically distinguishable segments may also be referred to as pattern segments or pattern elements.
[0082] The actual (minimum) size of a segment also depends on the resolution of the camera used for tracking. The minimum aspect ratio is also given by the camera resolution.
[0083] Figure 2 shows in an unfolded 2D (planned) view the marker design of Figure 1. In one example, the pattern is asymmetric in that at least the pattern segments provide clear directional information with respect to the longitudinal extension of the marker.
[0084] 1, the second opposing side 24 in every pattern of rectangles 18 forms at least one secondary grid line 32. When laid out in a flat, unfolded state, the at least one secondary grid line 32 is disposed across at least three parallel primary grid lines 28.
[0085] In one embodiment, the secondary grid lines 32 are provided as at least one of the following group: curved lines, wavy lines, or broken lines having at least two segments.
[0086] In one embodiment, at least one secondary grid line 32 is oriented non-parallel to the outer boundary 34 of the pattern.
[0087] In one embodiment, at an intersection with one of the at least three parallel primary grid lines 28, at least one secondary grid line 32 is non-perpendicular to one of the at least three parallel primary grid lines.
[0088] In one example, at least one secondary grid line 32 has the shape of at least one of the following group: a curve, a wave, or a broken line having at least two segments.
[0089] In one example, at least one secondary grid line 32 has at least one of the following group: curved segments, wave segments, and linear segments.
[0090] Significantly different includes at least one parameter of a group of color and brightness values of the determined light wave spectrum of the optical camera based tracking device being different.
[0091] In one example, the first type segment and the second type segment are distinguishably detectable in at least one of the group of: visible light wave region, infrared light wave region, and ultraviolet light wave region.
[0092] In one example (see also Figures 1 and 3), a pattern-bearing body 51 structure is provided. The body structure can be i) a tubular structure 49 with the pattern provided on the outside of the tubular structure. The axis of the tube forms the longitudinal axis 30 of the marker. The body structure can also be ii) a single curved open shell structure 36 (see Figure 3) with the pattern provided on a convex outer side or a concave inner side (not shown) of the shell structure 36. The axis of curvature forms the longitudinal axis 30 of the marker. At least three parallel primary grid lines 28 are positioned in alignment with the longitudinal axis 30 of the marker.
[0093] The term "aligned with the longitudinal axis of the marker" refers to the parallel alignment of at least three parallel primary grid lines 28 with the longitudinal axis 30 of the marker.
[0094] The term "single-curved open shell structure" refers to a structure in the form of a shell that is an open shell and is formed along only one curvature. It is noted that an open shell is provided in contrast to a closed shell structure. It is further noted that the shell structure has a curvature that follows a single curvature in contrast to being flat or in contrast to two curvatures in a doubly curved shell. The term "shell" refers to a structural element that is a three-dimensional solid body. The thickness is fairly small compared to the other dimensions.
[0095] By way of example, the tubular shape comprises one of the group of a cylinder with a circular cross section, a tube with a rounded non-circular cross section, a prism, a frustum, and a truncated cone. A frustum refers to a truncated structure with a polygonal cross section. A truncated cone refers to a truncated structure with a circular cross section. The pattern 12 is provided on such a shape.
[0096] 1 and 2, the pattern 12 has at least one edge band 38 disposed along a boundary section that extends across the primary grid lines 28. The at least one edge band 38 includes one of the first optical characteristic and the second optical characteristic as a main optical characteristic. The at least one edge band 38 is positioned such that each of the primary grid lines 28 terminates at a portion of the edge band having the main optical characteristic.
[0097] 2, the pattern has a first edge band 38a along a boundary section on one side of the pattern and a second edge band 38b along a boundary section on the other side of the pattern, the first edge band 38a having a first optical property and the second edge band 38b having a second optical property.
[0098] In another embodiment, only one first edgeband 38 is provided.
[0099] The term "main optical feature" refers to a structured edgeband that includes several portions of different optical features.
[0100] The "one side of the pattern" and the "other side of the pattern" are sometimes referred to as the first boundary and the second boundary. The one side of the pattern and the other side of the pattern refer to two opposing boundary sections, i.e., edge zones, of the pattern, which are in a direction transverse to the primary grid lines, e.g., vertically.
[0101] The arrangement of the first and second edge bands allows for better discrimination of direction by detecting at which optical property, i.e. at which color, the primary grid lines terminate, i.e., end.
[0102] For example, a white (or light) main optical characteristic may be provided in the first boundary section to indicate a "bottom" direction of the pattern (see FIG. 2) when, for example, positioned in a specified manner on the device. Further, for example, a black (or dark) main optical characteristic may be provided in the first boundary section to indicate a "top" direction of the pattern when, for example, positioned in a specified manner on the device.
[0103] At least one edgeband, for example the bottom edgeband 38b, has an edgeband pattern 40 having a plurality of first and second edgeband segments 42, 44 arranged in a coding scheme to provide information coded by the at least one edgeband. The first edgeband segment 42 has a first edgeband optical characteristic and the second edgeband segment 44 has a second edgeband optical characteristic that is different from the first edgeband optical characteristic. In one embodiment, the edgeband pattern 40 is repeated at least three times along the edge.
[0104] In one embodiment, only one of the at least one edgeband has an edgeband pattern 40 .
[0105] In another embodiment, two edgebands are provided, both having an instance of the edgeband pattern 40. For example, both edgebands can have the same edgeband pattern.
[0106] In another embodiment, two edgebands are provided (see FIG. 2), both having an example of an edgeband pattern 40. For example, both edgebands have different edgeband patterns. As shown in FIG. 3, the upper edgeband has an edgeband pattern 40 having a plurality of first and second edgeband segments 42, 44 arranged in a coding scheme to provide information encoded by the upper edgeband. The first edgeband segment 42 of the upper edgeband has a first edgeband optical characteristic and the second edgeband segment 44 of the upper edgeband has a second edgeband optical characteristic that is different from the first edgeband optical characteristic.
[0107] In one embodiment, the first edgeband optical characteristic of the upper edgeband is opposite to the first edgeband optical characteristic of the lower edgeband.Similarly, in one embodiment, the second edgeband optical characteristic of the upper edgeband is opposite to the second edgeband optical characteristic of the lower edgeband.
[0108] In another embodiment, a first edgeband optical characteristic of the upper edgeband is the same as a first edgeband optical characteristic of the lower edgeband, and a second edgeband optical characteristic of the upper edgeband is the same as a second edgeband optical characteristic of the lower edgeband.
[0109] In one embodiment, the second edge band pattern 40 is also repeated at least three times along the edge.
[0110] The edge band pattern is arranged such that a sequence of first and second edge band segments have alternating first and second edge band optical properties. In one example, the edge band segments extending across the entire width of the edge band, i.e., in the direction of the primary grid lines, have varying lengths in the circumferential direction. However, the transition lines from the first edge band optical property to the second edge band optical property and vice versa are offset relative to the primary grid lines to ensure that each primary grid line 28 terminates at an end or termination point 46 in the field of either the first edge band optical property (for one of the edge bands) or the second edge band optical property (for the other one of the edge bands).
[0111] In one example, the first edgeband optical property is provided in the same manner as the first optical property of the (main) pattern. In one embodiment, in addition or alternatively, the second edgeband optical property is provided in the same manner as the second optical property of the (main) pattern.
[0112] For example, the first edgeband optical property is the same as the first optical property of the (main) pattern. In one embodiment, additionally or alternatively, the second edgeband optical property is the same as the second optical property of the (main) pattern.
[0113] Repeating the edge band pattern at least three times along the edge provides the advantage that the encoded information can be detected without having to cover the complete edge band pattern: if the pattern is provided in a tubular shape, the edge band pattern can be seen in one view if the edge band pattern is distributed over a maximum of 120° in the circumferential direction (see also above regarding the number of grid lines).
[0114] As an example, the edgeband pattern may provide encoded information, for example, referencing a marked tool or device.
[0115] By applying two edge bands, it becomes possible to combine and provide more data.
[0116] In one example, the described bands are combined with a pattern that encodes an identity. The segments that make up the pattern are shifted by half their width compared to the parallel lines of the main pattern. The segments on these parallel lines form bands. The other segments form a binary signal that encodes some identity.
[0117] In one embodiment, error correction techniques are provided to ensure that if some of the segments are not read correctly or are read incorrectly, the correct ID is recovered.
[0118] In one example, a tracking system is provided having two or more cameras positioned closely together looking in substantially the same direction.
[0119] FIG. 2 shows a pattern with a number of different horizontal (with respect to the portrait orientation of the page) zones, such as an upper zone 48a, a central zone 48b, and a lower zone 48c. A first boundary line 50a is formed by each of the second opposing sides 24. The first boundary line 50a is shown in FIG. 2 as an embodiment with a wavy outline. Also, a second boundary line 50b is formed by the second opposing sides 24. The second boundary line 50b is shown in FIG. 2 as an embodiment with a wavy outline. The outlines may be non-parallel, for example with opposite increasing or decreasing ratios in the circumferential direction. In another example, referring to FIG. 8, when the pattern is laid out and arranged, one or all of the second boundary lines 32 are provided as straight lines 47a, 47b.
[0120] FIG. 3 shows in a perspective view an example of a marker 10 in the shape of an open tube, ie an open cylinder.
[0121] In another example, shown as an alternative embodiment in Fig. 3, the marker 10 is provided as an open cylinder, for example having a longitudinal gap 60. The pattern 12 is arranged in a tubular shape, for example having an open cross section, such as a C-shaped cross section.
[0122] In one example, the pattern 12 is arranged in a generally tubular shape having a longitudinal axis and an open cross-section. At least three parallel primary grid lines are aligned with the longitudinal axis. The generally tubular shape may also be referred to as an open tube shape.
[0123] In one embodiment, the diameter of a generally tubular shape having a C-shaped cross section is varied. The pattern 12 comprises a line that crosses from one side of the C-shape to the other side of the C-shape.
[0124] In one example, one or more conical markers are provided as "open cylinders", i.e., conical, but with axially oriented slits or gaps, i.e., with circumferentially discontinuous surfaces.
[0125] In another example, one or more conical markers are provided as "closed cylinders", i.e., cones with a continuous surface in the circumferential direction, i.e., cones with no axially oriented slits or gaps.
[0126] Figure 4 shows another example of a marker in a perspective view, and Figure 5 shows the marker design of Figure 4 in an unfolded 2D (planned) view.
[0127] Figure 5 shows a pattern having a number of different horizontal (with respect to the portrait orientation of the page) zones, such as upper zone 52a and lower zone 52b. Boundary 54 is formed by each second opposing edge 24. Boundary 54a is shown in Figure 5 as an embodiment with a wavy profile.
[0128] Figure 6 shows another example of a marker in a perspective view, and Figure 7 shows the marker design of Figure 6 in an unfolded 2D (planned) view.
[0129] FIG. 7 shows a pattern having a number of different horizontal (with respect to the portrait orientation of the page) zones, such as a first zone 56a, a second zone 56b, a third zone 56c, a fourth zone 56d, and a fifth zone 56e.
[0130] The first boundary line 50a is formed by the respective second opposing sides 24. The first boundary line 58a is shown in FIG. 2 with a wavy outline as an embodiment. The second boundary line 58b is formed by the respective second opposing sides 24. The second boundary line 58b is shown in FIG. 7 with a wavy outline as an embodiment. The third boundary line 58c is formed by the respective second opposing sides 24. The third boundary line 58a is shown in FIG. 7 with a wavy outline as an embodiment. The fourth boundary line 58d is formed by the respective second opposing sides 24. The fourth boundary line 58d is shown in FIG. 7 with a wavy outline as an embodiment.
[0131] The profiles (of the respective boundaries) may be non-parallel, for example having opposite rates of increase or decrease in the circumferential direction.
[0132] Figure 8 shows an example where the pattern has lines (shown in the form of straight lines 47a, 47b) that cross from one side of the C to the other side of the C. The pattern shown in Figure 8 as one embodiment has two or more lines that cross from one side of the C to the other side of the C.
[0133] In one example, the pattern shown in FIG. 8 is applied to the shape of an open cylinder or an open cone, thus having a C-shaped cross section.
[0134] In another example, the pattern shown in FIG. 8 is applied to the shape of a closed cylinder or a closed cone.
[0135] In an example not shown in further detail, a medical device is also provided having a body structure and a marker for optical tracking, the marker being attached to the body structure. Furthermore, at least one marker is provided as a marker for optical tracking of the medical device according to one of the above and below embodiments.
[0136] FIG. 9 shows an example of an optical tracking system 100 for a medical device. The optical tracking system 100 comprises at least one marker 102 and at least one optical camera-based tracker 104. The at least one marker 102 is provided as an example of a marker 10 for optical tracking of a medical device according to one of the previously described embodiments. The optical camera-based tracker 104 is configured to detect the first optical property and the second optical property and provide image data for further image data processing steps. The optical tracking system 100 is shown in a hospital operating room environment. For example, an X-ray imaging system 106 is provided as a movably mounted C-arm 108. At either end of the C-arm 108, an X-ray source 110 and an X-ray detector 112 are provided. The object 114 is placed on an object support 116. The marker 102 is attached to the object 114. Furthermore, a monitor device 118 is shown and a console 120 is shown in the lower right front. The optical camera based tracker 104 has a support structure 118 to which four cameras 122 are mounted. Line 122 indicates a data connection of the optical camera based tracker 104 to a console 120.
[0137] In another embodiment, the optical camera-based tracker 104, i.e., the camera system, is embedded in the X-ray detector 112. For example, three or more cameras 122' are integrated into the housing of the detector 112, as shown in dashed lines in FIG.
[0138] The term "subject" may also be referred to as an individual. A "subject" may also be referred to as a patient, although it should be noted that this term does not indicate whether any disease or illness is actually present in the subject.
[0139] It should be noted that the embodiments of the present invention are described with reference to different subject matters. In particular, some embodiments are described with reference to device type claims, and other embodiments are described with reference to system type claims. However, those skilled in the art will understand from the above and the following description that, unless otherwise stated, any combination of features belonging to one type of subject matter, as well as any combination between features relating to different subject matters, is disclosed in the present application. However, all features can be combined to provide a synergistic effect that is higher than the simple sum of the features.
[0140] While the invention has been illustrated and described in detail in the drawings and the foregoing description, such illustration and description are to be considered exemplary or explanatory and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure and the dependent claims.
[0141] In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be interpreted as limiting their scope.
Claims
1. 1. A marker for optical tracking of a medical device, comprising: a pattern having a plurality of optically distinguishable segments of at least a first type and a second type; the first type of optically distinguishable segments have a first optical characteristic and the second type of optically distinguishable segments have a second optical characteristic; the first optical characteristic and the second optical characteristic are distinguishably different from one another to a designated optical camera-based tracking device; the segments are provided as rectangles arranged in a two-dimensional alternating pattern; each of the quadrilaterals has two first opposing sides that are parallel to one another and two second opposing sides that are not parallel to one another; A marker, the first opposing sides of all of said rectangles being aligned to define at least three parallel primary grid lines.
2. The marker of claim 1 , wherein at least six parallel primary grid lines are provided.
3. 3. The marker of claim 1 or 2, wherein the rectangles arranged in the two-dimensional alternating pattern are arranged alternately such that one segment of the first and second types is followed next to the other segment of the second type and the first type.
4. A marker according to claim 1 , wherein the quadrangles are arranged such that their vertices intersect with each other and edges of the quadrangles form a grid.
5. 5. The marker of claim 4, wherein segments of the same type do not have mutual second sides adjacent to each other, and adjacent segments that have a common side are of different types.
6. A marker according to any one of claims 1 to 5, wherein the pattern is asymmetric in that at least a segment of the pattern provides clear directional information with respect to the longitudinal extension of the marker.
7. the pattern is arranged in a generally tubular shape having a longitudinal axis; The marker of claim 1 , wherein the at least three parallel primary grid lines are aligned with the longitudinal axis.
8. 8. A marker as described in any one of claims 1 to 7, wherein when the pattern is arranged in a closed tubular shape, the second opposing sides arranged within the pattern define at least one plane that is arranged at an angle to the longitudinal axis.
9. the pattern is arranged in the form of an open tube having a longitudinal axis and an open cross-section; the at least three parallel primary grid lines are aligned with the longitudinal axis; To vary the diameter of an open tube shape having a C-shaped cross section, the pattern has lines crossing from one side of the C to the other side of the C. A marker according to any one of claims 1 to 8.
10. the second opposing sides in every of the rectangular patterns form at least one secondary grid line; when laid flat and positioned, the at least one secondary grid line is disposed across the at least three parallel primary grid lines; the secondary grid lines are provided as at least one of the following group: curved, wavy or broken lines with at least two segments; the at least one secondary grid line is non-parallel to an outer boundary of the pattern; The at least one secondary grid line is non-perpendicular to one of the at least three parallel primary grid lines at a point where it intersects with that one of the at least three parallel primary grid lines. A marker according to any one of claims 1 to 9.
11. The marker of claim 1 , wherein the distinguishably different is characterized by differing in at least one parameter of the group of color and brightness values of the light wave spectrum determined by the optical camera based tracking device.
12. 13. A marker as claimed in any one of claims 1 to 12, wherein the first type segments and the second type segments are distinguishably detectable in at least one of the group of visible light wave region, infrared light wave region, and ultraviolet light wave region.
13. a body structure is provided that carries the pattern; The body structure includes: i) a tubular structure, the pattern being provided on the exterior of the tubular structure, the tube axis forming the longitudinal axis of the marker, or ii) a single curved open shell structure, the pattern being on a convex outer surface or a concave inner surface of the shell structure, the axis of curvature forming a longitudinal axis of the marker, the at least three parallel primary grid lines being aligned with the longitudinal axis of the marker, the at least three parallel primary grid lines being aligned with the longitudinal axis of the marker; The marker according to any one of claims 1 to 12, wherein:
14. The tubular shape is Cylinders with circular cross-sections, Tubes with round and non-circular cross sections, Square pillar, Frustum, and Cone truncation, 14. The marker according to claim 6, comprising one of the following groups:
15. the pattern includes at least one edge band disposed along a boundary section that extends transversely across the primary grid lines; the at least one edge band has one of the first optical property and the second optical property as a main optical property; the at least one edge band is arranged such that each of the primary grid lines terminates at a portion of the edge band having the main optical property; 15. A marker as described in any one of claims 1 to 14, wherein the pattern has a first edge band along a boundary section on one side of the pattern and a second edge band along a boundary section on another side of the pattern, the first edge band having a first optical property and the second edge band having the second optical property.
16. the at least one edge band having an edge band pattern, the edge band pattern having a plurality of first and second edge band segments arranged in a coding scheme to provide information coded by the at least one edge band; the first edgeband segment has a first edgeband optical characteristic and the second edgeband segment has a second edgeband optical characteristic different from the first edgeband optical characteristic; The marker of claim 15 , wherein the edgeband pattern is repeated at least three times along the edgeband.
17. The main body structure, and a marker for optical tracking; the marker is attached to the body structure; A medical device, wherein at least one said marker is provided as a marker according to any one of claims 1 to 16.
18. 1. An optical tracking system for a medical device, comprising: At least one marker; at least one optical camera based tracking device; 15. An optical tracking system, wherein the at least one marker is provided as a marker according to any one of claims 1 to 14, and the optical camera based tracking device is configured to detect the first optical property and the second optical property and provide image data for further image data processing steps.
