Intraoperative alignment assessment system and method

Through dynamic reference frame systems and benchmark alignment components, trackable markers and 3D imaging techniques are used to solve the intrastrative alignment problems, enabling fast and accurate spinal alignment and simplifying surgical procedures, reducing radiation exposure.

CN112638237BActive Publication Date: 2024-11-08GLOBUS MEDICAL INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201880097127.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-07-03
Filing Date
2018-12-31
Publication Date
2024-11-08
Estimated Expiration
2038-12-31

AI Technical Summary

Technical Problem

Existing surgical tools are difficult to quickly and accurately evaluate intraoperative alignment of the spine, especially during corrections, and often introduce excessive radiation exposure and inadequate visualization of anatomical landmarks, resulting in lengthy surgical workflow.

Method used

Using a Dynamic Reference Framework (DRF) system that includes traceable markers, 3D tracking cameras or imaging systems, processors and memory, provides spinal alignment anatomical information through dynamic reference frames and reference alignment components, using X-ray sources or imaging The device performs marking embedding and tracking to achieve accurate alignment of the spine.

Benefits of technology

Improves the rapid and accurate spinal alignment, reduces radiation exposure, simplifies the surgical procedure, and enhances visualization and analytical capabilities of anatomy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112638237B_ABST
    Figure CN112638237B_ABST
Patent Text Reader

Abstract

Some embodiments provide systems, components and methods for analyzing patient anatomy, including providing analysis of the patient's spine. The systems, components and / or methods may include obtaining initial patient data, and obtaining spinal alignment profile information. In addition, the systems, components and / or methods may assess the patient's local anatomical features and obtain anatomical region data. The systems, components and / or methods may analyze local anatomical structures and therapeutic device positions and profiles. In addition, the systems, components and / or methods may output local anatomical analysis and therapeutic device profile data and / or images on a display.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Related applications

[0002] This application is a continuation-in-part of U.S. Patent Application No. 16 / 026,754, filed July 3, 2018, entitled “Intraoperative Alignment Assessment System and Method,” which claims priority to U.S. Provisional Application Serial No. 62 / 528,390, filed July 3, 2017, the entire contents of which are incorporated herein by reference. Background Technology

[0003] Current tools limit surgeons' ability to quickly and accurately assess intraoperative alignment of their patients' spines, especially after the spine has been manipulated during correction. Furthermore, most existing technological options introduce or rely on excessive radiation exposure, insufficient visualization of one or more anatomical landmarks of interest, and lengthy interruptions to the surgical workflow. Summary of the Invention

[0004] Some embodiments include a system comprising at least one dynamic reference frame (DRF) configured such that any fixed or moving portion of the DRF, or any component or part coupled to the DRF, can be registered in 3D space using a plurality of trackable markers. In some embodiments, the plurality of trackable markers includes at least one movable or triggerable marker. Some embodiments include at least one user-actuated trigger or actuator coupled to at least one movable or triggerable marker, which can trigger or actuate the at least one movable or triggerable marker. Some further embodiments include at least one 3D tracking camera or imaging system configured to track one or more of the plurality of trackable markers. In some embodiments, the system includes a processor and a memory coupled to the processor, wherein the memory stores instructions executable by the processor to track the 3D coordinates of one or more of the plurality of trackable markers.

[0005] Some other embodiments include a method for analyzing and providing spinal alignment anatomical information and treatment device data, including obtaining initial patient data, acquiring alignment contour information, assessing local anatomical features, obtaining anatomical region data, analyzing local anatomical structures, analyzing treatment device location and contour mapping, and / or outputting local anatomical analysis and treatment device contour data on a display.

[0006] Some other embodiments include anatomical marking or tracking systems that include a lower reference alignment component and a complementary upper reference alignment component. In some embodiments, the lower reference alignment component is configured to be coupled to an anatomical structure, and the upper reference alignment component is configured to align to at least a portion of the lower reference component using at least one characteristic of both the lower and upper reference alignment components.

[0007] Some embodiments include radiopaque markers configured to be visually observable using an X-ray source or imager, wherein the radiopaque markers are at least partially embedded in at least one of the lower reference alignment assembly and the complementary upper reference alignment assembly.

[0008] In some embodiments, the at least one feature includes at least one magnet. In other embodiments, the at least one feature includes at least one protrusion configured to at least partially insert into or mate with at least one mating hole. In some embodiments, the at least one protrusion includes at least one protrusion extending from a mating surface of the lower reference alignment assembly. In some further embodiments, at least one mating hole is positioned through a mating surface of the upper reference alignment assembly.

[0009] In some embodiments of the invention, the lower reference alignment assembly and the complementary upper reference alignment assembly are configured to be at least partially aligned and coupled at an interface via a surgical drape or surgical towel, wherein the interface includes at least a portion of a surgical drape or surgical towel positioned between at least a portion of the lower reference alignment assembly and the complementary upper reference alignment assembly.

[0010] In some further embodiments, the upper reference alignment component includes at least one groove located in the upper surface, wherein the at least one groove is configured to be tracked by a tracking probe to determine the unique identity of the system and to interpret its position and orientation in space.

[0011] In some embodiments, at least one recess includes a “Z”-shaped geometry configured to receive and / or guide a tracking probe. In some further embodiments, the at least one recess includes a sloping downward surface configured to facilitate tracking of the probe by a user from the upper surface of the upper surface of the upper reference alignment assembly down to the body surface on which the system is placed.

[0012] In some embodiments, the lower reference alignment assembly is configured and arranged to adhere to the skin surface. In some other embodiments, the lower reference alignment assembly and / or the upper reference alignment assembly may include guides instructing the user how to position the system. In some embodiments, the guides include arrow shapes indicating position or orientation. In some embodiments of the system, the transmissive markers include three or more markers positioned relative to each other to enable the calculation of 3D pose information.

[0013] Some additional embodiments include a tracking probe configured to be coupled to at least a portion of the upper reference alignment assembly. In some embodiments, the tracking probe is configured to be coupled to at least one recess of the upper reference alignment assembly to determine the unique identity of the system and to interpret its position and orientation in space.

[0014] Some embodiments include a tracking system comprising a lower reference alignment assembly and a complementary upper reference alignment assembly, wherein the lower reference alignment assembly is configured to be coupled to an anatomical structure, and the upper reference alignment assembly is configured to align to at least a portion of the lower reference alignment assembly using at least one characteristic of the lower and upper reference alignment assemblies. In some further embodiments, a radiopaque marker is configured to be visually observable using an X-ray source or imager, and the radiopaque marker is at least partially embedded in at least one of the lower and upper reference alignment assemblies. Some embodiments also include at least one tracking probe assembly configured to be coupled to at least a portion of the upper reference alignment assembly, and at least one groove positioned within the upper reference alignment assembly. In some embodiments, the at least one groove is configured to be tracked by the at least one tracking probe assembly to determine the unique identity of the system and to interpret its position and orientation in space.

[0015] In some embodiments of the tracking system, at least one feature includes at least one magnet. In some embodiments of the tracking system, at least one feature includes at least one protrusion configured to at least partially insert into or mate with at least one mating hole, wherein the at least one protrusion extends from a mating surface of a lower reference alignment assembly, and the at least one mating hole is positioned through a mating surface of an upper reference alignment assembly.

[0016] Some embodiments of the tracking system include at least one recess comprising a "Z"-shaped geometry configured to receive and / or guide a tracking probe. In some embodiments, the at least one recess includes an inclined ramp configured to facilitate tracking of the probe by a user from the upper surface of the upper surface of the upper reference alignment assembly down to a body surface on which at least the lower reference alignment assembly is placed.

[0017] Some embodiments include a tracking system comprising a tracking probe assembly including a probe shaft with a pressable sliding shaft tip and a mounting member having a trackable moving stray marker at one end of the probe shaft and a plurality of depth limiters at the opposite end of the probe shaft. Additionally, some embodiments include a dynamic reference frame coupled to the probe shaft adjacent to the mounting member.

[0018] Some embodiments also include at least one depth limiter reference. In some embodiments, the plurality of depth limiters include a series of concentrically oriented, diameter-varying protrusions. In some embodiments, one or more of the plurality of depth limiters are configured to actuate a pressable sliding shaft tip. Furthermore, in some embodiments, one or more of the plurality of depth limiters are configured to actuate a pressable sliding shaft tip when pressed against a depth limiter reference having a specific inner diameter, the actuation being configured to provide a recognizable deflection that can track moving stray markers.

[0019] In some embodiments, the probe shaft is spring-loaded. In some embodiments, the dynamic reference frame includes at least one tracking mark. In some embodiments, the dynamic reference frame includes four tracking marks, wherein two of the four tracking marks extend to one side of the probe shaft, and two of the four tracking marks extend to opposite sides of the probe shaft. Some other embodiments also include asymmetrical protrusions configured to engage with corresponding slots of the depth limiter reference.

[0020] In some embodiments of the invention, the engagement of the asymmetric protrusion with the corresponding groove of the depth limiter reference enables the system to register the unique orientation of the coordinate axes of the depth limiter reference and / or detect how the depth limiter reference rotates and translates in 3D space between one or more registrations.

[0021] Some additional embodiments include a reference assembly comprising a lower reference alignment assembly and a complementary upper reference alignment assembly, wherein the lower reference alignment assembly is configured to be coupled to an anatomical structure, and the upper reference alignment assembly is configured to align to at least a portion of the lower reference assembly using at least one characteristic of both the lower and upper reference alignment assemblies. In some embodiments, the at least one groove is located in the upper reference alignment assembly, and the at least one groove is configured to be tracked by a tracking probe to determine the unique identity of the system and to interpret its position and orientation in space.

[0022] In some embodiments, the tracking system includes a radiopaque marker configured to be visually observable using an X-ray source or imager, wherein the radiopaque marker is at least partially embedded in at least one of a lower reference alignment assembly and a complementary upper reference alignment assembly. In some embodiments, the at least one feature includes at least one magnet. In some other embodiments, the at least one feature includes at least one protrusion configured to at least partially insert into or mate with at least one mating hole, and the at least one protrusion extends from a mating surface of the lower reference alignment assembly, and further, the at least one mating hole is positioned through a mating surface of the upper reference alignment assembly.

[0023] Some embodiments include a tracking system comprising a tracking probe assembly including a probe shaft with a pressable sliding shaft tip and a mounting member having a trackable moving stray marker at one end of the probe shaft and a plurality of depth limiters at the opposite end of the probe shaft. Additionally, some embodiments include a dynamic reference frame coupled to the probe shaft adjacent to the mounting member, and a lower reference alignment assembly and a complementary upper reference alignment assembly. In some embodiments, the lower reference alignment assembly is configured to be coupled to an anatomical structure, and the upper reference alignment assembly is configured to be aligned to at least a portion of the lower reference assembly using embedded or coupling elements of the lower and upper reference alignment assemblies. Furthermore, some embodiments include at least one recess located in the upper reference alignment assembly, wherein the at least one recess is configured to be tracked by the tracking probe assembly. Additionally, some embodiments of the tracking system include a radiopaque marker configured to be visually observable using an X-ray source or imager, wherein the radiopaque marker is at least partially embedded in at least one of the lower reference alignment assembly and the complementary upper reference alignment assembly. In some embodiments, the at least one embedded or coupled element includes at least one magnet. In other embodiments, the at least one embedded or coupled element includes at least one protrusion configured to at least partially insert into or mate with at least one mating hole, wherein the at least one protrusion extends from a mating surface of the lower reference alignment assembly, and the at least one mating hole is positioned through a mating surface of the upper reference alignment assembly.

[0024] Some embodiments include a marking system comprising a lower reference alignment assembly and a complementary upper reference alignment assembly, wherein the lower reference alignment assembly is configured to be coupled to an anatomical structure, and the upper reference alignment assembly is configured to be aligned to at least a portion of the lower reference assembly, and the radiopaque marking is configured to be visually observable using an X-ray source or imager and extends from the complementary upper reference alignment assembly.

[0025] In some embodiments, the radiopaque markers include three radiopaque markers. In some other embodiments, the radiopaque markers are positioned at the corners of the upper reference alignment assembly. In some embodiments, the lower reference alignment assembly and / or a complementary upper reference alignment assembly includes a slot. In some other embodiments, the upper surface of the upper reference alignment assembly includes a recess or contour configured to be detected by the tracking probe axis or tip.

[0026] In some embodiments, the lower reference alignment assembly and the complementary upper reference alignment assembly are configured to be at least partially aligned and coupled at an interface via a surgical drape or surgical towel, wherein the interface includes at least a portion of the surgical drape or surgical towel positioned between at least a portion of the complementary upper reference alignment assembly and the lower reference alignment assembly.

[0027] Some embodiments also include a tracking probe assembly comprising a probe axis and at least one coupled dynamic reference frame, the dynamic reference frame including an optically trackable marker.

[0028] Some embodiments include an anatomical analysis method comprising providing at least one trackable surgical tool, the trackable surgical tool including a tool dynamic reference frame and at least one trackable marker, wherein the at least one trackable surgical tool is configured such that any fixed or moving portion of the at least one trackable surgical tool can be registered in 3D space. In some embodiments, the method includes providing at least one 3D tracking camera or imaging system configured to track at least one trackable marker. In some embodiments, the method includes providing a topological optical surface registration system. In some embodiments, the method includes providing an extendable contour element coupled to at least a portion of a patient. In some other embodiments, the method includes providing an electromechanical 3D tracking system, wherein the electromechanical 3D tracking provides a system including at least one physical coupling probe, wherein the at least one physical coupling probe is configured to be tracked in 3D space while coupled to an extendable contour element and / or at least a portion of the patient, and to trace at least a portion of the patient's anatomical structures. In some embodiments, the method includes registering the location of one or more reference markers inside or outside the surgical site of the patient. In some additional embodiments, the method includes registering the contour of at least a portion of the patient using the extendable contour element. In some other embodiments, the method includes providing a processor and a memory coupled to the processor, wherein the memory stores anatomical contour measurement instructions executable by the processor to track the 3D coordinates of one or more reference markers. In some embodiments, the processor-executable instructions include outputting an anatomical imaging analysis of at least a portion of the patient on a display, and one or more anatomical landmarks registered by an electromechanical 3D tracking system, the anatomical landmarks being aligned in position and orientation to the registered contour.

[0029] Some embodiments of the present invention include a trackable probe assembly comprising a trackable dynamic reference frame coupled to or integrated into a probe axis, wherein the dynamic reference frame includes at least one marker. Some embodiments include a user-actuable marker coupled to a user-triggerable component, the user-triggerable component including a trigger and at least one probe tip extending from the probe axis.

[0030] In some embodiments, the trigger includes a pressable tab located at one end of a pivotable arm, wherein a user-actuable mark is coupled to the opposite end of the pivotable arm, the pivotable arm being configured and arranged such that the user-actuable mark is rotatable. In some further embodiments, the trigger includes a trigger plate mounted to an extension of a rotatable trigger arm, wherein the user-actuable mark is coupled to the opposite end of the rotatable trigger arm and is configured and arranged to rotate in an arcuate path determined by an angular displacement of the trigger arm following user actuation of the trigger plate.

[0031] In some embodiments, the user-triggerable component includes a double-link arm link coupled to a slidable shaft, wherein a user-actuable marker is coupled to the slidable shaft and configured and arranged to enable movement of a user-actuable marker coaxial with the probe shaft when the double-link arm link is actuated by user actuation of a trigger.

[0032] Some embodiments include an implantable rod analysis system comprising a trackable slider assembly including a handle and a rod engagement assembly. The handle includes a dynamic reference frame mounting arm extending from one end, and the rod engagement assembly is located at the opposite end and configured to slide along a surface of the implantable rod. Some embodiments further include a dynamic reference frame (DRF) coupled to or configured to couple to the DRF mounting arm. Some embodiments include a trackable end cap assembly including a rod mounting assembly and a dynamic reference frame, the rod mounting assembly engaging and securing one end of the implantable rod, the dynamic reference frame including trackable markers.

[0033] In some embodiments, the system further includes a 3D tracking camera or imaging system configured to track the at least one trackable marker, a processor, and a memory coupled to the processor, wherein the memory stores anatomical contour measurement instructions that can be executed by the processor to track the 3D coordinates of at least one fixed or moving marker and output anatomical imaging analysis of at least a portion of the patient and one or more anatomical landmarks and registration contours of the implantable rod on a display.

[0034] Some embodiments include an implantable rod adjustment and measurement system comprising a trackable rod bender assembly including a roller assembly comprising three rollers arranged on a pair of rotatable handles and at least one trackable marker, wherein the roller assembly is capable of clamping a surface of the implantable rod, sliding along the surface of the implantable rod, and / or bending the implantable rod. Some embodiments include a trackable end cap assembly comprising a rod mounting assembly and a dynamic reference frame, the rod mounting assembly engaging and securing one end of the implantable rod, the dynamic reference frame including the trackable marker. In some embodiments, at least one handle includes a coupled dynamic reference frame including at least one trackable marker. Some further embodiments include a 3D tracking camera or imaging system configured to track at least one trackable marker, a processor, and memory coupled to the processor, wherein the memory stores anatomical contour measurement instructions executable by the processor. In some embodiments, the instructions operate a method comprising tracking the 3D coordinates of at least one fixed or moving marker and outputting an anatomical imaging analysis of at least a portion of the patient, one or more anatomical landmarks and registration contours of the implantable rod, and displaying a diagram of the bending of the implantable rod on a display.

[0035] Some embodiments include an assembly comprising an adjustable support including a fixed shoulder at one end and an adjustable channel at the opposite end, wherein the adjustable channel extends at least partially into the fixed shoulder. Furthermore, some embodiments include a first side arm extending from the fixed shoulder and a second side arm extending from the adjustable channel, wherein each of the first and second side arms is configured to couple with a pedicle screw. In some embodiments, the second side arm is configured and arranged to be movable within the adjustable channel such that the distance between the first and second side arms can be adjusted. Some further embodiments include a handle extending from the adjustable support and at least one dynamic reference frame (DRF) coupled to the handle, wherein the DRF includes at least one trackable marker.

[0036] Some embodiments include a system comprising an adjustable support including a fixed shoulder at one end and an adjustable channel at the opposite end, wherein the adjustable channel extends at least partially into the fixed shoulder. Some further embodiments include a first lateral arm extending from the fixed shoulder and a second lateral arm extending from the adjustable channel, wherein each of the first and second lateral arms is configured to couple to a pedicle screw. Some embodiments include a handle extending from the adjustable support and at least one dynamic reference frame (DRF) coupled to the handle, wherein the DRF includes at least one trackable marker, and wherein the second lateral arm is configured and arranged to be movable within the adjustable channel, thereby allowing the distance between the first and second lateral arms to be adjusted. Furthermore, some embodiments include at least one 3D tracking camera or imaging system configured to track at least one trackable marker, a processor, and a memory coupled to the processor. In some embodiments, the memory stores instructions executable by the processor to track the 3D coordinates of one or more trackable markers and output anatomical imaging analysis of at least a portion of the patient, as well as a representation of at least a portion of the components based on the 3D coordinates and one or more anatomical landmarks on a display.

[0037] Some embodiments include a reference system comprising a probe assembly including a trackable dynamic reference frame coupled to or integrated into a probe shaft. Some embodiments include a movable post with a trackable marker slidably positioned within the probe shaft. Some embodiments include at least one probe tip protrusion configured and arranged to engage a mating portion of an implantable mating screw. Some embodiments include a spring-loaded plunger movably positioned within the probe shaft and configured to be actuated against a surface of the mating screw, raising the movable post with the trackable marker to a triggered state defined by the mating of the probe assembly and the mating screw.

[0038] Some embodiments of the invention include an assembly comprising an adjustable support including a fixed shoulder at one end and an adjustable channel at the opposite end, wherein the adjustable channel extends at least partially into the fixed shoulder, and a first side arm extending from the fixed shoulder and a second side arm extending from the adjustable channel, each of the first and second side arms being configured to couple with a pedicle screw. Some further embodiments include at least one adjustable screw interface extending from at least one of the first and second side arms and including a tool-fitting tip configured to engage a screw-fitting attachment including a depth limiter, wherein the second side arm is configured and arranged to be movable within the adjustable channel such that the distance between the first and second side arms can be adjusted.

[0039] Some embodiments also include a handle extending from the adjustable support, and at least one dynamic reference frame (DRF) coupled to the handle, wherein the DRF includes at least one trackable marker.

[0040] In some embodiments, the system includes an assembly comprising an adjustable support including a fixed shoulder at one end and an adjustable channel at the opposite end, wherein the adjustable channel extends at least partially into the fixed shoulder, and a first side arm extending from the fixed shoulder, and further, a second side arm extending from the adjustable channel, each of the first and second side arms being configured to couple with a pedicle screw. Some embodiments include at least one adjustable screw interface extending from at least one of the first and second side arms, wherein the at least one adjustable screw interface includes a tool-fitting tip configured to engage a screw-fitting attachment including a depth limiter. Furthermore, some embodiments include a handle extending from the adjustable support, and at least one dynamic reference frame (DRF) coupled to the handle, wherein the DRF includes at least one trackable marker. In some embodiments, the second side arm is configured and arranged to be movable within the adjustable channel such that the distance between the first and second side arms can be adjusted. Additionally, some embodiments include providing at least one 3D tracking camera or imaging system configured to track at least one trackable marker, and a processor and memory coupled to the processor. In some embodiments, the memory stores instructions executable by a processor to track the 3D coordinates of one or more traceable markers and output an anatomical imaging analysis of at least a portion of the patient on a display, as well as a representation of at least a portion of the components based on the 3D coordinates and one or more anatomical landmarks.

[0041] Some embodiments include a method comprising acquiring at least one X-ray image of a patient, wherein the patient is positioned having at least one dynamic reference frame and at least one trackable marker, the at least one trackable marker being such that any portion of the patient can be registered in 3D space and such that any portion of the acquired X-ray image includes at least one tracked 3D coordinate. Furthermore, the method comprises calculating the position and orientation of at least a portion of the patient based on the at least one X-ray image and the at least one tracked 3D coordinate. Furthermore, the method comprises calculating the 3D coordinates of the at least one X-ray image and scaling them onto a phantom model. Furthermore, the method comprises transforming the 3D coordinates into Cartesian coordinates of the phantom model. Furthermore, the method comprises providing a phantom model mounting assembly including at least one dynamic reference frame. Furthermore, the method comprises positioning at least a portion of the phantom model onto the phantom model mounting assembly based on the position of the at least one dynamic reference frame and one or more Cartesian coordinate systems.

[0042] Some embodiments include a 3D trackable probe system comprising a probe assembly including a trackable dynamic reference frame coupled to or integrated into a probe axis, wherein the dynamic reference frame includes at least one marker. Some embodiments include: a user-actuable marker coupled to a user-triggerable component including a trigger and at least one probe tip extending from the probe axis; and at least one 3D tracking camera or imaging system configured to track the at least one trackable marker. Some embodiments include a processor and a memory coupled to the processor, wherein the memory stores instructions executable by the processor to track the 3D coordinates of one or more trackable markers and calculate the 3D position and orientation of the probe assembly.

[0043] In some embodiments, the trigger includes a pressable tab located at one end of a pivotable arm, wherein a user-actuable tag is coupled to the opposite end of the pivotable arm, the pivotable arm being configured and arranged such that the user-actuable tag can rotate.

[0044] In some embodiments, the trigger includes a trigger plate mounted to an extension of a rotatable trigger arm, wherein the user-actuable mark is coupled to the opposite end of the rotatable trigger arm and configured and arranged to rotate in an arcuate path determined by the angular displacement of the trigger arm after user actuation of the trigger plate.

[0045] In some embodiments, the user-triggerable component includes a double-link arm link coupled to a slidable shaft, wherein a user-actuable marker is coupled to the slidable shaft and configured and arranged to enable movement of a user-actuable marker coaxial with the probe shaft when the double-link arm link is actuated by user actuation of a trigger.

[0046] Some embodiments include a probe assembly comprising a probe shaft including one or more coaxial depth limiters near one end of the probe shaft and a trackable dynamic reference frame integrated or coupled near the opposite end of the probe shaft, wherein one or more of the coaxial depth limiters are configured to be coupled or mate with one or more depth limiter references. Some further embodiments include a movable shaft at least partially slidably positioned within the probe shaft, wherein the movable shaft includes a probe tip at one end and a trackable marker at the opposite end.

[0047] In some embodiments, the probe assembly is configured and arranged such that, during use, the coupling between the probe tip and the body surface and the movement of the movable axis include the movement of the trackable marker away from the body a distance determined by the one or more depth-limiting reference points. In some other embodiments, one or more of the coaxial depth limiters include alignment protrusions configured and arranged to mate, interlock, or couple with complementary slots, cavities, or receptacle slots, cavities, or receptacles of one or more depth limiter references.

[0048] Some embodiments include a system comprising a trackable surgical tool including a dynamic reference frame and at least one trackable marker, wherein the trackable surgical tool is configured such that any fixed or moving portion of the trackable surgical tool can be registered in 3D space. Some embodiments include a processor and a memory coupled to the processor, wherein the memory stores instructions executed by the processor to acquire at least one X-ray image from a patient, wherein the position and orientation of the emitter and detector are known or determined, and the cone imaging volume of the X-ray imager coupled to the processor is determined using the dynamic reference frame mounted on at least one X-ray imager. Furthermore, in some embodiments, the memory stores instructions executed by the processor to record the orientation of the trackable surgical tool and, in response to a calculated position of the trackable surgical tool in the cone imaging volume, visually display a scaled projection of the trackable surgical tool onto at least a portion of the X-ray image displayed on an external display or device.

[0049] Some embodiments include a trackable probe comprising at least one trackable dynamic reference frame (DRF) and at least one movable trackable marker coupled to the DRF, the at least one DRF including at least one trackable marker. Some embodiments include mating protrusions extending from the DRF, the mating protrusions including mating grooves or mating cavities. Some embodiments include at least one probe extension comprising a mating element configured for insertion and / or sliding into the mating groove or cavity.

[0050] In some embodiments, at least one movable trackable marker is positioned to couple to a sliding insert of a mating protrusion. In some embodiments, the at least one movable trackable marker is spring-loaded, wherein the movement of the at least one movable trackable marker is controlled by the spring load.

[0051] Some embodiments include a reference patch comprising a body surface mountable article including a plurality of opaque markers arranged between a plurality of opaque grid lines. In some embodiments, the opaque markers include at least one of color or gray shading, characters, numbers, symbols, and icons. Some embodiments also include an adhesive that at least partially covers one side of the body surface mountable article, said side being intended for coupling to a body surface. Some other embodiments also include at least one opaque liner that at least partially matches one or more of the plurality of opaque markers.

[0052] Some embodiments include a probe assembly comprising a trackable probe and a rod centering fork. The trackable probe includes a trackable dynamic reference frame integrated or coupled to a first end of the probe. The rod centering fork is positioned at a second end of the probe and includes a bifurcated structure configured to engage an implantable or implantable rod. Some embodiments include a pressable shaft at least partially located within the probe, wherein the pressable shaft includes a probe tip at one end and a trackable marker at the opposite end.

[0053] Some embodiments include an adjustable depth limiter positioned adjacent to a first end of the probe, wherein the adjustable depth limiter is configured to control the maximum extension of the pressable shaft and the probe tip. Some embodiments include at least one shaft guide configured to prevent rotation of the pressable shaft;

[0054] Some embodiments also include a spring assembly coupled to a first end of the probe, wherein the spring assembly is configured to spring-load a pressable shaft. In some embodiments, the trackable dynamic reference frame includes at least one coupled trackable marker.

[0055] Some embodiments include an electromechanical 3D tracking system comprising an extendable rope system and two or more ball-and-socket assemblies. The extendable rope system includes two or more extendable ropes retractable or extendable from a reel, each extendable rope extending from a ball-and-socket assembly. Furthermore, some embodiments include at least one position or motion sensor configured to measure the position or motion of each ball-and-socket assembly, and at least one sensor configured to determine the extension length of each extendable rope. Some embodiments include a data acquisition system configured to receive sensor data from at least one position or motion sensor and at least one sensor, and to calculate the motion and / or at least one 3D coordinate of at least a portion of a probe coupled to the extendable rope.

[0056] Some embodiments include an implantable rod manipulator comprising a handle and a dynamic tracking frame positioned extending from a first end of the handle, wherein the dynamic tracking frame includes at least one trackable marker. Some embodiments include a rod interface head positioned extending from a second end of the handle opposite the first end, wherein the rod interface head includes a concave surface configured to couple to an implantable rod or a surface of the implantable rod. Furthermore, some embodiments include a movable sliding tip positioned to extend through the rod interface head. In some embodiments, the movable sliding tip is coupled to a spring-loaded pressable shaft.

[0057] Some embodiments also include a movable trackable marker coupled to a movable sliding tip, wherein the position of the movable trackable marker relative to the first end of the handle depends on at least one of the position of the rod coupled to the rod interface head and the position of the movable sliding tip in the rod interface head.

[0058] Some embodiments include a method that includes positioning a trackable probe in a straight line and / or parallel to the patient's anatomy, and triggering the trackable probe to communicate reference plane initialization. Furthermore, in some embodiments, the method includes calculating a 3D pose of a dynamic reference frame that approximates the patient's anatomical plane, and registering three or more points to establish an anatomical plane on which the acquired data is projected.

[0059] In some embodiments of the method, the dynamic reference frame is attached to the patient. In other embodiments of the method, the dynamic reference frame is coupled to the operating table or an adjacent surface, wherein the dynamic reference frame is adjacent to the patient. Attached Figure Description

[0060] Figure 1 A system for evaluating spinal alignment, local anatomical biomechanics, rod profiles and active rod profile drawing, and benchmark initialization and interactive display of various outputs is shown according to some embodiments of the present invention.

[0061] Figure 2A A representation of a reference patch that can be mounted on a body surface according to some embodiments of the present invention is shown.

[0062] Figure 2B This illustrates what will be visible on X-ray images of patients with the applied film according to some embodiments of the present invention. Figure 2A The reference patch has a non-transparent element.

[0063] Figure 3A A vertebra with a bone mounting reference fixed to bone is shown according to some embodiments of the present invention.

[0064] Figure 3B A component view of a vertebra having a bone mounting reference and a top reference for coupling to the bone mounting reference is shown according to some embodiments of the present invention.

[0065] Figure 3C A vertebra with a bone mounting reference coupled to a top reference is shown according to some embodiments of the present invention.

[0066] Figure 4A The present invention illustrates an assembly or manipulation process for applying a skin surface mounting reference to the posterior skin of a patient when the patient is positioned prone on an operating table.

[0067] Figure 4B A lateral radiograph of a skin reference applied to an anatomical model is shown according to some embodiments of the present invention.

[0068] Figure 4C Annotation vectors are shown according to some embodiments of the present invention. Figure 4B A lateral X-ray photograph of the sample.

[0069] Figure 4D A C-arm-based mounting is shown according to some embodiments of the present invention, which is an X-ray imaging system that can be used for image acquisition and subsequent initialization of reference markers.

[0070] Figure 4E The invention illustrates some embodiments from and Figure 4A and 4B Sample X-ray images of the spine-reference pair at different imaging angles.

[0071] Figure 4F Illustrations of some embodiments of the invention include annotation vectors Figure 4E Sample X-ray images.

[0072] Figure 4GThe diagram illustrates a 3D axis relative to a reference origin, based on the angle between each X-ray image plane, and a displacement vector drawn on each of the 2D X-ray images can be added thereto.

[0073] Figure 4H A system and method for locating a reference in 3D tracking camera coordinates are shown according to some embodiments of the present invention.

[0074] Figure 4I The axes of a 3D acquisition system according to some embodiments of the present invention are shown, wherein, for example... Figure 4H As shown, the unique position and orientation of the reference are registered with this axis.

[0075] Figure 5A An optical tracking system according to some embodiments of the present invention is shown.

[0076] Figure 5B An ultrasonic probe equipped with a tracking dynamic reference frame is shown according to some embodiments of the present invention.

[0077] Figure 5C An assembly or process view of a patient's skin surface covering a vertebra is shown, illustrating a cross-sectional view according to some embodiments of the invention, as a representation of a specific region of the bone anatomy that can be registered to a skin mounting reference.

[0078] Figure 6A Component views or process views are shown for applying skin mounting references and their associated cover plate references according to some embodiments of the present invention.

[0079] Figure 6B A component view of a skin mounting reference and its associated mating reference on a cover sheet, according to some embodiments of the present invention, is shown.

[0080] Figure 6C An embodiment of a skin mounting reference according to some embodiments of the present invention is shown, which is applied to an anatomical phantom in a region outside the surgical site but located in a region of the underlying anatomical structure where it is desired to know its position in 3D tracking coordinates.

[0081] Figure 6D An embodiment of a skin mounting reference according to some embodiments of the present invention is shown, which mates with a reference on the cover across the surgical drape / cloth.

[0082] Figure 7 A baseline component view is shown according to some embodiments of the present invention.

[0083] Figure 8 A baseline component view is shown according to some embodiments of the present invention.

[0084] Figure 9A An assembled skin surface reference with a mating top surface reference is shown according to some embodiments of the present invention.

[0085] Figure 9B Some embodiments of the present invention are shown. Figure 9A The baseline component view.

[0086] Figure 10A A 3D trackable probe equipped with a trackable dynamic reference frame with a substantially rigid attachment is shown according to some embodiments of the present invention.

[0087] Figure 10B Some embodiments of the present invention are shown. Figure 10A A close-up perspective view of the probe's actuation tip and the variable height selector depth limiter.

[0088] Figure 10C The design according to some embodiments of the present invention is shown to be consistent with Figures 10A-10B The probe is compatible with the connector.

[0089] Figure 10D The invention illustrates some embodiments thereof with Figure 10C Specific socket matching Figure 10A The probe.

[0090] Figure 10E The following are illustrations of connectors that mate with sockets according to some embodiments of the present invention. Figure 10A The probe, the connector is designed to be used with... Figure 10D The diagram shows different height selector combinations for the probe.

[0091] Figure 10F A component view of a portion of a probe according to some embodiments of the present invention is shown.

[0092] Figure 10G Some embodiments of the present invention are shown. Figure 10F A partial view of the assembled probe.

[0093] Figure 11A A top perspective view of a skin surface reference that mates with a tarpaulin containing three or more tracked markers, according to some embodiments of the present invention, is shown.

[0094] Figure 11B Some embodiments of the present invention are shown. Figure 11A The baseline side perspective component view.

[0095] Figure 12 A representation of a dynamic reference frame for tracking according to some embodiments of the present invention is shown.

[0096] Figure 13 A CT scan view of a sample cross-section of the spine is shown according to some embodiments of the present invention.

[0097] Figure 14A A tool equipped with a tracking dynamic reference frame is shown according to some embodiments of the present invention.

[0098] Figure 14B-14C Different arrangements according to some embodiments of the present invention are shown. Figure 14A Tools.

[0099] Figures 15A-15C Probes equipped with a tracking dynamic reference frame (DRF) in various configurations are shown according to some embodiments of the present invention.

[0100] Figure 16 A rotary encoder according to some embodiments of the present invention is shown.

[0101] Figure 17A The invention illustrates some embodiments thereof with Figure 16 The encoder uses a pulley-gear system.

[0102] Figure 17B Some embodiments according to the present invention are shown. Figure 17A Gears in a pulley-gear system.

[0103] Figure 18A A perspective view of a rope reel for the pulley-gear system of FIG17 is shown according to some embodiments of the present invention.

[0104] Figure 18B A side view of a rope reel for the pulley-gear system of FIG17 is shown according to some embodiments of the present invention.

[0105] Figures 19A-19C Some embodiments according to the present invention are shown. Figure 23A The ball component of the 3D tracking system.

[0106] Figure 19D-19E Some embodiments of the present invention are shown. Figure 23A The ball-and-socket component of the 3D tracking system.

[0107] Figure 20 A probe of a 3D tracking system according to some embodiments of the present invention is shown.

[0108] Figures 20A-20E Some embodiments of the present invention are shown. Figure 20 A view of the probe components.

[0109] Figures 21A-21B The components of a 3D tracking system including a probe coupled to a rope anchor point are shown according to some embodiments of the present invention.

[0110] Figure 22 An example system for a 3D tracking probe, according to some embodiments of the present invention, is shown.

[0111] Figure 23A An example 3D tracking system according to some embodiments of the present invention is shown.

[0112] Figure 23B A 3D tracking system in a housing according to some embodiments of the present invention is shown.

[0113] Figure 23C Some embodiments of the present invention are shown. Figure 23B A breakdown component view of a 3D tracking system.

[0114] Figure 24-26 A system capable of 3D tracking of a probe according to some embodiments of the present invention is shown.

[0115] Figures 27A-27D This includes representations of 3D tracking methods according to some embodiments of the present invention.

[0116] Figure 28A An example 3D tracking system according to some embodiments of the present invention is shown.

[0117] Figure 28B A computer system is shown, comprising components configured for operating and processing systems according to some embodiments of the present invention.

[0118] Figures 29A-29B A screwdriver with a tracking dynamic reference frame equipped with a screw head registration screwdriver is shown according to some embodiments of the present invention.

[0119] Figure 29C Some embodiments according to the present invention are shown. Figures 29A-29B A close-up perspective view of the screwdriver head and the pressable tip of the screwdriver.

[0120] Figure 29D A cross-sectional view of a screwdriver-screw interface according to some embodiments of the present invention is shown.

[0121] Figure 30A A 3D tracking camera system according to some embodiments of the present invention is shown.

[0122] Figure 30B This includes images of a tracked reference frame according to some embodiments of the present invention.

[0123] Figure 31A 3D tracking camera mounted on a body is shown according to some embodiments of the present invention.

[0124] Figure 32 A method for interpreting the outline of the posterior elements of the spine is shown according to some embodiments of the present invention.

[0125] Figure 33A A pedicle screw according to some embodiments of the present invention is shown.

[0126] Figure 33B A pedicle screw according to another embodiment of the present invention is shown.

[0127] Figure 33C A pedicle screw with a multiaxial tulip-shaped head is shown according to some embodiments of the present invention.

[0128] Figure 33D The design according to some embodiments of the present invention is shown to be similar to Figure 33B Tools for pedicle screw interfaces.

[0129] Figure 33E Some embodiments of the present invention are shown. Figure 33D tools and Figure 33C Visualization of the coupling between screws.

[0130] Figure 33F A screwdriver coupled to a pedicle screw is shown according to some embodiments of the present invention.

[0131] Figure 33G Some embodiments according to the present invention are shown. Figure 33A A top view of the screw.

[0132] Figure 33H Some embodiments according to the present invention are shown. Figure 33B A top view of the screw.

[0133] Figure 33I Some embodiments according to the present invention are shown. Figure 33A A top view of the screw.

[0134] Figure 34 Tools for interfacing with pedicle screws according to some embodiments of the present invention are shown.

[0135] Figures 34A-34F Some embodiments of the present invention are shown. Figure 34 Various views of the tools.

[0136] Figures 35A-35E Various views of a tool for interfacing with a pedicle screw are shown according to some embodiments of the present invention.

[0137] Figure 35F Some embodiments of the present invention are shown. Figures 35A-35E A close-up perspective view of the tool, which does not have a coupled pedicle screw or a tulip-shaped head.

[0138] Figures 36A-36G A tool designed to directly interface with the tulip-shaped head of a pedicle screw according to some embodiments of the present invention is shown.

[0139] Figure 36H-36I Some embodiments of the present invention are shown. Figures 36A-36G The tool does not have a perspective view of the pedicle screw axis.

[0140] Figure 37A-37G Various views of a tool for directly interfacing with two implanted pedicle screws according to some embodiments of the present invention are shown.

[0141] Figure 38 A pedicle screw shaft with a depth limiter is shown according to some embodiments of the present invention.

[0142] Figure 38A Some embodiments of the present invention are shown. Figure 38 A top view of the pedicle screw axis with a depth limiter.

[0143] Figure 38B A screw interface area with a coupling handle is shown according to some embodiments of the present invention.

[0144] Figure 38C The coupling according to some embodiments of the present invention is shown in Figure 38B Screw interface area and Figure 38-38A An exemplary component view between the pedicle screw shafts with a depth limiter.

[0145] Figure 38D-38G The invention illustrates some embodiments thereof with Figure 38-38A Pedicle screw axial coupling with depth limiter Figure 38B A view of the screw interface area.

[0146] Figure 39A A complete perspective view of a device for manipulating bone anatomy and assessing range of motion during surgery, according to some embodiments of the present invention, is shown.

[0147] Figure 39B The foreground references shown are based on some embodiments of the present invention. Figure 39A Another embodiment of the handle of the tool described.

[0148] Figure 39C The above description of some embodiments according to the present invention is shown above. Figure 39A -B describes the bottom view of the embodiment.

[0149] Figure 39D The foregoing has shown some embodiments of the invention. Figures 39A-39C A cross-sectional side view of the tool being described.

[0150] Figure 39E A bottom view of a width adjustment mechanism that allows for variation in the distance between the screw interface positions of a tool, according to some embodiments of the present invention, is shown.

[0151] Figure 39F The above description illustrates some embodiments of the invention. Figure 39A -E is a close-up perspective view of the width adjustment mechanism, threaded fastening knob, and sleeve body of the device described.

[0152] Figure 40A A side view of a spine model with a straight curve and two flexibility assessment tools coupled to the model is shown according to some embodiments of the present invention.

[0153] Figure 40B An embodiment of two flexible assessment devices that interface with a spinal model having a lordotic curve is shown according to some embodiments of the present invention.

[0154] Figure 40C An embodiment of the invention according to some embodiments is shown from a perspective view of a 3D tracking camera.

[0155] Figure 41A Previous descriptions of some embodiments according to the present invention have been shown. Figures 34A-34F A side view of an embodiment of the screw interface component of the flexible evaluation device described in 35A-35E and 36A-36G, 39A-39F and 40A-40C.

[0156] Figure 41B The above description of some embodiments according to the present invention is shown above. Figure 41A Front view of the described embodiment.

[0157] Figure 41C Some embodiments according to the present invention are shown. Figures 41A-41B The equipment, which is equipped with the aforementioned... Figures 39A-39F The flexible evaluation equipment described in 40A-40C.

[0158] Figure 41D A perspective assembly view of a removable screw interface component according to some embodiments of the present invention is shown, illustrating a release tab, a center alignment post, a peripheral alignment pin, a screw interface rod, a side tab extension, and a spring-loaded latch arm.

[0159] Figure 42A Some embodiments according to the present invention are shown. Figures 39A-39F The flexible evaluation equipment of 40A-40C is equipped with a removable screw interface component, which was previously described in Figure 41 and has the following reference. Figures 43A-43F The described adjustable crosslinking device.

[0160] Figure 42B This illustrates a previously discussed method of coupling substantially rigidly to a pedicle screw via engagement with a tulip-shaped head, according to some embodiments of the invention. Figure 42A The described flexible evaluation equipment.

[0161] Figure 42C A second flexible assessment device according to some embodiments of the present invention is shown, which is associated with a spinal segment at a distance from a previously disclosed... Figures 39A-39F The interface at the user-defined distance of the already-cooperated device described in 41A-41D and 42A-42B.

[0162] Figure 42D The foregoing has shown some embodiments of the invention. Figures 39A-39F The two cooperating flexible evaluation devices described in 41A-41D and 42A-42C.

[0163] Figure 42E The foregoing has shown some embodiments of the present invention. Figures 39A-39F The two flexible assessment devices described in 41A-41D and 42A-42D are basically rigidly attached to the spine.

[0164] Figure 42F The foregoing has shown some embodiments of the present invention. Figures 39A-39F The two flexible assessment devices described in 41A-41D and 42A-42F are basically rigidly attached to the spine.

[0165] Figure 42G The foregoing has shown some embodiments of the present invention. Figures 42A-42F The aforementioned spine equipped with instruments.

[0166] Figure 42H The foregoing has shown some embodiments of the present invention. Figure 42A-42G The aforementioned spine equipped with instruments.

[0167] Figure 42I The foregoing has shown some embodiments of the present invention. Figures 42A-42H The aforementioned spine equipped with instruments.

[0168] Figure 42J The foregoing has shown some embodiments of the present invention. Figure 42A-42I The aforementioned spine equipped with instruments.

[0169] Figure 42K The foregoing has shown some embodiments of the present invention. Figure 42A-42J The aforementioned spine equipped with instruments.

[0170] Figures 43A-43D Views of an adjustable crosslinking device according to some embodiments of the present invention.

[0171] Figure 43E-43F A view of an adjustable crosslinking device according to some embodiments of the present invention is shown.

[0172] Figure 44A The illustration shows a bone implantation reference according to some embodiments of the invention, which is equipped with a crossbar and is substantially rigidly fixed to the lamina of the vertebra, as previously discussed. Figures 3A-3C As described.

[0173] Figure 44B A pre-engagement process view of a bone implant reference and a bone reference mating screwdriver according to some embodiments of the present invention is shown, the bone implant reference and the bone reference mating screwdriver being equipped with a DRF and TMSM coupled at the end of the screwdriver to a pressable sliding shaft.

[0174] Figure 44C The illustration shows the engagement of a bone implant reference and a bone reference mating screwdriver according to some embodiments of the invention, the bone reference mating screwdriver being equipped with a DRF and TMSM coupled at the end of the screwdriver to a pressable sliding shaft for tracking.

[0175] Figure 44D A bone implantation reference with a crossbar and a cover, and a screwdriver, is shown according to some embodiments of the present invention.

[0176] Figures 45A-45B The vertebral engagement and rendering process according to some embodiments of the present invention is shown.

[0177] Figures 46A-46B A 3D tracking tool according to some embodiments of the present invention is shown.

[0178] Figure 46C An X-ray imaging and tracking system according to some embodiments of the present invention is shown.

[0179] Figure 46D A virtual overlay of a tracking surgical instrument positioned close to an X-ray detector, according to some embodiments of the invention, is shown on top of an X-ray image of the spine.

[0180] Figure 46E An X-ray imaging and tracking system according to some embodiments of the present invention is shown.

[0181] Figure 46F Examples of embodiments according to the present invention are shown. Figure 46E The image shows a virtual overlay of a surgical instrument positioned close to the transmitter for tracking.

[0182] Figure 46G The invention has shown some embodiments that have been previously presented in Figure 46D-46F The virtual overlay of the surgical instrument is described as a tool position rotated 90 degrees to track the position.

[0183] Figure 47A The components of a tracking end cap according to some embodiments of the present invention are shown.

[0184] Figure 47B The diagram shows components of a tracking slider designed to interface with a rod fixed to a tracking end cap, as described above, according to some embodiments of the invention. Figure 47A As stated above.

[0185] Figure 48A A close-up view of a portion of an end cap according to some embodiments of the present invention is shown.

[0186] Figure 48B The invention illustrates some embodiments thereof. Figure 47A A perspective view of the end cap assembled from the components.

[0187] Figure 48C Some embodiments of the present invention are shown. Figure 48B Side view of the end cap.

[0188] Figures 49A-49C A single-ring rod evaluation device assembly according to some embodiments of the present invention is shown.

[0189] Figure 49D The invention illustrates some embodiments of the invention in relation to previous discussions. Figure 47A and 48A The -48B describes the coupling of the rod and the tracking end cap. Figures 49A-49C Components.

[0190] Figures 50A-50D A fixed base, variable ring, and movable rod evaluation device according to some embodiments of the present invention are shown.

[0191] Figure 50E The diagram illustrates engagement of a rod coupled to an end cap according to some embodiments of the invention. Figures 50A-50D Evaluation equipment consisting of a fixed base, variable ring, and movable rod.

[0192] Figure 51A-51G Various views of a handheld mobile pole profile evaluation device according to some embodiments of the present invention are shown.

[0193] Figure 51H-51IThis illustrates, according to some embodiments of the invention, making the profile of the rod consistent with... Figure 51A-51G A view of the process or method of registering a handheld mobile pole profile evaluation device.

[0194] Figure 52A Components of a TMSM-based implant rod profile assessment device according to some embodiments of the present invention are shown.

[0195] Figure 52B Some embodiments of the invention are shown for coupling to Figure 52A The component has a pressable sliding shaft.

[0196] Figure 52C Some embodiments of the present invention are shown. Figure 52A A top view of the component.

[0197] Figure 52D Some embodiments of the present invention are shown. Figure 52B A close-up perspective view of the pressable sliding axis.

[0198] Figure 53A The following diagram illustrates an evaluation method for the profile of a rod after implantation at the surgical site, according to some embodiments of the invention. Figure 52A and 52B Components of the parts.

[0199] Figure 53B Some embodiments of the present invention are shown. Figure 53A A close-up rear view of a part of the component.

[0200] Figure 53C Some embodiments according to the present invention are shown. Figures 53A-53B A close-up view of the rod interface area of ​​the component.

[0201] Figure 53D The rod interface is shown according to some embodiments of the present invention. Figures 53A-53C Components.

[0202] Figure 53E-53F Some embodiments of the present invention are shown. Figures 53A-53D A close-up view of the traceable DRF portion of the component view.

[0203] Figure 54A A rod profile evaluation device based on electrical conductivity is shown according to some embodiments of the present invention.

[0204] Figure 54B Some embodiments of the present invention are shown. Figure 54A The equipment's centering fork and electrical contact pad.

[0205] Figure 54C-54DThe rod interface is shown according to some embodiments of the present invention. Figure 54B The centering fork of the rod.

[0206] Figure 55A-55I Various views of a manually moving rod bender with 3D tracking according to some embodiments of the present invention are shown.

[0207] Figures 56A-56F Various views of an end cap equipped with a tracking DRF, a pre-fitting rod, and a manual bender equipped with a TMSM are shown according to some embodiments of the present invention.

[0208] Figure 57A A field bender coupled to a rod and equipped with a trigger is shown according to some embodiments of the present invention.

[0209] Figure 57B A field bender equipped with a trigger and coupled to a DRF track of a rod coupled to the spine is shown according to some embodiments of the invention.

[0210] Figure 57C Some embodiments according to the present invention are shown. Figure 57A A close-up component view of the rod.

[0211] Figure 57D It shows Figure 57A The diagram shows a close-up view of the rod interface head of the bender, including a view of the pressable sliding shaft tip in the extended position according to some embodiments of the invention.

[0212] Figure 58 The present invention illustrates a workflow for initializing a skin-mounted or percutaneous reference during surgery using two or more X-ray images, according to some embodiments thereof.

[0213] Figure 59 The present invention illustrates a workflow for initializing one or more bone mounting references placed during surgery using two or more X-ray images taken prior to placement of the bone mounting references.

[0214] Figure 60 The present invention illustrates a workflow for initializing one or more bone mounting references placed during surgery using two or more X-ray images taken after placement of the bone mounting references.

[0215] Figure 61 A method for registering an anatomical reference plane during surgery is shown according to some embodiments of the present invention.

[0216] Figure 62AAn arrangement according to some embodiments of the invention is shown for obtaining information about the profile of the spine by using a tracking probe to track on a body surface.

[0217] Figure 62B A display of a body surface contour obtained by tracking using a 3D tracking probe, according to some embodiments of the present invention, is shown.

[0218] Figure 62C The illustration shows a display of transformed tracking data according to some embodiments of the present invention.

[0219] Figure 62D The following are illustrations with depth translation according to some embodiments of the present invention. Figure 62B-62C The data is displayed.

[0220] Figure 63 The present invention illustrates a workflow for simulating the detection of one or more tracking moving spurious markers (TMSMs) relative to a tool having a dynamic reference frame (DRF) according to some embodiments of the invention.

[0221] Figure 64A A tracking probe assembly according to some embodiments of the present invention is shown.

[0222] Figure 64B The rotating TMSM according to some embodiments of the present invention is shown relative to the aforementioned... Figure 64A The description and calculation of the DRF position on the probe.

[0223] Figure 65A The illustration shows a display of discrete body or bone surface annotations on a cross-sectional image for initializing a patient-specific interpretation of body and bone surface tracing using a 3D tracking probe, according to some embodiments of the present invention.

[0224] Figure 65B A 3D perspective view of cross-sectional annotations from a CT scan is shown according to some embodiments of the present invention.

[0225] Figure 65C A diagram showing coronal projection coordinates according to some embodiments of the present invention is shown.

[0226] Figure 65D A diagram showing sagittal projection coordinates according to some embodiments of the present invention is illustrated.

[0227] Figure 65E The calculated cross-sectional distance between corresponding anatomical landmarks and vertebral centroids according to some embodiments of the present invention is shown.

[0228] Figure 66AA cross-sectional slice of a vertebra (A) along its relative anatomical axis is shown, according to some embodiments of the present invention.

[0229] Figure 66B The illustration shows the initial data of the vertebral body and the patient calculated via bilateral tracer coordinates according to some embodiments of the present invention.

[0230] Figure 67 The workflow for calculating spinal alignment parameters based on intraoperative tracking according to some embodiments of the present invention is illustrated.

[0231] Figure 68 The workflow for obtaining spinal alignment curves using probe-based tracing only within the surgical site, according to some embodiments of the present invention, is illustrated.

[0232] Figure 69 The workflow for obtaining spinal alignment curves using probe-based tracer data across surgical sites, according to some embodiments of the present invention, is illustrated.

[0233] Figure 70 The present invention illustrates a workflow for assessing spinal flexibility during surgery using a flexibility assessment device according to some embodiments thereof.

[0234] Figure 71 A workflow for generating real-time coverage of surgical instruments on intraoperative X-rays is illustrated according to some embodiments of the present invention.

[0235] Figure 72 The workflow for rapidly re-registering a surgical navigation system after screw insertion for navigation / registration, according to some embodiments of the present invention, is illustrated.

[0236] Figure 73A A rod centering fork located at the end of a tool shaft is shown according to some embodiments of the present invention.

[0237] Figure 73B This illustrates a fully engaged rod according to some embodiments of the present invention. Figure 73A fork.

[0238] Figure 74 The present invention illustrates a workflow for evaluating the profile of a rod prior to implantation using two handheld tracking tools according to some embodiments of the invention.

[0239] Figure 75 The present invention illustrates a workflow for evaluating the profile of a rod prior to implantation using a handheld tracking tool and a substantially rigidly fixed ring, according to some embodiments of the invention.

[0240] Figure 76 The workflow for evaluating the profile of a rod after implantation is illustrated according to some embodiments of the present invention.

[0241] Figures 77A-77C Various displays illustrating the interpretation of data generated by evaluating the rod profile after the tube head has been implanted into the surgical site, according to some embodiments of the present invention.

[0242] Figure 78 The workflow for interactively placing a registration bar as an overlay map on a patient image on a display monitor, according to some embodiments of the present invention, is illustrated.

[0243] Figures 79A-79G The process of explaining and calculating the tracking of a rod bending device according to some embodiments of the present invention is shown.

[0244] Figure 80 A workflow for manually bending a rod prior to implantation and providing real-time feedback on its dynamic profile, according to some embodiments of the present invention, is shown.

[0245] Figure 81 A workflow for manually bending a rod prior to implantation is illustrated according to some embodiments of the invention, wherein directional software input projects a dynamic rod profile onto an intraoperative X-ray image.

[0246] Figures 82A-82B The process or method for probe calibration according to some embodiments of the present invention is illustrated.

[0247] Figure 83 The present invention illustrates a workflow for simulating a laser pointer for a user interface system with a non-tracking display using a probe equipped with a trigger, according to some embodiments of the invention.

[0248] Figures 84A-84B The present invention illustrates a workflow for simulating a user interface for a 3D tracking display monitor using a probe equipped with a trigger as a laser pointer according to some embodiments of the invention.

[0249] Figure 85 The workflow of an interface device using a probe equipped with a trigger as an interface device for non-tracking display via a user-defined trackpad simulation, according to some embodiments of the present invention, is illustrated.

[0250] Figures 86A-86D The output of the alignment evaluation according to some embodiments of the present invention is shown.

[0251] Figure 87A A rod with a previously registered profile is shown according to some embodiments of the invention. The rod is fixed to a tracking end cap equipped with a DRF and interfaces with a tracking rod bender.

[0252] Figure 87BThe diagram shows a sagittal projection of a registered rod profile according to some embodiments of the invention.

[0253] Figure 87C The coronal projection of the registered rod profile is shown according to some embodiments of the present invention.

[0254] Figure 87D The position of the central rod profile surface of a rod bender relative to a cross-sectional view of a rod, according to some embodiments of the present invention, is shown.

[0255] Figure 87E A display of a sagittal projection of a registered rod profile according to some embodiments of the present invention is shown.

[0256] Figure 87F The illustration shows a sagittal patient image according to some embodiments of the invention, overlaid with the registered rod profile and a traced rod bender positioned relative to the previously registered rod.

[0257] Figure 87G A sagittal patient image adjusted for surgical planning according to some embodiments of the present invention is shown, overlaid with the registered rod profile and the position of the tracked rod bender relative to the previously registered rod.

[0258] Figure 87H-87I This includes the display of the position of a rod and rod bender on a display monitor, according to some embodiments of the invention.

[0259] Figure 87J-87M This illustration shows a bender and a rod according to some embodiments of the present invention.

[0260] Figure 88A The diagram shows a sagittal projection of a registered rod profile according to some embodiments of the invention, a display of the current position of the rod bender relative to the registered rod profile, a display of the position of the software instruction where the user should place the rod bender, and an anatomical axis label.

[0261] Figure 88B The application of some embodiments of the present invention to the coronal plane is illustrated. Figure 88A The display.

[0262] Figure 88C The diagram illustrates the current position of the center profile drawing surface of a rod and a rod bender according to some embodiments of the invention, the position of the software instruction to place the center profile drawing surface of the rod bender, and a cross-sectional display of the anatomical axis markers.

[0263] Figure 88D The illustration shows a display representation of the current relative position of the handle of a bender according to some embodiments of the invention, which is directly related to the degree of bending induced on a rod of a known diameter.

[0264] Figure 88E A display representation of the relative position of the software instructions of a bender handle (k) according to some embodiments of the present invention is shown, which is directly related to the degree of bending induced on a rod of a known diameter.

[0265] Figure 88F A bending angle display instrument is shown according to some embodiments of the present invention.

[0266] Figure 89 The workflow of matching an adjustable worktable spinal model to mimic alignment parameters from patient-specific imaging is illustrated according to some embodiments of the present invention.

[0267] Figure 90A The illustration shows sagittal and coronal patient images according to some embodiments of the invention, overlaid with sagittal and coronal contour trajectories of the spine, placement of discrete software instructions for adjustable mounts on an anatomical model, and instructions for the coordinates of each of those adjustable mounts to be positioned on the adjustable worktable model.

[0268] Figure 90B An anatomical model assembly disassembly component is shown according to some embodiments of the present invention.

[0269] Figure 90C A fastening interface for an anatomical model is shown according to some embodiments of the present invention.

[0270] Figure 90D An anatomical model of the spine installed according to some embodiments of the present invention is shown.

[0271] Figure 91A A top view of a modular 3D tracking tool according to some embodiments of the present invention is shown, having a straight extension fully engaged in the base of the tool.

[0272] Figure 91B A perspective view of a modular 3D tracking tool according to some embodiments of the present invention is shown, having features as described above. Figure 91A The tool has a base that is not engaged with a straight extension.

[0273] Figure 91C A perspective view of a modular 3D tracking tool according to some embodiments of the present invention is shown, having fully integrated with the aforementioned... Figures 91A-91B The curved extension in the base of the described tool.

[0274] Figures 92A-92B A side view of an adjustable phantom spinal model retainer according to some embodiments of the invention is shown, wherein the vertebral retainer is substantially rigidly engaged with selected vertebrae and pelvis of the model.

[0275] Figure 92C A perspective view of an adjustable phantom spinal model retainer according to some embodiments of the present invention is shown, as previously discussed. Figures 92A-92B The vertebral retainer is substantially rigidly engaged with the selected vertebra and pelvis.

[0276] Figure 92D The foregoing has shown some embodiments of the invention. Figure 92A-92C A perspective view of the adjustable phantom spine model retainer in an upright position via the adjustable base retainer.

[0277] Figure 92E-92F A DRF according to some embodiments of the present invention and a method for attaching the DRF to the preceding information are shown. Figures 92A-92D A perspective view of the mounting components of the base platform of the adjustable phantom spine model retainer.

[0278] Figure 92G-92I Some embodiments of the invention are shown for attachment as previously described. Figure 92A-92F The described perspective view of the base and vertical height adjustment components of the adjustable phantom spine model retainer.

[0279] Figure 92J Some embodiments of the invention are shown for use as previously described. Figure 92A-92I A perspective view of the vertical height indicator of the base mount of the described adjustable phantom spine model retainer.

[0280] Figure 92K Some embodiments of the invention are shown for use as previously described. Figure 92A-92J Front view of the vertical height indicator of the base mount of the described adjustable phantom spine model retainer.

[0281] Figure 92L The invention illustrates some embodiments for use as previously described. Figure 92A-92K A perspective view of the sagittal angle indicator of the pelvic mount of the adjustable phantom spinal model retainer.

[0282] Figure 92M The foregoing has shown some embodiments of the invention. Figure 92A-92L A front view of the sagittal angle indicator of the pelvic mount of the adjustable phantom spinal model retainer.

[0283] Figure 92N The foregoing has shown some embodiments of the present invention. Figure 92A-92M A front view of the sagittal angle indicator of the vertebral retainer of the adjustable phantom spinal model retainer.

[0284] Figure 920 The invention illustrates some embodiments for use as described above regarding Figure 92A-92N A perspective view of the sagittal angle indicator of the vertebral retainer of the adjustable phantom spinal model retainer.

[0285] Figures 92P-92Q Some embodiments of the invention are shown for use as described above. Figure 92A A perspective view of the sagittal angle adjustment component of the vertebral retainer of the adjustable phantom spinal model retainer described in -920.

[0286] Figure 92R-92S The invention illustrates some embodiments for use as described above regarding Figure 92A-92Q A perspective view of the sagittal angle adjustment component of the pelvic mount of the adjustable phantom spinal model retainer.

[0287] Figure 92T-92U Some embodiments of the invention are shown for use as described above. Figure 92A-92S A perspective view of the pelvic angle adjustment component of the vertebral retainer of the adjustable phantom spinal model retainer.

[0288] Figure 92V-92X The invention illustrates some embodiments for use as described above regarding Figure 92A-92U A perspective view of the sagittal angle adjustment component of the vertebral retainer of the adjustable phantom spinal model retainer.

[0289] Figure 92Y The invention illustrates some embodiments for use as previously described. Figure 92A-92X A front view of the vertebral interface component of the adjustable phantom spinal model retainer.

[0290] Figure 92Z The invention illustrates some embodiments for use as previously described. Figure 92A-92Y A perspective view of the vertebral interface component and sagittal angle adjustment component of the adjustable spinal model retainer.

[0291] Figure 92AA The foregoing reference shows some embodiments of the invention. Figure 92A-92Z A perspective view of the adjustable vertebral retainer with a basically rigid connection to the spinal model retainer described above.

[0292] Figure 92AB The foregoing has shown some embodiments of the invention. Figure 92A-92AA A perspective view of the adjustable vertical base retainer of the adjustable phantom spine model retainer.

[0293] Figure 92ACThe foregoing has shown some embodiments of the invention. Figures 92A-92AB A front component view of the adjustable vertical base retainer of the adjustable phantom spine model retainer.

[0294] Figure 92AD The foregoing has shown some embodiments of the invention. Figure 92A-92AC A view of the base platform and front assembly of the adjustable phantom spine model retainer.

[0295] Figure 93A A rear view of the adjustable pedicle screw interface base of the flexible assessment device is shown. The adjustable pedicle screw interface base has a fixed side arm and a side arm with height and angle adjustment.

[0296] Figure 93B The foregoing illustrates some embodiments of the present invention. Figure 93A A side view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm with height and angle adjustment.

[0297] Figure 93C The foregoing has shown some embodiments of the present invention. Figures 93A-93B A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm with height and angle adjustment.

[0298] Figure 93D The foregoing has shown some embodiments of the present invention. Figures 93A-93C A side view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a height and angle adjustable side arm.

[0299] Figure 93E The foregoing has shown some embodiments of the present invention. Figures 93A-93D A front view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm that is adjustable in height and angle.

[0300] Figure 93F The foregoing has shown some embodiments of the present invention. Figures 93A-93E A top view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm that is adjustable in height and angle.

[0301] Figure 93G The foregoing has shown some embodiments of the present invention. Figures 93A-93F A component view of the adjustable pedicle screw interface base of the flexible assessment device, the adjustable pedicle screw interface base having a fixed side arm and a side arm with height and angle adjustment.

[0302] Figure 93H The foregoing has shown some embodiments of the present invention. Figure 93A-93G A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm with height and angle adjustment.

[0303] Figure 93I The foregoing has shown some embodiments of the present invention. Figures 93A-93H A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and a side arm that is adjustable in height and angle.

[0304] Figure 93J The foregoing has shown some embodiments of the present invention. Figure 93A-93I A cross-sectional view of the side arm of the adjustable pedicle screw interface base of the flexible assessment device, the adjustable pedicle screw interface base having a fixed side arm and a side arm that is adjustable in height and angle.

[0305] Figure 94A A side view of an adjustable pedicle screw interface base for a flexible assessment device according to some embodiments of the present invention is shown. The adjustable pedicle screw interface base has a fixed side arm and an angle-adjustable side arm.

[0306] Figure 94B The foregoing has shown some embodiments of the present invention. Figure 94A A top view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and an angle-adjustable side arm.

[0307] Figure 94C The foregoing has shown some embodiments of the present invention. Figures 94A-94B A front view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and an angle-adjustable side arm.

[0308] Figure 94D The foregoing reference illustrates some embodiments of the present invention. Figures 94A-94C A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and an angle-adjustable side arm.

[0309] Figure 94E The foregoing has shown some embodiments of the present invention. Figures 94A-94D The rear view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and an angle-adjustable side arm.

[0310] Figure 94F The foregoing has shown some embodiments of the present invention. Figures 94A-94E A side view of the adjustable pedicle screw interface base of the flexible assessment device, which has a fixed side arm and an angle-adjustable side arm.

[0311] Figure 94G The foregoing has shown some embodiments of the present invention. Figure 94A-94F The front view of the adjustable pedicle screw interface base of the flexible assessment device shows that one of the fixed side arms is not attached to the pedicle screw, while the other side arm with angle adjustment is attached to the pedicle screw.

[0312] Figure 94H The foregoing has shown some embodiments of the present invention. Figure 94A-94G A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, wherein one fixed side arm is not attached to a pedicle screw, while the other side arm with angle adjustment is attached to a pedicle screw.

[0313] Figures 95A-95B A front view of a forward-facing flexible evaluation device according to some embodiments of the present invention is shown in both triggered and untriggered states.

[0314] Figure 95C-95D The foregoing has shown some embodiments of the invention. Figures 95A-95B The rear view of the forward-facing flexible evaluation device in both triggered and non-triggered states.

[0315] Figure 95E-95F The foregoing has shown some embodiments of the invention. Figure 95A-95D The front view of the rear-facing flexible evaluation device in both triggered and non-triggered states.

[0316] Figure 95G The foregoing has shown some embodiments of the invention. Figure 95A-95F The front view of both the front-facing and back-facing flexible evaluation devices.

[0317] Figure 95H The foregoing has shown some embodiments of the invention. Figure 95A-95G Side views of both the front-facing and rear-facing flexible evaluation devices.

[0318] Figure 95I The foregoing has shown some embodiments of the present invention. Figures 95A-95H A cross-sectional view of the trigger mechanism of the handle of the flexible evaluation device.

[0319] Figure 96A The illustration shows front views of both a rear-facing and front-facing flexible assessment device attached to an adjustable pedicle screw interface with an accessory pedicle screw mount according to some embodiments of the present invention.

[0320] Figure 96B The foregoing has shown some embodiments of the present invention. Figure 96A Rear view of both the rear-facing and front-facing flexible assessment device attached to an adjustable pedicle screw interface with an accessory pedicle screw mount.

[0321] Figure 96C The foregoing has shown some embodiments of the present invention. Figures 96A-96B Perspective views of both the rear-facing and front-facing flexible assessment device attached to an adjustable pedicle screw interface with an accessory pedicle screw mount.

[0322] Figure 96D The foregoing has shown some embodiments of the present invention. Figures 96A-96C Side views of both the rear-facing and front-facing flexible assessment device attached to an adjustable pedicle screw interface with an accessory pedicle screw mount.

[0323] Figure 96E The foregoing has shown some embodiments of the present invention. Figures 96A-96D Top view of both the rear-facing and front-facing flexible assessment device attached to an adjustable pedicle screw interface with an accessory pedicle screw mount.

[0324] Figure 96F-96H The foregoing illustrates some embodiments of the present invention. Figures 96A-96E A perspective view of the adjustable pedicle screw interface having an embedded screw fastener and an auxiliary pedicle screw mounting component.

[0325] Figures 96I-96J The foregoing has shown some embodiments of the present invention. Figures 96A-96H A perspective view of an adjustable pedicle screw interface having an embedded screw-fit fastener and an attached pedicle screw mount, wherein the pedicle screw interface of the side arm is not engaged with the pedicle screw.

[0326] Figure 96K-96L The foregoing has shown some embodiments of the present invention. Figure 96A-96JAn exploded assembly view of the adjustable pedicle screw interface having an embedded screw-fit fastener and an attached pedicle screw mount, wherein the pedicle screw interface at the distal end of the side arm includes a rod extension for engaging with the tulip-shaped head of the pedicle screw.

[0327] Figure 96M The foregoing has shown some embodiments of the present invention. Figure 96A-96L A perspective view of an adjustable pedicle screw interface having an embedded screw-fit fastener and an associated pedicle screw mount, wherein the pedicle screw interface at the distal end of the side arm includes a rod extension for engaging with the tulip-shaped head of the pedicle screw.

[0328] Figure 96N The present invention illustrates some embodiments having, as previously stated... Figure 96A-96M Rear view of the adjustable pedicle screw interface in the triggered state, facing backwards, for a flexible assessment device.

[0329] Figure 960 The illustration shows a side view of a flexible assessment device with adjustable pedicle screw interfaces, facing both rear-facing and front-facing, according to some embodiments of the invention. The pedicle screw interfaces are substantially rigidly fixed in their orientation relative to each other, while the device is substantially rigidly engaged with the vertebra, as previously discussed. Figure 96A-96N As stated above.

[0330] Figure 96P The illustration shows perspective views of a flexible assessment device with rear-facing and anterior-facing adjustable pedicle screw interfaces according to some embodiments of the invention. The pedicle screw interfaces are substantially rigidly fixed in their orientation relative to each other, as previously discussed. Figure 96A As stated in -960.

[0331] Figure 96Q The foregoing has shown some embodiments of the present invention. Figures 96A-96P A side view of the lower half of the side arm component of the flexible assessment device, which is essentially rigidly linked to each other and engages with the vertebrae.

[0332] Figure 96R The foregoing has shown some embodiments of the present invention. Figure 96A-96Q A perspective view of the lower half of the side arm component of the flexible assessment device, which is essentially rigidly linked to each other and engages with the vertebrae.

[0333] Figure 96S The foregoing has shown some embodiments of the present invention. Figure 96A-96R A top view of the lower half of the side arm component of the flexible assessment device, which is essentially rigidly linked to each other and engages with the vertebrae.

[0334] Figures 97A-97BA side view of an extended side arm of a flexible assessment device, which is substantially rigidly attached to and unattached to pedicle screws, according to some embodiments of the present invention, is shown.

[0335] Figure 97C The foregoing has shown some embodiments of the invention. Figures 97A-97B A top view of the extended side arm of the flexible evaluation device.

[0336] Figure 97D-97E The foregoing has shown some embodiments of the invention. Figures 97A-97C A cross-sectional view of the extended side arm of the flexible evaluation device that is rigidly attached to the pedicle screw.

[0337] Figure 97F The foregoing has shown some embodiments of the present invention. Figures 97A-97E An exploded view of the extended adjustable screw interface of the flexible evaluation device, which is basically rigidly attached to the pedicle screw.

[0338] Figure 97G The foregoing has shown some embodiments of the present invention. Figures 97A-97F Side view of the extended adjustable screw interface of the flexible evaluation device, which is basically rigidly attached to the pedicle screw.

[0339] Figure 97H The foregoing illustrates some embodiments of the present invention. Figure 97A-97G A perspective view of the adjustable screw interface of the flexible evaluation device, which is basically rigidly attached to the pedicle screw.

[0340] Figure 97I As described above, this is based on some embodiments of the present invention. Figures 97A-97H A side view of the adjustable screw interface of the flexible assessment device, which is basically rigidly attached to the pedicle screw.

[0341] Figure 97J The foregoing illustrates some embodiments of the present invention. Figure 97A-97I A front view of the adjustable screw interface of the flexible assessment device, which is basically rigidly attached to the pedicle screw.

[0342] Figure 97K The foregoing has shown some embodiments of the present invention. Figures 97A-97J A top view of the adjustable screw interface of the flexible assessment device, which is rigidly attached to the pedicle screw.

[0343] Figure 97L As described above, this is based on some embodiments of the present invention. Figure 97A-97KRear view of the adjustable screw interface of the flexible assessment device, which is basically rigidly attached to the pedicle screw.

[0344] Figures 98A-98B A front view of a rod profile registration tool in an active and inactive trigger state is shown according to some embodiments of the present invention.

[0345] Figure 98C The foregoing has shown some embodiments of the invention. Figures 98A-98B A side view of the rod profile registration tool.

[0346] Figure 98D The foregoing has shown some embodiments of the invention. Figures 98A-98C A perspective view of the rod profile registration tool.

[0347] Figure 98E-98F The foregoing has shown some embodiments of the invention. Figures 98A-98D A perspective view of the triggering mechanism of the rod profile registration tool.

[0348] Figure 98G The foregoing has shown some embodiments of the invention. Figures 98A-98F A side view of the triggering mechanism of the rod profile registration tool.

[0349] Figure 98H The foregoing has shown some embodiments of the present invention. Figure 98A-98G The side view of the coordinate reference tool in an inactive trigger state.

[0350] Figure 98I The foregoing has shown some embodiments of the present invention. Figures 98A-98H The side view of the coordinate reference tool in the active triggered state.

[0351] Figure 98J The foregoing has shown some embodiments of the present invention. Figure 98A-98I The front view of the coordinate reference tool in an inactive trigger state.

[0352] Figure 98K The foregoing has shown some embodiments of the present invention. Figure 98A-98J The front view of the coordinate reference tool in the active triggered state.

[0353] Figure 98L The foregoing has shown some embodiments of the present invention. Figure 98A-98K The side view of the coordinate reference tool in an inactive trigger state.

[0354] Figure 98M The foregoing has shown some embodiments of the present invention. Figure 98A-98L The side view of the coordinate reference tool in the active triggered state.

[0355] Figure 98N The foregoing has shown some embodiments of the present invention. Figure 98A-98M A cross-sectional view of the coordinate reference tool in an inactive trigger state.

[0356] Figure 980-98S The foregoing has shown some embodiments of the invention. Figure 98A-98N A perspective view of the rod attached to the coordinate reference tool and the rod profile registration tool that engages with the rod.

[0357] Figure 98T-98V The foregoing has shown some embodiments of the invention. Figure 98A-98S A perspective view of the rod profile registration tool with the reversible DRF mounting mechanism.

[0358] Figure 99A A front view of a rod profile registration tool attachment in an inactive trigger state is shown according to some embodiments of the present invention.

[0359] Figure 99B The foregoing has shown some embodiments of the invention. Figure 99A The front view of the rod profile registration tool attachment in the active trigger state.

[0360] Figure 99C The foregoing illustrates some embodiments of the invention. Figures 99A-99B A perspective view of the rod profile registration tool attachment in an inactive trigger state.

[0361] Figure 99D The foregoing has shown some embodiments of the invention. Figures 99A-99C Side view of the rod profile registration tool accessory.

[0362] Figure 99E-99F A rear view of a rod bender according to some embodiments of the present invention is shown, having as previously described... Figures 99A-99D The aforementioned rod profile registration tool accessory is mounted on the rod bender.

[0363] Figure 99G-99H The foregoing has shown some embodiments of the invention. Figures 99A-99F The rear perspective view of the rod bender, wherein the rod profile registration tool attachment is mounted on the rod bender.

[0364] Figure 99I-99J The foregoing has shown some embodiments of the invention. Figures 99A-99HA side view of the rod bender, wherein a rod profile registration tool attachment is mounted on the rod bender, and the trigger is in an active and inactive state.

[0365] Figure 99K-99L A perspective view of a rod bender with a rod profile registration tool attachment mounted on a rod bender, according to some embodiments of the present invention, is shown, wherein the rod bender actively profiles a rod mounted on a coordinate reference tool, as previously described. Figure 99A-99J As stated above.

[0366] Figure 99M-99N A perspective view of a rod bender having a rod profile registration tool attachment mounted on a rod bender, according to some embodiments of the present invention, is shown, wherein the rod bender attachment actively traces the profile of a rod mounted to a coordinate reference tool, as previously described. Figure 99A-99L As stated above.

[0367] Figure 990 A side view of a rod bender with a rod profile registration tool attachment mounted on a rod bender, according to some embodiments of the present invention, is shown, wherein the rod bender attachment actively traces the profile of a rod mounted to a coordinate reference tool, as previously described. Figure 99A-99N As stated above.

[0368] Figure 100A A rear view of a 3D tracking tool with a rotation trigger mechanism and a tool in an inactive state is shown, according to some embodiments of the present invention.

[0369] Figure 100B The foregoing has shown some embodiments of the invention. Figure 100A A side view of a 3D tracking tool with a rotation trigger mechanism and in an inactive state.

[0370] Figure 100C The foregoing has shown some embodiments of the invention. Figure 100A-100B The front view of a 3D tracking tool with a rotation trigger mechanism and the tool in an inactive state.

[0371] Figure 100D The foregoing has shown some embodiments of the invention. Figure 100A-100C The description includes a 3D tracking tool with a rotation trigger mechanism and a rear view of the tool in an active state.

[0372] Figure 100E The foregoing has shown some embodiments of the invention. Figure 100A-100D The description includes a 3D tracking tool with a rotation trigger mechanism and a side view of the tool in an active state.

[0373] Figure 100FThe foregoing has shown some embodiments of the invention. Figure 100A-100E The description includes a 3D tracking tool with a rotation trigger mechanism and a front view of the tool in an active state.

[0374] Figure 101A A front view of a 3D tracking tool with a linear triggering mechanism and a tool in an inactive state is shown, according to some embodiments of the present invention.

[0375] Figure 101B The foregoing has shown some embodiments of the invention. Figure 101A The description includes a 3D tracking tool with a linear trigger mechanism and a front view of the tool in an active state.

[0376] Figure 101C The foregoing illustrates some embodiments of the invention. Figure 101A-101B The description includes a 3D tracking tool with a linear trigger mechanism and a rear view of the tool in an inactive state.

[0377] Figure 101D The foregoing has shown some embodiments of the invention. Figure 101A-101C The description includes a 3D tracking tool with a linear trigger mechanism and a rear view of the tool in an active state.

[0378] Figure 101E The foregoing has shown some embodiments of the invention. Figure 101A-101D The description includes a 3D tracking tool with a linear trigger mechanism and a cross-sectional view of the tool in an inactive state.

[0379] Figure 101F The foregoing has shown some embodiments of the invention. Figure 101A-101E The description includes a 3D tracking tool with a linear trigger mechanism and a cross-sectional view of the tool in an inactive state.

[0380] Figure 101G The foregoing has shown some embodiments of the invention. Figure 101A-101F The description includes a front view of a 3D tracking tool that does not have a trigger sleeve but has a linear trigger mechanism (oriented for left-handed dominant users) and is in an inactive state.

[0381] Figure 101H The foregoing has shown some embodiments of the invention. Figure 101A-101G The description includes a 3D tracking tool without a trigger sleeve and with a linear trigger mechanism (oriented for left-handed dominant users), and a rear view of the tool in an inactive state.

[0382] Figure 101I The foregoing has shown some embodiments of the invention. Figure 101A-101HThe description includes a 3D tracking tool with a linear trigger mechanism and a side view of the tool in an inactive state.

[0383] Figure 101J The foregoing has shown some embodiments of the invention. Figure 101A-101I The description includes a 3D tracking tool with a linear triggering mechanism and a side view of the tool in an active state.

[0384] Figure 101K The foregoing has shown some embodiments of the invention. Figure 101A-101J A component view of a 3D tracking tool with a linear triggering mechanism.

[0385] Figure 101L-101O The foregoing illustrates some embodiments of the invention. Figure 101A-101K A perspective view of the trigger sleeve of a 3D tracking tool with a linear triggering mechanism.

[0386] Figure 101P The foregoing has shown some embodiments of the invention. Figure 101A-101O A component view of the 3D tracking tool with a linear trigger mechanism, wherein the trigger sleeve is oriented for left-handed dominant users.

[0387] Figure 101Q The foregoing has shown some embodiments of the invention. Figure 101A-101P A component view of the 3D tracking tool with a linear trigger mechanism, wherein the trigger sleeve is oriented for a right-handed dominant user.

[0388] Figure 102A The illustration shows a side view of a 3D tracking tool that engages with an externally mating bone mounting reference according to some embodiments of the present invention.

[0389] Figure 102B The foregoing has shown some embodiments of the invention. Figure 102A The rear view of the 3D tracking tool described in relation to the externally fitted bone mounting reference.

[0390] Figure 102C The foregoing has shown some embodiments of the invention. Figure 102A-102B A side view of a 3D tracking tool that engages with an externally fitted bone mounting reference.

[0391] Figure 102D The foregoing has shown some embodiments of the invention. Figure 102A-102C A perspective view of the components of a 3D tracking tool that does not engage with an externally mating bone mounting reference.

[0392] Figure 102E The foregoing has shown some embodiments of the invention. Figure 102A-102D A side view of the 3D tracking tool that engages with an external bone mounting reference.

[0393] Figure 102F A front component view of a 3D tracking tool according to some embodiments of the present invention is shown, which is not related to the previous descriptions. Figure 102A-102E The external fitting bone mounting reference joint is described.

[0394] Figure 102G The foregoing has shown some embodiments of the invention. Figure 102A-102F Perspective view of the externally fitted bone mounting reference.

[0395] Figure 102H The foregoing has shown some embodiments of the invention. Figure 102A-102G A side view describing the external fitting bone mounting reference.

[0396] Figure 102I The foregoing has shown some embodiments of the invention. Figures 102A-102H A perspective view describing the external fitting bone mounting reference.

[0397] Figure 102J The foregoing has shown some embodiments of the invention. Figure 102A-102I A top view of the external fitting bone mounting reference.

[0398] Figure 102K The foregoing has shown some embodiments of the invention. Figure 102A-102J A side view of the bone mounting reference for external fitting described.

[0399] Figure 102L The foregoing has shown some embodiments of the invention. Figure 102A-102K A perspective view describing the external fitting bone mounting reference.

[0400] Figure 102M The foregoing has shown some embodiments of the invention. Figure 102A-102L A perspective view of a 3D tracking tool that engages with a bone mounting reference that does not require external fitting.

[0401] Figure 102N The foregoing has shown some embodiments of the invention. Figure 102A-102M A cross-sectional view of the trigger mechanism of a 3D tracking tool for engaging with an external bone mounting reference.

[0402] Figure 102O-102P The foregoing has shown some embodiments of the invention. Figure 102A-102N The component view of the 3D tracking tool described in conjunction with the external bone mounting reference.

[0403] Figure 103A A front view of a 3D tracking tool that mates with an internal bone mounting reference according to some embodiments of the present invention is shown.

[0404] Figure 103B The foregoing has shown some embodiments of the invention. Figure 103A A side view of the 3D tracking tool described in relation to the internal bone mounting reference.

[0405] Figure 103C The foregoing has shown some embodiments of the invention. Figure 103A-103B The rear view of the 3D tracking tool described in relation to the internal bone mounting reference.

[0406] Figure 103D-103F The foregoing has shown some embodiments of the invention. Figure 103A-103C A perspective view of the 3D tracking tool described in relation to the internal mate bone mounting reference, as shown in its various mating trigger states.

[0407] Figure 103G The foregoing has shown some embodiments of the invention. Figure 103A-103F The front view of the 3D tracking tool described is shown in the figure, which is in perfect alignment with the internal bone mounting reference.

[0408] Figure 103H The foregoing has shown some embodiments of the invention. Figure 103A-103G The side view of the 3D tracking tool described in the figure, which is fitted with the internal bone mounting reference, shows the two devices in perfect fit.

[0409] Figure 103I The foregoing has shown some embodiments of the present invention. Figures 103A-103H The rear view of the 3D tracking tool that mates with the internal bone mounting reference is shown in the figure, with the two devices fully mated.

[0410] Figure 103J The foregoing has shown some embodiments of the invention. Figure 103A-103I A perspective view of the components of the internal fitting bone mounting reference.

[0411] Figure 103K The foregoing has shown some embodiments of the invention. Figure 103A-103J A side view describing the internal fitting bone mounting reference.

[0412] Figure 103L-103O The foregoing has shown some embodiments of the invention. Figure 103A-103K A perspective view describing the internal fitting bone mounting reference.

[0413] Figure 103P The foregoing has shown some embodiments of the invention. Figure 103A-1 030 is a bottom view of a 3D tracking tool that mates with the internal bone mounting reference.

[0414] Figure 103Q The foregoing has shown some embodiments of the invention. Figure 103A-103P A perspective view of a 3D tracking tool that mates with the internal bone mounting reference.

[0415] Figure 104A A front view of a 3D tracking tool according to some embodiments of the present invention is shown, which engages with a fastener having a depth limiter interface, wherein the device shown in the figure is not engaged.

[0416] Figure 104B The foregoing has shown some embodiments of the invention. Figure 104A A side view of a 3D tracking tool that mates with a fastener having a depth limiter interface, where the device shown in the figure is not mated.

[0417] Figure 104C The foregoing has shown some embodiments of the invention. Figure 104A-104B The rear view of the 3D tracking tool described, which mates with a fastener having a depth limiter interface, with the device not mated as shown in the figure.

[0418] Figure 104D The foregoing has shown some embodiments of the invention. Figure 104A-104C The front view of a 3D tracking tool that mates with a fastener having a depth limiter interface is described, with the device not mated as shown in the figure.

[0419] Figure 104E The foregoing has shown some embodiments of the invention. Figure 104A-104D A side view of a 3D tracking tool that mates with a fastener having a depth limiter interface, as shown in the figure.

[0420] Figure 104F The foregoing illustrates some embodiments of the invention. Figure 104A-104E The rear view of a 3D tracking tool that mates with a fastener having a depth limiter interface is described, with the device mating as shown in the figure.

[0421] Figure 104G The foregoing has shown some embodiments of the invention. Figure 104A-104F A perspective view of a 3D tracking tool that mates with a fastener having a depth limiter interface, with the device mating as shown in the figure.

[0422] Figure 104H The foregoing has shown some embodiments of the invention. Figure 104A-104G A perspective view of the mating interface between the described 3D tracking tool and the fastener with a depth limiter interface, wherein the device shown in the figure is not mated.

[0423] Figure 104I The foregoing illustrates some embodiments of the present invention. Figure 104A-104H A perspective view of the 3D tracking tool that mates with a fastener having a depth limiter interface, wherein the device mates as shown in the figure.

[0424] Figure 104J The foregoing has shown some embodiments of the invention. Figure 104A-104I A side view of the 3D tracking tool that mates with a fastener having a depth limiter interface, wherein, as shown, the device mates and engages with a vertebra having an implant rod.

[0425] Figure 105A A perspective view of an adjustable pedicle screw interface base of a flexible assessment device according to some embodiments of the present invention is shown, wherein a fixed side arm and a side arm having height and angle adjustment are provided, and wherein the device engages with a fastener having a depth limiter engagement interface.

[0426] Figure 105B The foregoing has shown some embodiments of the invention. Figure 105A The front view of the adjustable pedicle screw interface base of the flexible assessment device shows one fixed side arm and one side arm with height and angle adjustment, and the device mates with a fastener having a depth limiter interface.

[0427] Figure 105C The foregoing has shown some embodiments of the invention. Figure 105A-105B The rear view of the adjustable pedicle screw interface base of the flexible assessment device shows one fixed side arm and one side arm with height and angle adjustment, and the device is coupled with a fastener having a depth limiter mating interface.

[0428] Figure 105D The foregoing has shown some embodiments of the present invention. Figure 105A-105C A top view of the adjustable pedicle screw interface base of the flexible assessment device, including a fixed side arm and a side arm with height and angle adjustment, and the device mates with a fastener having a depth limiter interface.

[0429] Figure 105E The foregoing has shown some embodiments of the invention. Figure 105A-105D A side view of the adjustable pedicle screw interface base of the flexible assessment device, including a fixed side arm and a side arm with height and angle adjustment, and the device mates with a fastener having a depth limiter interface.

[0430] Figure 105F The foregoing has shown some embodiments of the invention. Figure 105A-105E A perspective view of the adjustable pedicle screw interface base of the flexible assessment device, showing one fixed side arm and one side arm with height and angle adjustment, and the device engaging with one of the fasteners shown in the display, which has a depth limiter engagement interface.

[0431] Figure 105G The foregoing has shown some embodiments of the invention. Figure 105A-105F A perspective view of the flexible assessment device with an adjustable pedicle screw interface base, wherein the device engages with a fastener having a depth limiter mating interface, the joined vertebrae are substantially rigidly linked by an implant rod, and the device is substantially rigidly connected by an auxiliary rod between the screw interface bases.

[0432] Figure 106A A perspective view of a coordinate reference end cap device with a lockable trigger chip is shown according to some embodiments of the present invention.

[0433] Figure 106B The foregoing has shown some embodiments of the invention. Figure 106A Rear view of the coordinate reference end cap device with lockable trigger chip.

[0434] Figure 106C The foregoing has shown some embodiments of the invention. Figure 106A-106B A top view of the coordinate reference end cap device with a lockable trigger chip.

[0435] Figure 106D The foregoing has shown some embodiments of the present invention. Figure 106A-106C A side cross-sectional view of the coordinate reference end cap device having a lockable trigger plate in its active locked state.

[0436] Figure 106E The foregoing has shown some embodiments of the present invention. Figure 106A-106D A side cross-sectional view of the coordinate reference end cap device having a lockable trigger plate in its inactive locked state.

[0437] Figure 106F The foregoing has shown some embodiments of the present invention. Figure 106A-106E A component view of the coordinate reference end cap device with a lockable trigger chip.

[0438] Figure 107A A display interface for analyzing a patient’s profile and displaying spinal alignment parameters from landmarks of interest, according to some embodiments of the present invention, is shown, along with a trackboard display control interface in its active state.

[0439] Figure 107B The foregoing has shown some embodiments of the invention. Figure 107A The aforementioned display interface for analyzing the patient's contours and displaying spinal alignment parameters from landmarks of interest, as well as the trackpad display control interface in its inactive state.

[0440] Figure 107C The foregoing has shown some embodiments of the invention. Figure 107A-107B The interface described includes a display for analyzing the patient's contours and showing spinal alignment parameters from landmarks of interest, as well as a trackpad display control interface and several contour acquisition overlays.

[0441] Figure 107D The foregoing has shown some embodiments of the invention. Figure 107A-107C The interface described includes a display for analyzing patient contours and showing spinal alignment parameters from landmarks of interest, a trackpad display control interface, coverage of several contour acquisitions, and measurement of the latest contour.

[0442] Figure 108A A display interface for analyzing the position and orientation of a flexible evaluation device is shown according to some embodiments of the present invention.

[0443] Figure 108B-108D The foregoing has shown some embodiments of the present invention. Figure 108A The aforementioned display interface for analyzing the position and orientation of a flexibility assessment device, wherein the device is in its active triggered state, and displays the range of motion of the fused vertebrae across all anatomical planes.

[0444] Figure 108E The foregoing has shown some embodiments of the present invention. Figure 108A-108D The aforementioned display interface for analyzing the position and orientation of the flexibility assessment device, wherein the device is in its active triggered state and displays a rendered view of each fused vertebra.

[0445] Figure 108F-108H The foregoing has shown some embodiments of the invention. Figure 108A-108E The display interface used to analyze the position and orientation of the flexible assessment device shows a summary view across all anatomical planes of the range of motion of the vertebrae during the assessment process.

[0446] Figure 109A A display interface for displaying the real-time position of a device for registering rod profiles is shown according to some embodiments of the present invention.

[0447] Figure 109B The foregoing has shown some embodiments of the invention. Figure 109A The aforementioned display interface is used to display the real-time position of the device used for registering the rod profile and for complete tracing of the rod profile.

[0448] Figure 109C-109D The foregoing has shown some embodiments of the invention. Figure 109A-109B The aforementioned display interface with patient images and the coverage of the registration bar contour, which has been adjusted to match the user's target for the patient's contour.

[0449] Figure 110A-110B The present invention illustrates a workflow for adjusting the position of a vertebral retainer for an adjustable model retainer using input from patient imaging, according to some embodiments of the invention.

[0450] Figure 111A-111C A workflow for analyzing and outputting the range of motion results of the conjoined vertebrae during and after flexibility assessment is shown according to some embodiments of the present invention.

[0451] Figure 112A-112C The workflow of the profile of the registration and cover rod and the subsequent adjustment of the rod profile are shown according to some embodiments of the present invention.

[0452] Figure 113 Workflows for filtering stray markers output by a 3D tracking camera, identifying one or more TMSMs equipped with a DRF-triggered tool and having a triggering mechanism, and analyzing whether a TMSM is in an active triggering state are illustrated according to some embodiments of the present invention.

[0453] Figure 114A-114F A workflow for estimating the profile of a rod during and after bending, according to some embodiments of the present invention, is shown.

[0454] Figure 115A A front view of the rod profile and roller surface of a rod bender according to some embodiments of the present invention is shown.

[0455] Figure 115B-115C The foregoing has shown some embodiments of the invention. Figure 115A The front view of the roller surface of the rod bender and the rod profile during the process of drawing the profile of the joined rod.

[0456] Figure 115D The foregoing has shown some embodiments of the invention. Figure 115A-115C The front view of the segmented rod profile of the center rod of the abutment rod bending device is shown at close range.

[0457] Figure 115E The foregoing has shown some embodiments of the invention. Figure 115A-115DThe front view of the adjusted rod profile with estimated profile correction when it is engaged with the central rod drawing profile drawing surface of the rod bender.

[0458] Figure 115F The following are examples illustrating some embodiments of the invention as previously described. Figure 115A-115E A close-up front view of the adjusted rod profile with estimated profile correction when it engages with the central rod drawing profile drawing surface of the rod bender. Specific Implementation

[0459] Before explaining any embodiments of the invention in detail, it should be understood that the invention is not limited in its application to the details of the construction and arrangement of the components set forth in the following description or shown in the following drawings. The invention can have other embodiments and can be practiced or performed in various ways. Moreover, it should be understood that the wording and terminology used herein are for descriptive purposes and should not be considered limiting. The use of “comprising,” “including,” or “having,” and variations thereof herein is intended to include the items listed thereafter and their equivalents, as well as additional items. Unless otherwise specified or limited, the terms “mounted,” “connected,” “supported,” and “coupled,” and variations thereof are used extensively and include both direct and indirect mounting, connection, support, and coupling. Furthermore, “connected” and “coupled” are not limited to physical or mechanical connections or couplings.

[0460] The following discussion is presented to enable those skilled in the art to make and use embodiments of the invention. Various modifications to the illustrated embodiments will be apparent to those skilled in the art, and the general principles herein can be applied to other embodiments and applications without departing from the embodiments of the invention. Therefore, embodiments of the invention are not intended to be limited to the illustrated embodiments, but are accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description will be read with reference to the accompanying drawings, wherein the same elements in the different drawings have the same reference numerals. The drawings are not necessarily drawn to scale, depict selected embodiments, and are not intended to limit the scope of embodiments of the invention. Those skilled in the art will recognize that the examples provided herein have many useful alternatives that fall within the scope of embodiments of the invention.

[0461] As used in this article, "tracked" refers to a specific object that is at least in Figure 4H , Figure 5B , Figure 7-8 , Figure 10A , 10G , Figure 11A-11B , Figures 14A-14C , Figures 15A-15C , Figure 16 , Figures 17A-17B , Figures 18A-18B , Figures 19A-19E , Figure 20 and 20A -20E, Figures 21A-21B , Figure 22 , Figures 23A-23C , Figure 24-26 , Figures 27A-27D , Figures 28A-28B , Figures 29A-29D , Figure 30B , Figure 31 , Figure 38A-38G , Figures 39A-39F , Figure 40A-40C , Figures 41A-41D , Figure 42A-42K , Figures 43A-43F , Figures 44A-44D , Figures 44A-44B , Figure 46A-46G , Figures 47A-47B , Figures 48A-48C , Figures 49A-49D , Figures 50A-50E , Figure 51A-51I , Figures 52A-52D , Figures 53A-53F , Figures 54A-54D , Figure 55A-55I , Figures 56A-56F , Figures 57A-57D , Figures 64A-64B , Figures 73A-73B , Figures 77A-77C , Figures 79A-79G , Figures 82A-82B , Figure 87A-87K , Figures 88A-88F The ability to interface with a tracking device (e.g., one or more 3D tracking optical cameras and / or one or more 3D tracking electromechanical devices) to track the 3D coordinates of the object being tracked relative to the coordinate system of the tracking system. An example of an object being “tracked” is one that has a substantially rigidly attached dynamic reference frame that is being tracked in 3D space.

[0462] As used herein, a Dynamic Reference Frame (hereinafter “DRF”) refers to three or more points (markers) positioned in a uniquely identifiable configuration such that their discrete positions are associated with an object identity. These uniquely arranged marks allow for the computation of both the 3D position and pose of the DRF, and also define a coordinate system relative to the DRF. Furthermore, as used herein, stray marks refer to 3D tracked objects, typically reflective or luminous, that can be visualized by a 3D tracking camera and are not among the marks defining the DRF. Stray marks can be associated with a DRF, and their position, pose, and behavior can be computed relative to one or more DRFs.

[0463] As used herein, a tracked moving spurious tag (TMSM) refers to a spurious tag designed to move relative to other spurious tags or nearby DRFs. Calculations of the TMSM's position and / or movement relative to those other entities can be interpreted to convey information and / or commands to a computer acquisition system.

[0464] As used herein, a probe refers to and / or is defined as a device tracked in a manner known in 3D space by its position, orientation, and identity. Using this information, the system can infer the position and orientation of other points and / or markers on and / or near the tracked object (e.g., tips, axes, unique features, etc.), even if they are not tracked directly and independently.

[0465] As used herein, a reference point is an object primarily used as a reference to another point in space. When a reference point is placed near an object / region of interest, its relative position to the object of interest can be initialized. After initialization, the precise position of the initialized object / region of interest can then be calculated when referencing the reference point's position and orientation in the future. Reference points can have unique surface patterns, in the form of tracing indentations, tracing grooves, and / or mating features to be coupled, such that the 3D position, orientation, and identity of the reference point can be calculated by the acquisition system when interacting with a 3D tracking probe or end effector. Furthermore, reference points are most commonly objects with embedded radiopaque markers that enable visualization and registration of the reference point via radiographic imaging. When "reference marker" is used, it is an equivalent term for "reference point," unless specifically referring to a radiopaque marker embedded within the reference point structure that can be visualized on X-rays.

[0466] As used herein, the term "3D rigid transformation" describes the mathematical operations involved in the computation of matrices containing both rotational and translational transformations. 3D rigid transformations are used when a system needs to transform the relationship of objects from one coordinate axis to another without deforming the objects. For example, instead of referencing the position coordinates and orientation values ​​of a 3D tracking tool to a 3D tracking acquisition system, the 3D tracking tool can be substantially rigidly transformed to the coordinates and orientation of another 3D tracking tool or DRF within the reference scene. Another term used here is "rigid body transformation," which is a synonym.

[0467] As used herein, a pedicle screw is a screw inserted into the anatomical structure of the vertebral vertebrae known as the pedicle. Whenever the screw is mentioned, it is assumed that the system is also compatible with any other screws, fasteners, and / or other surgical implants (e.g., cages, rods, etc.).

[0468] As used herein, a tulip-shaped head is an object attached to a screw head and can be multi-axial or uniaxial within its range of motion. Tulip-shaped heads typically have internal threads that allow fasteners to engage substantially rigidly with the structure. Tulip-shaped heads may also have mating features on their outer walls / surfaces that allow devices to be attached substantially rigidly to the tulip-shaped head. Typically, tulip-shaped heads are designed to accept the insertion of rod implants.

[0469] As used herein, the rod can be any object with a cross-section similar to a circle, but can also be other shapes (e.g., keyhole, semicircle, etc.). The rod can have any length and curvature. The rod can be coupled to a tracked tool and a non-tracked tool. Typically, the rod is inserted into the cavity of a tulip-shaped head and then essentially rigidly secured in place by a cap screw, which is threaded onto the inner wall of the tulip-shaped head.

[0470] As used in this article, "registration" refers to the process by which a 3D tracking tool or object sends information about its state, 3D position, 3D orientation, unique identity, relative position to other objects, or other relevant information to a computer system at any time. For example, "a 3D tracking probe can register the position and identity of a reference" means that the 3D tracking probe can convey to the computer system that a specific reference has a specific position and orientation in 3D space relative to the 3D tracking acquisition system.

[0471] As used in this article, "sagittal" is the anatomical plane that represents a patient's side view, where the patient's upper part (e.g., head) is on the right or left, and the patient's lower part (e.g., feet) is at the opposite end, depending on which side of the patient the view is from, i.e., the left or right half. Depending on whether the patient is supine or prone, the patient's back will be visible at the top or bottom of the view.

[0472] As used herein, “coronal” is an anatomical plane that refers to a top view of the patient in which the upper part of the patient (e.g., head) is at the top or bottom and the lower part of the patient (e.g., feet) is at the opposite end, depending on which side of the patient the view is from, below or above, and which side of the patient appears in the view, whether it is the right or left side.

[0473] As used herein, "axial" refers to an anatomical plane that is a cross-sectional view of the patient in which the posterior part of the patient is at the top or bottom, and the anterior part of the patient is at the opposite end, depending on which side of the patient the view is from, whether the patient is prone or supine. The patient view can also vary depending on whether the view is pointing towards the lower or upper part of the patient. If "transverse" is used, it is an equivalent term to "axial".

[0474] As used herein, a "pressable sliding axis" or "plunger" refers to a pressable, sometimes spring-loaded, sliding axis that is actuated by pressing against a surface, a spring-loaded button, or other mechanical actuation means. A plunger typically has a mechanically linked TMSM (Transmitter-Modifier System) that communicates its position along the plunger relative to stray markers on a nearby DRF (Distributed Tracking Rendering) or other track. The axis is usually coaxial with the 3D tracking tool. The axis does not need to protrude beyond the object, as it can also engage within the object.

[0475] As used herein, the electromechanical 3D tracking system refers to the invention described throughout, wherein the 3D position and orientation of a probe are tracked in space via a mechanical link to an extendable rope that is tracked independently in 3D space. The system includes a rotary encoder for measuring the length of the extendable rope and a sensor for detecting the spherical rotation angle of the rope's trajectory through a ball-and-socket interface.

[0476] As used herein, the spinal alignment parameters for the assessment of partial and / or full-length spinal alignment are compared with each relevant radiographic alignment parameter (e.g., Cobb angle, lumbar lordosis (LL), thoracic kyphosis (TK), C2-C7 sagittal vertical axis (SVA), C7-S1 SVA, C2-S1). The values ​​of SVA, Cervical Vertical Line (CSVL), T1 Pelvic Angle (T1PA), Pelvic Tilt (PT), Pelvic Incidence Angle (PI), Chin-Eyebrow Vertical Angle (CBVA), T1 Tilt, Sacral Tilt (SS), C1-2 kyphosis, C2-C7 kyphosis, C0-C2 kyphosis, C1-C2 kyphosis, PI-LL mismatch, C2-pelvic tilt (CPT), C2-T3 angle, vertebral-pelvic tilt from T1 (T1SPi) and T9 (T9SPi), C0 tilt, mismatch between T1 tilt and cervical kyphosis (T1S-CL), and / or Global Sagittal Angle (GSA) are used to generate the values. Any time alignment assessment or calculation of alignment parameters mentioned in this document can be assumed to be calculated in this section of the specification, along with other parameters not mentioned but known.

[0477] As used herein, 3D tracking acquisition system broadly refers to the use of a 3D tracking system to acquire points in 3D space and register them with specific commands via 3D tracking tools. Key examples of this term include: 1) an optical tracking system, such as a system for surgical navigation (e.g., the NDI Polaris Spectra stereo camera system, such as...). Figure 5A As shown, its tracking tools or objects, such as Figure 12 , Figures 15A-15C (as shown in the figure), and 2) at least in Figure 16 , Figures 17A-17B , Figures 18A-18B , Figures 19A-19E , Figure 20 , Figures 20A-20E , Figures 21A-21B , Figure 22 , Figures 23A-23C , Figure 24-26 , Figures 27A-27D , Figures 28A-28B The electromechanical tracking system described in [reference].

[0478] As used herein, the 3D tracking probe is a handheld or robotically wielded tool that can be tracked in 3D physical space by any 3D tracking acquisition system, such as an optical surgical navigation system (e.g., Figure 5A NDIPolaris stereo camera) or electromechanical 3D tracking system (e.g., Figure 16 , Figures 17A-17B , Figures 18A-18B , Figures 19A-19E , Figure 20 , Figures 20A-20E , Figures 21A-21B , Figure 22 , Figures 23A-23C , Figure 24-26 , Figures 27A-27D , Figures 28A-28B (The tracking system described in [reference]). One embodiment relying on an optical surgical navigation system includes a probe with a substantially rigidly attached 3D tracking DRF. Some embodiments also include a mechanically linked, 3D-tracked moving stray marker (TMSM) mounted on or coupled to a pressable, spring-loaded, and / or user-actuable axis capable of linearly or rotationally (e.g., about a hinge pivot on the probe) actuating the movement of the TMSM.

[0479] As used in this article, an optical 3D tracking system broadly refers to any optical system that can provide a 3D map or image of a scene or calculate the position, orientation, and identity of a trackable object. Figure 5A As shown, an example of an optical 3D tracking system is a surgical navigation system (e.g., NDI Polaris). A stereo camera system (from NDI International, 103 Randall Drive, Waterloo, Ontario, Canada N2V 1C5) can be used to collect similar information, however, similar information can be collected from almost any optical-based 3D tracking system.

[0480] As used herein, skin-mounted references can be directly mounted on the patient's skin surface or percutaneously implanted within the skin. As used herein, drape-fitting references can specifically mate with another reference beneath the surgical drape or any other occlusive material.

[0481] As used herein, a tracking stray marker (“TSM”) refers to an optical 3D tracking stray marker, which is defined as an independent reflective or luminescent marker that is not registered as part of the DRF. This particular stray marker does not exhibit direct movement relative to the dynamic reference marker; however, it can be used as a toggle to send various unique commands to the acquisition unit.

[0482] As used herein, a display monitor refers to any display embodiment capable of visually depicting the output of a system, its feedback system and instructions, its calculations, and other relevant information or settings available.

[0483] As used herein, a “tracking end cap” refers to a 3D tracking object that includes a substantially rigidly attached 3D tracking DRF and can be substantially rigidly attached to a rod or rod-like object. The end cap provides a reference frame for the rod in a manner that establishes the implant’s dynamic coordinate system, while simultaneously tracing, structurally manipulating / contouring its profile, or performing any other evaluation. The term is also used in the form of “tracking end cap equipped with a DRF,” which is synonymous.

[0484] As used herein, a tracked slider refers to a 3D tracked object that comprises a substantially rigidly attached 3D tracking DRF and is capable of recording the profile of a rod by mechanically engaging its surface and tracing along the length of the rod. Slider tools are typically converted to output 3D coordinates and orientation values ​​relative to a 3D tracking end cap tool. The term is also used in the form of "slider tool equipped with DRF"; it is commonly used for evaluating rod profiles.

[0485] As used herein, the acquisition system is synonymous with the term 3D tracking acquisition system described above. Typically, this system is a 3D tracking camera (e.g., NDI Polaris). (A stereo camera) and the computer system that communicates with it.

[0486] As used herein, an end effector is any part of an object that engages with another surface or object in a manner that enables communication or registration of information, including but not limited to: 3D position, 3D orientation, unique identity, physical or identity-based relationship with other objects in the scene, forces applied to the object, or forces experienced by the end effector. An example is the 3D tracking distal tip of a robotic arm.

[0487] As used in this article, tracking refers to a method of acquiring discrete or continuous points along a surface via a 3D tracking probe or object.

[0488] As used herein, the endplate refers to the surface of the vertebral column that intersects with the intervertebral disc and couples to the adjacent vertebrae on the opposite side of the disc. The endplate is a common anatomical landmark used to measure a patient's spinal alignment parameters (such as the Cobb angle), primarily because X-rays of the endplate surface can be used to represent anatomical segments or vectors, based on which two or more endplates can be used to calculate the relative angle between two or more vertebrae (e.g., L1 and S1 endplate measurements can be used to calculate the lumbar lordosis angle of a patient's lumbar spine).

[0489] As used in this paper, pose refers to the orientation of an object relative to another object or a 3D tracking acquisition system. An object's pose can be redundant from multiple perspectives, or it can be unique and identifiable in a way that distinguishes it from other objects. An object's pose is typically output as a 3D orientation value (e.g., quaternion, Euler angle, rotation matrix, vector sequence, etc.).

[0490] As used herein, the term "unique" generally refers to the unique identity of an object, or its distinguishable configuration, location, or orientation. The phrase "unique pattern" as used in this document generally refers to 1) an embedded patterned surface on a ball component in an electromechanical, 3D tracking system (in... Figures 19A-19E , Figures 23A-23C , Figure 25-26 , Figures 27A-27D , Figure 28A (as shown in the figure), or 2) an asymmetric or identifiable arrangement of objects that can be registered in a way that makes the set of objects uniquely identifiable compared to another set of tracked / registered objects.

[0491] As used in this article, a "segment" refers to a specific vertebra within the span of the vertebral column. A segment can refer to any vertebra (e.g., L5, T10, C1, S3, etc.). The abbreviations for the segments of the vertebrae are as follows: lumbar (L), thoracic (T), cervical (C), and sacral (S).

[0492] As used herein, “fully joined” describes two or more objects that are fully linked, mated, coupled, adhered, bonded, fastened, or aligned. Typically, when two or more objects are fully joined, a computer system can record events, collect information, acquire 3D position or orientation, identify one or more objects, receive commands, or output information about the join. Fully joined objects will typically trigger communication or acquisition of specific commands to the computer system for storage.

[0493] As used in this article, "trigger / trigger" describes a button or communication moment that sends a signal to a computer or acquisition system to store data, output calculations or other relevant information, interpret commands, or register the identity of an object.

[0494] Some embodiments of the present invention include a system that allows surgeons to intraoperatively assess and adjust a patient's alignment and biomechanical capabilities. Embodiments of the disclosed system record the patient's local and / or full-length spinal curvature and flexibility. The system also registers instruments and / or implants for assessing and / or manipulating the structure of the spine. The system uses various calculations and algorithms to generate quantitative assessments of the patient's spinal biomechanical quality and custom implants used to enhance these qualities. These quantitative assessments include, but are not limited to, calculated values ​​of various radiographic parameters (e.g., lumbar lordosis, central sacral vertical line, T1 pelvic angle, thoracic kyphosis, Cobb angle, etc.) related to overall and partial alignment of the spine.

[0495] Key features of one or more embodiments described herein may include anatomical landmarks of interest (e.g., C7, S1, etc.) initialized relative to the 3D tracking acquisition system. In some embodiments, continuous or discrete 3D tracking acquisition is performed within and outside the surgical site, along the surface of the spine (e.g., posterior, anterior, or lateral surfaces). In some embodiments, a series of algorithms filters the continuous or discrete 3D tracking probe data to identify the relationship between the acquired points and the anatomical region of interest (e.g., the centroid of the vertebral body). In some embodiments, values ​​of each associated radiographic parameter (e.g., Cobb angle, lumbar lordosis, thoracic kyphosis, C2-C7 lordosis, C7-S1 sagittal vertical axis, sacral midline, T1 pelvic angle, pelvic angle of incidence-lumbar lordosis mismatch, etc.) are used to generate an assessment of partial and / or full-length spinal alignment. In some embodiments, an assessment of the contour, position, and / or alignment of instrumented hardware such as screws, rods, or cages may be generated.

[0496] Some embodiments include a visual display and quantitative feedback system for evaluating and adjusting implants inserted into or to be inserted into / on anatomical structures, including 3D dynamic rendering of one or more registered anatomical landmarks of interest. In some embodiments, assessments of partial, regional, or full-length flexibility and range of motion can be generated between selected vertebral segments. In some embodiments, the display outputs information regarding the curvature and alignment of the spine, quantitative radiographic alignment parameter values, instrumented hardware analysis, the flexibility or range of motion of the spine, and various methods of acquiring or analyzing radiographic images. In some embodiments, the display implements interactive feedback and an interface for a user to signal specific commands to the system to calculate, initiate operation, or output quantitative or visual analysis of the system or one or more anatomical regions of interest.

[0497] Any of the proposed embodiments can be an independent invention and need not be excluded from other inventions or classification system workflows (e.g., patient initialization, alignment contour acquisition, etc.). Figure 1As shown. For example, some embodiments of the invention described herein include devices, components, systems, and methods for assessing intraoperative alignment of the spine, extracting information about the contours or alignment of instrumented hardware, and assessing certain biomechanical qualities of a patient's spine. Figure 1 The document illustrates some embodiments of the overall system, in which a central software system can receive input from discrete and / or continuous location data (e.g., internal and / or external surgical sites), wherein the data is collected through non-radiographic or radiographic embodiments, algorithmic calculations, or based on manual user interaction to produce visual and quantitative outputs relating to the intersegmental or full-length alignment, curvature, position, range of motion, and biomechanical flexibility of the patient's spine. Any embodiments described herein may be independent embodiments and are not necessarily included in this document. Figure 1 Within the classification series of system steps shown (e.g., 3D trajectories, local anatomical structures, landmarks, etc.), a system for evaluating spinal alignment, local anatomical biomechanics, rod profiles and active rod profile drawing, as well as the initialization of references and interactive display of various outputs, according to some embodiments of the invention, is illustrated. Figure 1 The overall system 100 may include devices, components, systems, and / or methods described in the following description with reference to one or more accompanying drawings, including processes for methods implemented using one or more software modules 121 on one or more computers. In some embodiments, system 100 may include devices, components, systems, and methods for patient initialization 107, alignment contour acquisition 115, reference / detection anatomical regions 117, third-party software integration 119, local anatomical structure assessment 105, rod contour assessment 109, auxiliary rod contour drawing 111, and output display 113.

[0498] Some embodiments of the present invention relate to systems and methods for precisely placing skin surface markers or percutaneous access devices that provide the relative position of underlying bone anatomy to a visible surface grid. In some embodiments, the systems and methods described herein can reduce the number of X-rays required to examine the position of the covered or percutaneous device relative to the bone anatomy. Some embodiments may include a skin-mounted patch with visible markings having colors in the visible spectrum for the user to see. Furthermore, in some embodiments, the patch may include a corresponding radiopaque pattern (e.g., grid lines, letters, numbers, symbols, icons, etc.) embedded in the patch, such that when X-rays are taken, the patch provides a large-area landmark that can assist the user in placing percutaneous devices, placing one or more additional surface marker references, and / or locating surgical incision sites relative to underlying anatomy. For example, Figure 2AA representation of a reference patch 200 that can be mounted on a body surface according to some embodiments of the invention is shown, wherein radiopaque mesh lines can be visualized on an X-ray image. Other related figures and discussions herein may include those applied to, for example... Figure 6B , 9A -9B and Figure 11A-11B Examples of skin reference markings on patches are relevant to those. For example... Figure 2A As shown, some embodiments include a body surface mountable reference patch 200, which may include an array of translucent markers having a visible and / or translucent grid line 201. In some embodiments, the shape or markers defined by the grid line 201 may be colored and / or marked with identifiers, including but not limited to a red grid surface with a translucent “R” (reference numeral 209), a blue grid surface with a translucent “B” (reference numeral 211), a yellow grid surface with a translucent “Y” (reference numeral 205), and / or a green grid surface with a translucent “G” (reference numeral 207). In some embodiments, the grid lines may be more spaced or closer together than shown. In some embodiments, the markers may be larger or smaller than shown in this non-limiting embodiment, and fewer or more in number. In some embodiments, the body surface mount reference patch 200 is capable of precisely positioning surface mount objects or percutaneous devices that require identification or understanding of the relative position of underlying bone or soft tissue structures.

[0499] It should be noted that the visible surface of patch 200 does not need to be a color distribution, but may also include any identifiable pattern that is also meaningfully visible on X-ray imaging. In some embodiments, the patch may be adhered to surface anatomy by an adhesive (not shown) or other methods. In some embodiments, one side of patch 200 may include an adhesive (e.g., the skin-attachment side). In some embodiments, the size and density of the unique, identifiable grid segments on the patch may vary based on a specific application. In some embodiments of the invention, a radiopaque liner may be included that at least partially matches one or more overlaid visible markings. In this case, patch 200 can facilitate the user's understanding of where each visible marking is and how it corresponds to the underlying anatomical area or element. This can facilitate the user making incisions in known or identifiable areas of the patient.

[0500] Figure 2B Showing Figure 2AThe radiopaque elements of the reference patch, as will be visible in an X-ray image of a patient to which the patch has been applied, according to some embodiments of the invention. For example, X-ray patient image 225 is shown as a reference grid patch 200a with radiopaque elements displayed on image 225. This image shows the radiopaque elements of the reference patch 200, as will be visible in an X-ray image 225 of a patient to which the patch 200 has been applied. In some embodiments, after obtaining X-rays of the patch 200 applied to the patient, the user can place a surface reference or point a percutaneous access device toward the skeletal anatomy of interest based on the corresponding grid positions on the patch representing the underlying anatomical structures of interest. In this non-limiting example embodiment, a red grid surface (reference numeral 209) with radiopaque “R” is shown as 209a, and a blue grid surface (reference numeral 211) with radiopaque “B” is shown as 211a. Furthermore, in X-ray image 225, the yellow grid surface (reference numeral 205) with a radiopaque "Y" is shown as 205a, and the green grid surface (reference numeral 207) with a radiopaque "G" is shown as 207a. In some embodiments, when used in this manner, Figure 2A Patch 200 and Figure 2B Imaging can aid in the precise selection of the correct surgical site access point, ensuring that the incision covers the desired bone anatomy on which surgery will be performed. Additionally, in some embodiments, the patch 200 can be used to precisely position secondary skin mounting references such that they overlap with the underlying bone anatomy of interest. Some exemplary embodiments of references that can be applied to the imaging patch include... Figure 6B , Figures 9A-9B , Figure 11A-11B In some embodiments, the patch 200 may be applied to the patient's skin using an adhesive or other conventional methods. In some embodiments, the type of identifiable surface markings may differ from the non-limiting embodiment shown.

[0501] Figures 3A-3CA bone mounting reference device is illustrated, designed with a crossbar to interface with one or more mating devices that can assist in registering the reference's position and potential in 3D space (e.g., through tracing, tracking discrete positions, direct tracking), assisting in initializing the registration of the reference relative to the anatomical structure of interest with X-ray images or a 3D tracking acquisition system, or directly manipulating the reference and the attached bone anatomy after they have been coupled. In some embodiments, after imaging the reference mounted to the bone anatomy, the relative position of the reference in space with respect to the anatomical landmark of interest can be registered such that the corresponding bone anatomy element is also localizable and / or identifiable when the reference is later located and registered by a 3D tracking tool. Vertebra 300 is shown as having a bone mounting reference 320 fastened to the bone. In some embodiments, reference 320 may be fastened to the medial edge of the right vertebral lamina, but due to its small size and profile, it can be mounted at any location on the bone anatomy. In some embodiments, the bone mounting reference 320 may include a threaded or smooth bone puncture component (not shown) such that it can be substantially rigidly fastened to the anatomical structure of interest (e.g., 300). In some embodiments, the bone puncture component may be significantly miniaturized such that it does not puncture the opposite side of the bone anatomy or otherwise damage any sensitive anatomical structures.

[0502] In some embodiments, reference 320 may include one or more rigid crossbars 325 that travel across reference 320. In some embodiments, crossbars 325 may be positioned such that an open space exists beneath them to allow direct engagement of mating interfaces of coupled reference attachment 350 with them. In this case, reference 320 may be substantially rigidly fixed to attachment reference 350 (see below). Figure 3B This is to explain the attitude and position of the reference 320 in space when it is accessed by a 3D tracking device.

[0503] Additionally, some embodiments involve patterned peripheral surfaces ( Figure 3B ), including but not limited to groove 327 (not shown) and other identifiable patterns, which can be traced or discretely registered by a 3D tracking probe. Figure 3BAn assembly view of a vertebra 300 having a bone mounting reference 320 and an accessory reference 350 for coupling to the bone mounting reference 320 is shown, illustrating the mating capability of the bone mounting reference 320, allowing it to be mechanically coupled to the accessory reference 350 via various mechanisms. For example, a non-limiting mechanism includes a right-angle turn interlock mechanism 355, such that when the accessory reference 350 is rotated 90 degrees into the interlocking design of the mechanism 355, the accessory reference 350 is tightly pulled into the crossbar 325 of the base bone reference 320. In some embodiments, the accessory reference 350 is constructed such that it may include surface features, including but not limited to an asymmetrical pattern of three or more identifiable recesses 370. In some embodiments, the identifiable recesses 370 can be used to register the unique position and orientation of the reference 320 in 3D space via an interface with a 3D trackable device, as referenced below. Figure 3C and Figures 44A-44D As described in more detail. In some other embodiments, other conventional mating mechanisms with a reference include, but are not limited to, quarter-turn, half-turn, internal thread, clamping devices and / or spring-loaded engagement devices.

[0504] When interacting with a 3D tracking probe, some embodiments of the uniquely identifiable surface structure of the accessory reference 350, which can be used to register the orientation of reference 320 in 3D space, may include, but are not limited to: 1.) three or more uniquely spaced recesses; 2.) a uniquely identifiable groove in which the 3D tracking probe can trace to identify the position and orientation of reference 320; 3.) an insert containing a set of three or more tracking markers, the position of which in 3D space can be tracked by a 3D tracking camera; 4.) a tracking DRF; 5.) a larger embodiment having radiopaque features so that its unique orientation and position can be identified by X-ray imaging; and 6.) interaction with a tracking probe, which can be substantially rigidly coupled to reference 320 so that it can interpret the position and orientation of reference 320 in 3D space, as referenced below. Figures 44A-44D As described above. For example, Figure 3C A vertebra 300 according to some embodiments of the invention is illustrated, wherein a bone mounting reference 320 is coupled to a top reference (reference 350). The bone mounting reference 320 includes a substantially rigidly attached subordinate reference 350, and one embodiment of a uniquely identifiable surface pattern 370 (surface recess) that can be registered with a 3D tracking probe is shown. In some embodiments, three or more discrete recesses constituting the surface pattern 370 may be coupled to at least a portion of the 3D tracking probe, which may be coupled to the surface pattern 370. Thus, one or more computer systems can then be used to calculate the position and unique orientation of the reference 320 in 3D space.

[0505] Figure 4A An assembly or operation process 450 for a skin-surface mounting reference 400 being applied to a patient 425 is illustrated according to some embodiments of the invention. The skin-surface mounting reference 400 is applied to the posterior skin of the patient while the patient is positioned prone on an operating table 435. In some embodiments, the reference 400 may be adhered to the patient's skin by an attached adhesive compound, a U-shaped staple, suture, or a covering adhesive overlay.

[0506] Figure 4B A lateral radiographic image of a sample is shown, comprising a radiopaque marker 444 embedded within a skin-based reference 442 according to some embodiments of the invention. This skin-based reference is applied to an anatomical model 443 and adhered to its skin surface 446. In some embodiments, the radiopaque elements of the reference marker 444 allow for clear visualization and identification of the reference 442 on the radiographic image. Additionally, the known dimensions of the radiopaque marker 444 allow for reference scaling within the X-ray image 441. Furthermore, nearby anatomical structures also within the field of view of the X-ray image 441 can then be initialized so that displacement vectors can be plotted in the plane of the X-ray image 441, as follows: Figure 4C and Figure 4F As described above. In some embodiments, the arrangement of the radiopaque reference markers 444 can be designed as an asymmetrical pattern so that the X-ray image of the reference can visualize the unique orientation of the pattern from any viewpoint, and subsequently enable the system to automatically estimate the 3D orientation of the reference 442. For example, Figure 4C Annotation vectors are shown according to some embodiments of the present invention. Figure 4B The sample lateral X-ray photograph 440. Figure 4C One aspect of the initialization process for a datum located near an anatomical element is shown, where it is desirable to know the position of the anatomical element relative to the position of datum 442. In some embodiments, manual or automated software annotation may enable the identification of radiopaque markers within the datum (shown as vectors 465 and 460 extending between radiopaque markers 444).

[0507] Given the relative dimensions and orientations of the reference markers 444, the pose of the reference 442 relative to the plane of the X-ray image 440 can be calculated. In some embodiments, the user interacts with the system to select one or more additional anatomical points, and displacement vectors 470 from the reference 442 to said one or more additional anatomical points are calculated. In this example, a central region of a particular vertebra is selected, indicated by a great circle (e.g., as shown in 427), and the software calculates the pixel distance between each radiopaque marker 444 and the annotation region 427 on the display monitor. Based on the known dimensions of the radiopaque markers 444 in or on the reference 442, the image can be scaled such that lengths measured in pixels can be converted to lengths measured in distance units (e.g., mm, cm, etc.). In other embodiments, the software can also calculate displacement vectors from the reference to any anatomical landmark of interest, even across several vertebrae.

[0508] Figure 4D A C-arm X-ray imaging system 480 according to some embodiments of the present invention is illustrated, which can be used for image acquisition and subsequent initialization of a reference marker 442. In some embodiments, after acquiring a first X-ray image, the relative angle between the patient reference complex and the X-ray emitter is rotated by a known or unknown amount to obtain a subsequent image. The second image allows information to be added outside the plane of the first X-ray image to construct a 3D displacement vector between the reference and the bone anatomy of interest. The X-ray system does not have to be a C-arm-based device 480, but may also include other image acquisition systems, including but not limited to O-arms, flat-panel X-rays, CT scans, MRI, and wall-mounted or bed-mounted acquisition systems.

[0509] Figure 4E The invention illustrates some embodiments from and Figure 4A and 4B Sample X-ray images 485 of the spine-reference pair with different imaging angles are shown, and reference radiopaque markers (shown as 487A, 487B) are shown as an example of the arrangement of radiopaque markers distributed in or on the reference to enable image scaling and localization of nearby anatomical regions of interest.

[0510] Figure 4F Some embodiments according to the present invention are shown. Figure 4E 485 sample X-ray images, including annotation vectors. Figure 4F The X-ray image initialization process for the reference-body pair is shown above. Figure 4E It is imaged and described. Annotation vector 488 is used to reference benchmark 442 ( Figure 4B-4CThe relative positions of each of the radiopaque markers (487a, 487b) within the reference datum are calculated, along with a displacement vector 486 to a user-indicated anatomical region of interest (shown as 489), for which the reference datum 442 can be used as a reference point for future positioning. In some embodiments, the arrangement of the radiopaque reference markers can be designed as an asymmetrical pattern, as seen through the exemplary unique triangular pattern of vectors between the radiopaque markers 487a, 487b, so that the X-ray image of the reference can visualize the unique orientation of the pattern from any viewpoint, which allows the system to automatically estimate the 3D orientation of the reference. In this respect, the estimation of the reference orientation enables the system to calculate 3D vectors relative to each reference axis.

[0511] Figure 4G The 3D axes of the reference device 442 are displayed in coordinates of the X-ray imaging system, wherein the unique position and orientation of the reference device 442 are registered according to some embodiments of the invention. In this non-limiting embodiment, the X-ray imaging system coordinate axis 492 is shown as having a 3D displacement vector 494a, which indicates a relative 3D offset initialized between the reference origin 490a and the triangulated position of the previously annotated (annotations 427 and 489) anatomical landmark 491a of interest. According to some embodiments of the invention, the displacement vectors plotted on each 2D X-ray can be combined based on calculated or input angles between each X-ray image plane. This input makes it possible to calculate rigid body transformations between the coordinate axes of two or more X-ray images of the reference device 442, and thus makes it possible to calculate a 3D displacement vector combining the displacement vector inputs from two or more X-ray images. It must be noted that a series of X-ray images of the reference device 442 relative to an anatomical region of interest, such as 427 or 489, may not always differ by pure rotational transformations and may include translational transformations, especially if the reference device 442 is rotated by its boom (e.g., ...). Figure 4D (As seen in the image) when the field of view of the C-arm is not aligned with the volume center of the field of view. This non-circularity of the field of view of the C-arm may be caused by the misalignment of the center of the imaging cone with the center of the rotation axis of the C-arm.

[0512] Figure 4H Systems and methods for locating a reference in 3D tracking camera coordinates are illustrated according to some embodiments of the present invention. In a non-limiting embodiment, a recognizable tracer pattern 495 relative to the 3D tracking acquisition system, a trigger-capable tracking probe 496 (showing the probe in an active tracer state 493), and a reference coordinate axis 497 are shown. Figure 4HA method for locating a reference in 3D tracking camera coordinates is shown as a non-limiting embodiment. As shown, the reference is equipped with a unique groove pattern 495, and a tracking probe 496 can trace the reference's signature pattern into this groove pattern. (See above regarding...) Figure 4A The identifiable features of the reference are not limited to a unique traceable pattern, but also include discrete points for tracking, mounting locations for tracking markers, and a substantially rigid coupling with the tracking probe in a manner that allows the probe's orientation to be used to interpret the reference's position and orientation. By tracing the unique surface pattern 495 on the reference with the tracking probe 496, the reference's axis 497 and origin can then be interpreted relative to the coordinate system of the 3D tracking acquisition system. In some embodiments, the acquisition system will then be able to interpret the locations of initialized nearby anatomical regions (e.g., 427 and 489), as follows: Figure 4I As described in [the text].

[0513] Figure 4I The 3D coordinate axes of the reference device 498 relative to the 3D tracking acquisition system are shown. This non-limiting embodiment includes a 3D displacement vector 494b between the reference coordinate axes 498 and 442 relative to the 3D tracking acquisition system and the anatomical regions of interest (427 and 489). The 3D displacement vector 494b between the reference origin 490b and the anatomical region of interest 491b relative to the 3D tracking acquisition system represents the vector 494a after undergoing a 3D rigid transformation. Figure 4G As shown in the diagram, it utilizes a calculated transformation between a reference position and orientation in an X-ray imaging and 3D tracking acquisition system, such as... Figure 4C , 4F And as depicted in 4H. This synthesized 3D displacement vector enables the calculation of the anatomical region of interest 491b (in Figure 4C-4G The reference numerals 427 and 489 (described as coordinates relative to the X-ray imaging system) represent the positions relative to the coordinate axes and the origin of the reference point relative to the coordinate system of the 3D tracking acquisition system. In some embodiments, this allows for the localization of the bone anatomy region of interest by interpreting the position and orientation of the reference point within other 3D tracking acquisition system axes, such as... Figure 4H As shown.

[0514] Figures 5A-5C The components, systems, and methods for initializing baselines to serve as reference points for potential anatomical regions of interest are shown in the above reference. Figure 4A-4I However, instead of using X-ray images, the method can utilize an ultrasound-based probe 575 equipped with a tracking DRF 580, allowing its position and orientation to be calculated while visualized by a 3D tracking camera. For example, Figure 5A An optical 3D tracking system 550 according to some embodiments of the present invention is shown. Figure 5BAn ultrasonic probe 575 equipped with a tracking DRF 580 is shown according to some embodiments of the present invention. Furthermore, Figure 5C An assembly or process view 590 of a patient skin surface 594, showing a cross-sectional view covering a vertebra 596 according to some embodiments of the invention, is provided, with the vertebra 596 representing a specific region of a bone anatomy that can be registered with a skin mounting reference 592. In some embodiments of the invention, Figure 5A The optical 3D tracking camera 550 can be used throughout the 3D tracking acquisition system referenced herein. This system utilizes a stereo camera 551 to detect the position of a tracking marker that reflects or emits infrared light. This is one example of a tracking system that can be used to acquire 3D coordinates throughout this document, but this can also be achieved through other methods, including but not limited to luminous markers, electronic communication, etc. Furthermore, in some embodiments, Figure 5B The ultrasound probe 575 is equipped with a tracking DRF 580, which enables the use of a passive reflective marker 585 to track the position and orientation of the probe in 3D space. In some embodiments, tracking the precise position of the probe allows recording the relative angles between each acquired cross-sectional imaging plane, which can be used to create a 3D displacement vector to the point of interest by calculating the 3D rigid transformation of the relative position and orientation of the ultrasound probe 575 between acquisitions of ultrasound cross-sectional images.

[0515] Figure 6A -D includes a description of the apparatus, system, and process for applying a skin mounting reference along with its top mating component, which is capable of mating across the surgical drape so that the reference is both visible and referential during surgery, during which the surgical drape blocks the surface of the skeletal anatomy where its location is to be known.

[0516] Figure 6A A sample scenario is described, for which a skin mounting reference 625 and its associated drape mating reference 635 can be applied. With the patient prone on the operating table, the skin mounting reference can be applied to an area that will not be surgically exposed but contains underlying bony anatomy, with the aim of knowing the location of that bony anatomy relative to other anatomical areas. After the surgical drape 605 is applied to the skin mounting reference, the drape mating reference can then be used to interpret the location of the underlying skin mounting reference, which will... Figure 6B The -D option provides a more detailed description. For example, Figure 6A An assembly or process view 600 is shown for applying a skin mounting reference 625 and its associated mating reference 635 on a drape, according to some embodiments of the present invention. Figure 6BAn assembly view 650 of a skin-mounting reference 625 and its associated mating reference 635 on a cover sheet, according to some embodiments of the present invention, is shown. In some embodiments, reference 625 may include reference 400, and reference 635 may include reference 635.

[0517] refer to Figure 6B The detailed components of one embodiment depict a skin mounting reference 625 and its associated mating reference 635 on a surgical drape. In some embodiments, the skin mounting reference 625 may include a method of adhesion to a skin surface (not shown), including but not limited to adhesive materials, annular areas to be sutured or pinned to the skin, percutaneous or bone puncture screws, pins, threads or other common fasteners, and / or attachment tape to be tightly wrapped around the body surface. In some embodiments, one or more radiopaque markers 608 may be included within or on the reference, which are readily visible on X-ray images of the reference. Furthermore, in some embodiments, these radiopaque markers 608 may be positioned relative to each other via shape-specific incisions 606 and the reference body itself, such that the markers can be used to identify the orientation of the reference on a 2D X-ray image, as described above in Figure 4. In some embodiments, the reference may include magnets (e.g., shown as 619 in reference 635 and magnet 604 in reference 625 embedded in or on the surface of the reference), such that when the surgical drape (on Figure 6A When separated (shown as 605), it helps to securely fasten the two references. In some embodiments, the magnets may have different geometries; for example, some embodiments include spherical magnets, which can serve two functions: providing a radiopaque marking and aiding in the engagement of mating references across the cover. In some embodiments, the skin-mounting references may also be equipped with protrusions to act as mating elements for mechanical alignment (shown as 602A and 602B). In some embodiments, the mating elements may protrude from one reference (e.g., shown as 625 and / or alternatively from both references 625 and 635) and have complementary mating cutouts, such as 617a and 617b, within the opposing references to ensure proper alignment of the two references relative to each other. Figure 6B In a non-limiting embodiment, the protrusion is conical in shape, but in other embodiments other conical or non-conical geometries may also be formed.

[0518] Figure 6C An embodiment of a skin mounting reference according to some embodiments of the present invention is shown, which is applied to an anatomical phantom in a region outside the surgical site but above an area of ​​an underlying anatomical structure where it is desired to know its position within the coordinates of a 3D tracking acquisition system. Furthermore, Figure 6DAn embodiment of a skin mounting reference according to some embodiments of the present invention is shown, which mates across a surgical drape / coveret with a reference on its drape. Reference Figure 6C In some embodiments, the skin mounting reference 625 may be applied to the anatomical phantom 677 in an area outside the surgical site 681. For example, Figure 6D An embodiment of a skin mounting reference 625 according to some embodiments of the present invention is shown, which has a reference 635 on its cover across a surgical drape / fabric 679. In some embodiments, because the drape-on-the-covert mating reference 635 mechanically mates with the skin surface reference 625 in a predictable manner, the position and orientation of the drape-on-the-covert mating reference 635 can be used to calculate the position and orientation of the underlying skin mounting reference 625. Furthermore, if the skin mounting reference 625 has been previously initialized to nearby anatomical structures, as described above regarding… Figure 4A-4I The position and orientation of the cover cloth aligning with reference 635 can then be used as an alternative reference point for the anatomical structure of interest 681 below.

[0519] Figure 7 A component view 700 of a reference 740 according to some embodiments of the present invention is shown, and embodiments enabling a reference to be uniquely identified relative to another reference are depicted. In some embodiments, this can be applied to situations where more than one reference is used and the identity of the reference is required. In this embodiment, an interface probe 703 is shown designed with electrodes 735 to mate with the reference 740. In some embodiments, the electrodes may be coupled to or inserted into the reference 740, and the unique identity of the reference can be known by the mating probe based on the circuit characteristics (e.g., resistance, capacitance, etc.) built into the reference material. As shown, in some embodiments, the probe 703 may include a probe axis 705 coupled to a DRF 715 having a 3D traceable marker 725. Furthermore, in some embodiments, the reference 740 may include two built-in electrodes and may have identification circuitry (e.g., resistors, capacitors, etc.) embedded between the electrodes. In this way, a probe 703 equipped with a tracking DRF715 can be designed to have mating electrodes 735 that can interface with a reference 740, thereby measuring the unique electrical characteristics of the reference 740 and identifying the position and orientation of the reference 740 in 3D space. Therefore, the above embodiment enables the identification of a unique reference, which can be useful when deploying multiple references.

[0520] Figure 8A component view 800 of a reference according to some embodiments of the present invention is shown, enabling the unique identification of a reference relative to another reference. This can be applied to scenarios where more than one reference is used and it is desirable to know the unique identity of the references. In this design, a probe equipped with RFID reading circuitry interfaces with a spring-embedded RFID tag circuitry within the reference. Thus, the probe 803 is able to simultaneously convey that the reference has been accessed by a pressed, spring-loaded, momentary button, and also obtain information about which reference has been referenced. As shown, the probe 803 may include a tracking DRF 715 with a trackable marker 725, configured to couple to an embedded RFID reader 850 including a spring-loaded button 855. In some embodiments, the tip 707 of the shaft 705 may couple to the surface 858 of the button 855, thereby compressing the spring 864 and ultimately enabling the terminal 862 to contact the RFID tag 870. In some embodiments, if, in addition to the tracked DRF 715, it is also accessed by a probe 803 equipped with an RFID reader 850, the probe 803, which depresses the spring 864, can simultaneously perform three tasks: 1.) triggering it to approximate the reference, 2.) interpreting the position of the reference surface, and 3.) interpreting the unique identity of the reference based on the RFID tag embedded in the reference.

[0521] Figure 9A Showing previous information Figures 6A-6B Another embodiment of the described skin surface reference. In this case, the assembled skin surface reference 900 includes a mating top surface reference 905 coupled to a skin-mountable reference. For example, Figure 9A The assembled skin surface reference 930 and its mating reference 905 on the drape are shown. The bottom reference 930 is equipped with a mechanism (not shown) for adhesion to the skin surface. Reference pairs 905, 930 are joined together at an interface 925 designed to receive a surgical drape or towel while maintaining a predictable mating configuration. One embodiment of the top reference includes grooves (tracer pattern 910) with a unique geometry (e.g., the “z” geometry shown here) such that a 3D tracking probe (e.g., any 3D tracking probe described here) can trace the pattern, as previously discussed... Figure 4H The depiction, and the interpretation of the unique identity of the datum based on this information, as well as the interpretation of its position and orientation in space, enable the identification of datum-based axes, as previously discussed. Figure 4A-4I As mentioned above.

[0522] The external design of the reference 900 is configured to convey information to the user as embedded instructions. One embodiment of the reference has an external arrow appearance (…). Figure 9AAn example of a reference 900 assembled as an arrow is depicted, which can be used to indicate to the user how the reference should be positioned (e.g., positioning the reference on the skin such that the arrow points away from the surgical site). In some embodiments, a sloped surface 920 of known geometry on the bottom reference and a curved slope 915 on the top reference can be implemented to allow the user to trace the probe from the recessed surface 910 of the upper reference 905 down to the bottom surface of the lower reference 930, which transitions to the skin or draped skin on which the upper reference 905 is placed. In some embodiments, the framed structure of the reference 900 allows for more predictable tracing on the transition from the reference recess 910 to the underlying surface. Additionally, in some embodiments, the known geometry of the reference's sloped design allows for the ability to calculate the position of the underlying body surface.

[0523] Figure 9B Some embodiments of the present invention are shown. Figure 9A A component view of reference 900. In this non-limiting embodiment, skin mounting reference 930 includes a convex alignment aid protrusion 940, similar to the previously mentioned... Figure 6B Those described. Furthermore, these protrusions have a flat top 922 to accommodate the increased volume of covering material, as in the case of a surgical drape. In this way, the structure allows for close proximity of the two reference fittings in the presence of a sandwiched drape by preventing the drape bulge between the two reference halves. In some embodiments, references 905, 930 are equipped with a cutout 924 to accommodate both a radiopaque marker and / or a magnet, which may also serve as a radiopaque marker, as previously discussed. Figure 6B As described. One embodiment of incision 924 includes an asymmetric geometry that substantially rigidly embeds the radiopaque marker within a relative configuration capable of unique attitude estimation from any radiographic viewpoint. Instead of magnets to aid in accessing the two references, other embodiments may include protrusions with quarter-turn or torsion mechanisms that allow for a tight mechanical link across the surgical drape. In some embodiments, the drape mating reference 905 is equipped with a concave alignment aid incision 908 configured to mate with the position of protrusions 940, 922 on the skin mounting reference 930. It should be noted that the position, size, and geometry of these protrusions and mating incisions can vary, and this is only one embodiment. Furthermore, the protrusions need not be located solely on the skin mounting reference, and the incisions on the drape mating references may include different combinations of shapes and sizes.

[0524] Instead of magnets, some embodiments may include a "covert clamp" feature (e.g., a sheet on a top reference to clamp downwards above a lower reference while gripping the covert in between). Other embodiments of the invention include two or more clamping arms mounted on the covert reference, the clamping arms being designed to snap onto corresponding areas of the lower reference to ensure proper alignment when separated by the surgical covert.

[0525] In some embodiments, the reference 905 may be equipped with other components mentioned herein, such as those referenced later. Figure 10A-10G The description describes a depth limiter-based reference and probe combination. Other embodiments of the reference that enable its unique identification include notches with discrete depths, designed to mate with probes equipped with depth sensing technology, as referenced below. Figure 10A-10G The description allows the unique position of the datum and the notch relative to the datum to be determined based on the distribution of the measured notch depth.

[0526] In some embodiments, the bottom reference 930 may have flexible components to enable it to successfully adhere to and / or conform to the uneven surface contours of the patient's skin.

[0527] Figure 10A-10G Some embodiments of the invention described herein include a 3D tracking probe coupled to an actuated TMSM indicating the depth of the recess in a spring-loaded sliding shaft, and embodiments of a complementary mating reference designed to engage the shaft and cause discrete amounts of shaft deflection. The purpose of this design is multi-faceted. For example, Figure 10A A 3D trackable probe 1000 equipped with a substantially rigid attachment 3D tracking DRF 1020 is illustrated according to some embodiments of the present invention. In some embodiments, an actuated TMSM 1030 on the tracking probe 1000 allows analog communication between the probe 1000 and the acquisition system, as will be referenced below at least... Figures 15A-15CAs described in 63. In some embodiments, the actuated TMSM 1030 conveys information about the depth of deflection of the shaft 1049 at the tip 1409b of the probe 1000. Furthermore, when coupled with a mating reference designed to deflect the shaft tip L049b at a set height upon full engagement, the probe 1000 can convey three things: 1.) when it is fully engaged with the mating reference, 2.) the position and orientation of the mating reference, and 3.) the unique identity of the mating reference based on the depth of the recess designed to deflect the sliding shaft 1049. As shown, the tracking DRF 1020 includes fixed 3D tracking markers 1025a, 1025b, 1025c, 1025D. Some or all of the markers 1025a, 1025b, 1025c, 1025d shown in the DRF frame 1020 can be used in any DRF described herein. In some embodiments, any DRF described herein may use these markers, or fewer markers may be used. In some embodiments, any DRF described herein may use more markings similar to or the same as any of markings 1025a, 1025b, 1025c and / or 1025d. In some embodiments, any probe or DRF described herein may include any of markings 1025a, 1025b, 1025c and / or 1025d, but with different geometries and / or shapes (e.g., the markings may be smaller or larger than shown, or may be placed at different distances from the probe axis).

[0528] One embodiment of the invention includes a 3D tracking probe equipped with a substantially rigidly attached 3D tracking DRF 1020. Furthermore, a TMSM 1030 is substantially rigidly attached to a spring-loaded shaft 1049 coaxial with the probe 1000 and actuated downwards within a through-hole along the length of the probe shaft 1010 of the probe 1000. In some embodiments, the sliding shaft 1049 can be actuated by a pressable tip 1049b that translates the shaft together with a mounting member 1005 for the TMSM 1030. This embodiment of the probe also includes a series of concentrically oriented, diameter-variable protrusions 1040 near the probe tip 1049b. When coupled with a depth limiter reference, these diameter-variable protrusions 1040 can be used as variable depth limiter selections (1041, 1045, 1047), as referenced below. Figure 10C The depth limiter is designed with a variable inner diameter to mate with a specific depth limiter 1040 on the probe 1000. For example, Figure 10B As shown above Figure 10AA more detailed perspective view of the probe 1000 with an actuating tip and a variable depth limiting device described herein. The tracking probe shaft 1010 includes coaxial cylindrical protrusions 1040 of various heights, which serve as depth limiters to actuate the pressable sliding shaft tip 1049B and its associated TMSM 1030 to different heights (1041, 1045, 1047) for transmitting unique trigger signals to the computer system.

[0529] Figure 10C It shows the design as described above. Figures 10A-10B One embodiment of the depth limiting references for probe mating. These depth limiting references (1050, 1052) have variable inner diameters and / or heights, allowing them to couple with varying depth limiting devices on the probe. In addition to having variable inner diameters to mate with defined depth limiting devices on the probe (e.g., probe 1000), this can result in a recognizable deflection of the TMSM 1030 relative to the DRF 1020. Furthermore, other embodiments of these depth limiting references also include variable bottom depths, allowing the sliding probe tip 1049b to be actuated by varying amounts despite mating with depth limiting references having matching inner diameters. Thus, these depth limiting references (1050, 1052) can be distinguished from each other, and their mating inner diameters and / or depth limiting devices provide additional unique identifiers. Therefore, these depth limiting references can be coupled as probe interface components, which are related to the previously mentioned... Figures 3A-3B The reference coupling described in 6A-6D and 9A-9B.

[0530] Figure 10D Showing comparisons with previous information Figure 10C The specific depth limiter reference 1050 described in the previous discussion Figures 10A-10B The probe 1000 is described. By coupling these two components in this manner, the TMSM 1030 can be coaxially actuated with the probe axis 1010, and based on the known geometry of both the probe and its mating depth limiter reference, the deflection relative to the tracked DRF can be measured, and compared with the depth limiter height 1061 of the probe (previously described in...). Figure 10A The deflection expected for a specific fit (shown as 1041) is compared. Thus, the measured deflection (“M”) of the sliding tip and the TMSM 1030 attached to the sliding shaft can be used as a probe (e.g., 1000 and / or 1001) when compared with a specific depth limiter reference 1060 (previously in...). Figure 10C The unique identifier shown in the figure is 1050) for full engagement.

[0531] Figure 10E As shown above regarding Figure 10A The probe 1002, which is designed with a unique depth limiter 1082 (previously in) the probe 1000 Figure 10A The depth limiter reference 1084 (shown as 1045 in the middle) is matched with the reference 1084 (previously in Figure 10C The reference 1052 is shown in the middle, which is consistent with the previous reference 1052. Figure 10D Compared to what is shown. Figure 10D In contrast, this figure shows the associated difference in deflection height (“P”) of the different mating areas 1080 on the probe’s unique depth limiter 1082 and the TMSM 1030, representing the different indentation depths of the sliding probe tip (which will... Figure 10E The "P" in Figure 10D (Compared to the "M" in the text).

[0532] Figure 10F A component view 1099 is shown as a portion of an embodiment of a probe 1000 according to some embodiments of the present invention. In one embodiment, as previously stated... Figure 10A As described, the 3D tracking probe 1000 contains components that can be used in conjunction with the previously mentioned... Figure 10C The described depth limiter references engage with an asymmetrical protrusion 1091, wherein a corresponding groove 1093 of the depth limiter reference mates with the probe protrusion 1091. Due to the asymmetrical design of the groove cutout 1093, the probe can only mate with the depth limiter reference in one direction. This asymmetrical alignment allows the probe 1099 to be registered to the unique orientation of the coordinate axes of the reference 1095, and thus detects how the reference 1095 rotates and translates in 3D space between registrations. Figure 10G A perspective view of a depth limiter reference 1095, which is partially engaged with a 3D tracking probe 1000 equipped with a depth limiter, is shown. The two previously discussed... Figure 10F To depict.

[0533] Figure 11A-11B As shown above Figures 6A-6B and Figures 9A-9B An embodiment of the skin surface and mating reference design described herein. The main difference in this design is the presence of a tracked marker, which is mounted to the top reference, allowing its position, orientation, and identity to be registered by the 3D tracking acquisition system without requiring an interface between the reference and the tracking probe. In this way, the reference information is continuously registered as long as the reference is within the line of sight of the 3D tracking camera system. The assembled reference can be used for the same purpose as previously described; once initialized, it serves as a surface reference point for the 3D location of the underlying anatomical structures in space. For example, Figure 11AA top view 1100 shows a skin surface reference 1155 mating with a reference 1105 on a cover containing three or more tracked markers 1135. These markers 1135 are arranged in a predetermined configuration to form DRF objects, allowing a camera acquisition system to identify them as unique entities associated with the reference. These tracked markers 1135 allow for constant registration of the reference's position and orientation in 3D space, as long as they are within the camera's line of sight. Even when these tracked markers 1135 are not within the camera's line of sight, the top reference component 1105 also includes a surface profile 1110 that can be accessed, traced, and / or tracked by a 3D tracking probe. In this way, the reference components (1105, 1155) are designed with redundancy to ensure they can be registered in 3D space regardless of whether the line of sight of the tracked markers is obstructed.

[0534] In some embodiments, the markers mounted on the reference may be placed in a manner that allows the reference to be uniquely identified. Other embodiments include three or more 3D tracking markers arranged in a unique, identifiable pattern (e.g., asymmetrical triangles).

[0535] Some embodiments include Figures 27A-27B The unique pattern described in the text is embedded in Figures 6A-6D The exemplary embodiments of the reference described in 9A-9B and 11A-11B enable enhanced X-ray image fusion using optical systems to provide positioning features across two coordinate systems. In some embodiments, a unique pattern (e.g., CALTag / ARTag) can be applied to a reference patch or a skin-based reference. This design involves a radiopaque, uniquely patterned surface (e.g., CALTag) that can be easily visualized in both the 3D tracking camera space and the 2D or 3D X-ray imaging space. Some embodiments involve using the absolute position of a C-arm relative to the uniquely patterned surface to calculate the relative position and orientation between individual X-ray images and to implement robust stitching algorithms to understand their spatial relationships and overlaps. The invention can be used with corresponding optical sensors mounted to an X-ray imaging apparatus, and the system knows the relative geometric relationship between the camera and the emitter or detector of the X-ray imaging apparatus. The system is capable of stitching, unique 3D orientation detection, absolute positional relationships, and should be robust to X-ray images acquired using a rotating / tilting X-ray imaging system. The visualization of unique patterned surfaces in X-ray images enables the automatic scaling of images to physical units (e.g., millimeters) and the automatic detection of reference points relative to anatomical landmarks of interest and to the orientation of the X-ray imaging apparatus.

[0536] Figure 11BAnother view of a baseline embodiment is shown, which is equipped with a tracking mark on a cover-on mating reference 1105, which is coupled to a skin-mounting reference 1155, which is mounted to the patient's skin via an adhesive backing 1157. This embodiment may also include slots for inserting radiopaque magnets and / or electronics 1125, 1160. It should be noted that, although in Figure 11A-11B Not shown in the diagram, but the reference 1100 can also be equipped with protrusions and mating cutouts for use as described above. Figures 6A-6D and Figures 9A-9B The aforementioned alignment.

[0537] Figure 12 Some embodiments of the invention described herein include a tracking DRF equipped with an indication relative to an anatomical reference plane. In this case, a functional aspect exists in the external indication method to inform the user how to optimally orient the DRF used for its tracking, to instruct the acquisition system how to interpret camera coordinates relative to anatomical axis coordinates. For example, Figure 12 A representation 1200 shows a tracking DRF 1250 with built-in indications for conveying relative anatomical axes. The design includes four 3D tracking markers 1275 defining the DRF, and also includes a covered body contour reference 1225 to help guide the user on how to properly position the DRF near the patient. Attached to the device is an adjustable mounting surface (labeled 1280, as below frame 1250) that allows the user to rotate the device until it is aligned with the patient's orientation, and then lock it in place using any common fastening mechanism. This device allows the acquisition system to not only register the DRF, but also define an anatomical reference plane relative to the known geometry of a dynamic reference plane. By utilizing this device, it allows the acquisition system to display data to the user on anatomical reference planes (e.g., sagittal, coronal, axial), rather than camera coordinates, which are often skewed and challenging for the user to interpret based on the camera's orientation relative to the subject. It should be noted that the method of indicating anatomical reference axes on this device is not limited to the body coverage shown in this figure. Other methods include, but are not limited to, displaying written text of the relevant anatomical axes, images of discrete body parts representing anatomical orientations, and alphanumeric or unique pattern labels for areas that should be aligned with a specific anatomical axis, allowing the software interface to enable the user to initially orient the DRF appropriately relative to the patient. It is noteworthy that the reference frame can be mounted virtually anywhere and does not need to have an adjustable mount, and can be rigid / orthogonal relative to the patient or operating table. For example, other embodiments involve reference frames that are substantially rigidly mounted in one orientation to an operating table or any rigid surface, or substantially rigidly mounted directly to a patient's anatomical structure (e.g., the spinous process of the spine).

[0538] Some embodiments of the present invention include cross-sectional CT scan views of the spine, highlighting anatomical regions of interest that can be used to initialize patient data prior to assessing the spinal contour using a tracing method, which will be referred to below. Figure 65A-65E and Figure 66A-65B A more detailed description follows. In some embodiments, this can be used to interpret the cross-sectional displacement vector between certain regions (e.g., skin surface, lamina, transverse process) and other regions of interest (e.g., the centroid of the vertebral body, the anterior segment of the vertebral body, etc.). Initializing the patient with a CT scan prior to assessing spinal alignment during surgery allows the software to better interpret the location of the exposed area (e.g., lamina) as an alternative to the location of other regions (e.g., the centroid of the vertebral body). In doing so, the use or non-use of the methods described above... Figures 3A-3B In the case of reference landmarks described in 4A-4I, 6A-6B, 9A-9B, and 11A-11B, intraoperative interpretation of the acquired data is performed. For example, Figure 13 A sample cross-sectional CT image 1300 of the patient is displayed, in which specific anatomical regions are visible, including the posterior skin surface 1335, and cross-sectional views of vertebral landmarks 1338 and their numerous bone elements. From the CT image set, the patient's anatomy can be initialized by calculating displacement vectors 1325 from a specific region of interest to another region of interest (e.g., from the midpoint of the skin to the centroid of the vertebral body, and from the laminae to the centroid of the vertebral body). After initialization, the software can interpret the location of a region based on its relative position to other initialized regions of interest. For example, while the location of the centroid of the vertebral body may be most advantageous for interpreting spinal alignment parameters, if the skin or laminae are fully exposed during surgery, the coordinates of the exposed elements can be collected, and then the coordinates of the exposed elements can be interpreted based on preoperative and / or intraoperative initialization data to represent the location of unexposed areas (e.g., the centroid of the vertebral body).

[0539] Some embodiments of the invention include an assembly with an arrangement of 3D tracking markers that can be used to transmit discrete signals to an acquisition system. In some embodiments, four tracking markers and two tracking spurious markers (TSMs) constituting a dynamic reference frame (DRF) are included in the assembly. In this embodiment, the center of the assembly may include a rotating shield that can be positioned to cover selected TSMs or not cover any TSMs at all. Using the known tool geometry, the acquisition system software can interpret which TSMs are exposed, and based on pre-programmed combinations, the tool can transmit discrete messages to the acquisition system. For example, if a first TSM is covered, this can indicate that the system is in a particular state, rather than indicating another state if a second TSM is covered. Because the tool contains a DRF, its position and orientation can be interpreted by the 3D tracking camera, and the arrangement of covered and uncovered spurious markers can then be used to convey specific commands or device states.

[0540] Figure 14A The tool is shown equipped with a tracking DRF 1401, which has markers (1420, 1424) and two TSMs identified as 1422a (invisible) and 1422b. The tool is also equipped with a rotating shield 1415, currently positioned to cover the visibility of TSM 1422a. Because it is equipped with a DRF, a 3D tracking camera is able to locate the position and orientation of the tool 1400 in 3D space and distinguish between the four markers used as the DRF and those used as TSMs. The tool can be programmed to communicate with the acquisition system through varying combinations of visible or invisible TSMs. For example, when 1422a is covered, the system indicates that it is in a specific state, different from the state when 1422b is covered, such as... Figure 14B As shown, this is also different from the state conveyed by any TSM not being covered, such as Figure 14CAs shown. It should be noted that any combination of one or more TSMs may exist associated with this tool, and any arrangement of individuals or combinations of covered or exposed TSMs may exist to communicate various states to the acquisition system. The static, known position of the TSM relative to the registered DRF allows the computer system to robustly filter out any phantom markers or additional stray markers not associated with the tool, as the computer algorithm can determine, through the design of the tool base mount, which stray markers visible to the camera have positions relative to the tool (1400, 1425, 1450) that match the preset positions of the TSMs. The rotating shield shown in this figure is only one embodiment of how to block the visualization of TSMs by the 3D tracking camera. Other embodiments of blocking visualization include, but are not limited to, spring-loaded rotating wipers, linearly moving sliders, actuating TSMs to move them from covered to uncovered positions, and rotating shields with multiple panels so that varying combinations of TSMs can be covered or uncovered. It should be noted that techniques for signaling by covering and exposing TSMs can also be combined with actuated TSMs, as previously referenced. Figure 10A-10G As described, and as will be discussed below. Figures 15A-15C 63 and 64A-64B are described in more detail.

[0541] Figure 14B-14C Different arrangements according to some embodiments of the present invention are shown. Figure 14A Tools. For example. Figure 14B The previous information was displayed. Figure 14A One embodiment of the tool discussed, however, in this arrangement, the rotating shield 1415 covers the visualization of TSM 1422b, while TSM 1422a is not covered. This combination can be used to communicate its unique status to the acquisition system software. Furthermore, Figure 14C The previous information was displayed. Figure 14A One embodiment of the tool discussed, however, in this arrangement, the rotating shield 1415 is positioned such that both TSMs 1422a and 1422b are visible, which is used to transmit the unique status to the acquisition system software.

[0542] Some embodiments of the present invention include a 3D tracking probe equipped with a tracking DRF and a tracking moving spurious marker (TMSM), the TMSM being user-actuable and used to indicate analog and / or binary information to the acquisition system software. For example, Figures 15A-15C Probes equipped with a tracking dynamic reference frame (DRF) in various configurations according to some embodiments of the present invention are illustrated. The position of the tracked moving spurious marker, which is rotated by the user about a pivot point in the probe axis, can be calculated relative to the DRF and, when visualized at certain locations, can be used to communicate messages of change to the software of the acquisition system. Reference Figure 15AOne embodiment of probe 1500 may be equipped with a tracking DRF 1510 coupled to mount 1512 and a TMSM 1525 coupled to arm 1530, which provides structural integrity for attachment of the DRF to probe 1505. Arm 1530 rotates about a pivot hinge 1550 on a hexagonal protruding probe shaft 1505. Arm 1530 is spring-loaded (via spring 1578) via an external spring mount 1580, 1575, which allows the pressable tab 1570 to be actuated by the user pressing it inward toward the coaxial probe shaft. The illustrated embodiment of probe 1500 has a blunt hemispherical tip 1560 to avoid damage to sensitive anatomical structures and also has a hexagonal protruding probe shaft 1505 for increased grip by the user. Probe 1500 is designed such that the TMSM 1525 rotates about the pivot hinge 1550 when the user presses down or releases the pressable tab 1570. The position and relative angle of the TMSM 1525 with respect to the DRF 1510 are calculated by the acquisition software of any disclosed system and can be used for binary or analog communication with the system, such as regarding... Figure 63 and 64A -64B is described in more detail.

[0543] It should be noted that regarding the movement type of the components of the TMSM 1525, the TMSM 1525 can be as previously stated. Figures 10A-10E Move linearly as described, such as regarding Figure 63 and 64A -64B describes rotational movement in more detail, or a combination of both types of movement. Regarding the actuation method, one embodiment is a user-pressable tablet 1570 as shown here, but it may also include the previously described... Figures 10A-10B The user slide button, rotary button, and pressable sliding shaft are described. Regarding the spring position, an external compression spring 1578 is shown, but this is only one embodiment, and it may also include, but is not limited to, torsion springs, internal compression springs, and deformable materials with shape memory. Regarding the probe shaft 1505, the hexagonal protrusion shape shown is only one embodiment, and other embodiments include, but are not limited to, circular, triangular, rectangular, pentagonal protrusions, and non-uniform rotational profiles for users to grasp and place the probe in a limited access environment. The probe shaft 1505 does not need to be linear or symmetrical. Regarding the pressable tab 1570, the position of tab 1570 can also be positioned anywhere on the body of tool 1500. Regarding the probe tip 1560, the blunt hemispherical design is only one embodiment, as it can also include different shapes and sharpnesses of the point at tip 1560. Other embodiments may include movement type, linear / rotational, and include other actuation methods. Some embodiments include user buttons, sliders, or pressable sliding shafts (previously described in...). Figures 10A-10B(As shown in the diagram). Other embodiments include different spring positions, internal or external placement, torsion springs, compressible springs, or incompressible springs. Other embodiments include alternative tip shapes and sizes, blunt or pointed tips. Some further embodiments include, for example... Figure 33D-33F The mating tip is shown in other fastening devices of 44B-44D.

[0544] refer to Figure 15B The tracking probe 1500 with rotating TMSM 1525 can be used for previously mentioned... Figure 15A The analog and / or binary communication described. This embodiment shows the position of TMSM 1525 when the pressable tab 1570 is in its unpressed position and the spring 1578 is in its maximum compressed state. The position and angle of TMSM 1525 relative to DRF 1510 can be calculated, such as regarding... Figure 63 and Figures 64A-64B A more detailed description.

[0545] Figure 15C An embodiment of the tracking probe 1500 is shown, which has features for previously discussed... Figure 15A The analog communication described is represented by a rotating TMSM 1525. This embodiment shows the position of the TMSM 1525 when the pressable tab 1570 is in its pressed position 1525a and the spring 1578 is in its maximum extension state. By comparing the position of the TMSM 1525 relative to the tracked DRF 1510, when it is actuated via the pressable tab 1570, the computer system can visualize and calculate the arc traveled by the tracked moving stray marker (marked 1509). Figures 15A-15C The example depicted is provided. The position and angle of the tracked moving spur mark 1525 relative to the DRF 1510 can be calculated, as shown in the reference. Figure 63 and 64A -64B is described in more detail.

[0546] Some embodiments of the present invention utilize a rotary encoder for measuring data retrieved into an electromechanical 3D tracking system (e.g., such as...). Figures 23A-23CThe system shown measures the precise length of an external extendable rope. This length calculation is accomplished by measuring the amount of rotation of the mechanically linked rope due to retraction using an encoder. The rotary encoder is either directly mechanically linked to the transverse rope or linked to a reel storing several turns of the rope. This component of the electromechanical tracking system provides precise length measurement of the extendable rope between the acquisition unit and the probe. The rotation measurement system of the electromechanical tracking system consists of a system capable of measuring rotation and any supporting mechanical systems capable of enabling or enhancing the rotation measurement process. The rotation measurement system mechanically interfaces with the extendable rope and / or the reel / tension system to measure the linear distance of the extendable rope interfaced with the encoder. For example, one embodiment of the rotation measurement system is... Figure 16 The rotary encoder 1600 is shown. A rotary encoder is an electromechanical device that converts the position or movement of a shaft 1630 about a body 1610 into an electrical signal. In some embodiments, the electrical interface 1650 of the rotary encoder depends on the type and manufacturer of the rotary encoder. The internal circuitry within the rotary encoder 1600 can automatically calculate the amount of shaft rotation, the direction of shaft rotation, or transmit measurement data via a digital or analog interface. The method and interface through which it transmits rotation measurement data are not critical to the encoder system. Only the angle and direction of rotation of the shaft 1630 are important for calculating linear distance. In other embodiments, a potentiometer can also be used to measure rotation, particularly absolute rotation, which eliminates the need for length calibration to measure the length of an extendable cable actively retracted outside the electromechanical 3D tracking system.

[0547] Figure 17A The invention illustrates some embodiments of the invention with Figure 16 The encoder 1600 is used in conjunction with the pulley and gear system 1701, and Figure 17B Some embodiments of the present invention are shown. Figure 17A The pulley and gear system 1701 has gear 1710. Figures 23A-23B This component of the electromechanical 3D tracking system depicted in the image enables increased accuracy in measuring the length of an extendable rope that traverses the housing and extends beyond the system's reach. Figure 20 The probe 2000 is shown in the diagram. The pulley-gear embodiment 1701 enables the measurement of rotational speeds by the encoder to be multiplied by a factor that is almost equal to the gear ratio between the gear set mechanically arranged between the rope interface pulley 1710 and the encoder-shaft gear 1715. Figure 16 The encoder shaft 1630 depicted in the figure is actuated based on gears.

[0548] Some embodiments include a pulley and gear system mounted between the encoder shaft, the retraction spool / tension system, and / or the extendable rope to increase... Figure 16 The accuracy of the rotary measurement system shown. An embodiment of the pulley and gear system is shown in...Figure 17A As shown in the diagram. The linear movement of the extendable rope 1705 is coupled to the pulley-gear 1710 by utilizing the surface friction between the extendable rope 1705, a passive pulley 1707 that helps to wind the rope 1705 around the pulley-gear 1710 to maximize friction and prevent rope slippage, and a high-friction O-ring 1748 around the inner diameter of the pulley. The pulley-gear 1710 (in...) Figure 17B (As shown in detail) mechanically interfaces with the rotary encoder shaft gear 1715, and during the linear movement of the extendable rope 1705, any rotation of the pulley-gear 1710 corresponds to a greater degree of rotation of the rotary encoder shaft gear 1715, wherein the relationship of the corresponding rotations is determined by the gear ratio between 1710 and 1715. The resolution of the rotary encoder 1720 can be increased by a fixed amount using the pulley-gear system 1701, resulting in increased measurement accuracy of the extendable rope length. In some embodiments, the pulley-gear 1710 may be designed with a notch 1745 to allow easy removal of the O-ring, and a cut 1740 at the center of the pulley-gear 1710 is designed to allow insertion of a bearing that enables the pulley-gear 1710 to rotate about its central axis with minimal friction, which can have a significant impact on the ease of use of the system, allowing the user to responsively retract the probe.

[0549] Some embodiments of the surface of the pulley-gear 1710, which mechanically interfaces with the extendable rope 1705, may include a specific geometric cross-sectional profile that enhances friction between the surfaces of the extendable rope 1705 and the pulley-gear 1710. One exemplary embodiment includes a V-groove that clamps onto the surface of the rope 1705, and this design creates a tight tolerance fit between the rope and the pulley-gear 1710 when the entire system is under tension. Other embodiments may include a direct link between the pulley-gear system and a tensioned reel system (see below). Figures 18A-18B (To be described in more detail), the reel system stores multi-turn extendable rope.

[0550] Figure 18A A perspective view of a rope reel for the pulley-gear system of FIG17, according to some embodiments of the present invention, is shown. Figure 18B A side view is shown. Figure 23C This component of the electromechanical 3D tracking system shown involves a helical storage of an extendable rope to be inserted into and removed from the reel at predetermined rope lengths / circumferences per revolution. Some embodiments involve a reel coaxially connected between the reel and the encoder shaft. Figure 16 The rotary encoder depicted has a direct mechanical interface for measuring the number of revolutions of a line extending away from the housing at any given time.

[0551] One embodiment of the reel system includes a link with a tension system that provides a counterforce to the extendable rope 1705 to maximize... Figure 17A The pulley-gear system and / or shown Figure 16 The coupling in the rotary encoder 1600 is shown. In some embodiments, the tension system can be preloaded with a rope and tension-tuned to ensure no slack along the extendable rope. If slack is introduced on the rope, accurate measurement of the rotational degree around the encoder system is not optimal. One embodiment of the retraction reel / tensioning system is a spring-based system that provides tension to the extendable rope. One embodiment of the retraction reel / tensioning system may include a subsystem to allow different degrees of tension of the extendable rope to conform to user specifications. One embodiment of the retraction reel / tensioning system may include a mechanism that slows and / or stops the movement of the reel in the event of a sudden release of the pre-tensioned extendable rope to prevent the extendable rope from traveling at dangerously high speeds.

[0552] This retractable reel provides a system through which the extendable rope can be contained. For example, as... Figures 18A-18B As shown, one embodiment of the rope reel 1800 comprises a cylindrical disk 1805 with the rope inlet groove 1840 removed from the side, allowing the rope 1705 to rotate about the center of the reel with a predetermined rotation increment. This embodiment may have a rope inlet groove 1840 with a thickness much greater than the rope diameter. This embodiment may have a rope inlet groove 1840 approximately equal to the rope diameter, forcing the rope to spiral outward from the center of the reel in a single-turn-thick helical stack. This embodiment may have an internal rope reel radius 1820 of a fixed value. This embodiment may have an internal rope reel radius 1820 that can be expressed by an equation. In one embodiment, the radial distance of the Archimedean spiral is equal to the diameter of the rope, such that the retractable rope continuously winds around itself as described by the Archimedean spiral, which simplifies the calculation of the distance between the reel center and the rope center, in addition to the calculation of the linear rope distance.

[0553] One embodiment involves the rope being secured to the reel at a known radius defined by the design mounting point 1830 of the reel 1805. Another embodiment involves winding the rope around the inner surface of the rope reel (defined by the inner radius 1820) until the rope length is fully contained within the reel 1800 or when the rope reaches the outer edge of the reel (defined by the outer radius 1810). A larger outer reel edge allows for greater torque to be applied through rope movement and less resistance felt by the user when the rope tensioning system retracts. However, the large inner radius surface results in less accurate measurements due to the increased rope length, which increases the single-resolution step size for the encoder's rotational sensitivity.

[0554] In the rotary measurement system described herein, the extendable rope 1705 provides a mechanical connection between the retractable spool and the rotary measurement sensor. The extendable rope 1705 provides a probe ( Figures 20A-20E ) and encoder system 1600 ( Figure 16 The mechanical connection between the probe and the wire allows for three-dimensional measurement of the probe tip position as the probe moves through space. A common embodiment of the extendable cord 1705 is a small-diameter, low-tensile cord. One embodiment of the extendable cord is a metallic cable, some of which incorporate a special coating, such as a nylon coating. Another embodiment of the extendable cord is a Kevlar cable.

[0555] Figures 19A-19C Some embodiments according to the present invention are shown. Figure 23A The sphere component 1900 of the 3D tracking system. Figures 23B-23C The component of the electromechanical 3D tracking system shown includes a ball-and-socket interface that is manipulated by lateral movement of an extendable cord 1705 passing through the center of a ball. In some embodiments, the extendable cord (e.g., Figure 17A Rope 1705 shown Figure 21A Rope 2120 shown, or Figure 21B The rope (2150) shown can pass through the central cylinder and traverse the ball-and-socket system through the entrance at the rope insertion point (rope entry channel 1903). The rope entry point is designed to intersect with the center of the spherical structure and subsequently align with the center of rotation of the ball. This alignment of the rope entry point 1903 allows the movement of the rope to be mathematically divided into two parts, the rope storage system (e.g., Figures 18A-18B The straight line between the center of the spool shown and the center of the ball 1903, and the center of the ball 1903 and the probe (e.g.) Figure 20 The straight line between the mounting posts on the probe shown. In some embodiments, the cylinder is supported by a mechanical structure added to minimize undesirable forces and torques exerted by the rope that can deflect the cylinder during rope movement. In some embodiments, the ball assembly may include a cylindrical support structure 1940 for the ball (or sphere) 1901. As the cylinder moves away from the front of the ball, it is internally supported by a reinforcing wall 1902. To minimize cylinder deflection in the rope entry position, the support rod 1940 provides mechanical stiffness to the cylinder to minimize deflection generated during rope movement.

[0556] In some embodiments, the sphere includes a cylindrical groove 1950 projecting from the top of a spherical surface, which allows for the mounting of an image or any unique pattern without any spherical deformation of the patterned surface. Therefore, by examining how the pattern on the cylindrical groove 1950 rotates and translates relative to the imaging sensor, the imaging sensor can be used to visualize and measure the sphere in spherical coordinates θ and θ. Rotation within the cylindrical recess. To maintain alignment of the cylindrical recess with the center of the ball 1901 and the imaging sensor, the ball 1901 includes an orthogonal protrusion (anti-roll bar 1920) relative to the cylindrical window. When inserted into a complementary mating groove, the protrusion prevents the ball from rotating around the cylindrical structure. The mating groove restricts the movement of the anti-roll bar to a linear arc orthogonal to the cylindrical recess 1950.

[0557] In some embodiments, such as Figure 19B and 19D As shown, ball 1901 includes a cylindrical tube 1930 that begins inside ball 1901 and extends radially to a fixed distance in front of ball 1901. A rope (e.g., rope 1705) can pass through a protrusion in the rear of the ball, enter the tube at a rope insertion point (as shown in 1903), pass through the tube in front of the ball, and exit from the tube in front of the ball (through tube 1930). Tube 1930 includes multiple holes (tube window 1922) to reduce the surface contact area between the interior of tube 1931 and the exterior of the rope, which helps ensure smooth rope movement through tube 1930. The tube is designed to provide a fixed exit point for an encoder (e.g., encoder 1600) to calculate the linear rope pitch. As tube 1930 extends from the front of ball 1901, it is externally supported by a reinforcing wall with a rounded bottom corner (rounded tip corner 1924) of the tube shaft. Furthermore, in some embodiments, the cylindrical groove 1950 provides a surface with a flat cross-section from which the imaging sensor can calculate the degree of rotation of the sphere without requiring additional transformations caused by pattern deformation (e.g., cylinder deformation). Reference Figure 19C The cylindrical groove (groove 1950) protrudes from the top of the spherical surface and allows for the mounting of images or any unique patterns without any spherical deformation of the patterned surface. In some embodiments, a support structure shown as reinforcing the stiffness of the cylinder is not required in the final manufactured product, and the support structure may include components for prototypes produced by 3D printing with brittle materials.

[0558] Figure 19D-19E Some embodiments of the present invention are shown. Figure 23AThe ball-and-socket assembly of the 3D tracking system. The socket housing 1950 of ball 1901 provides a mating surface in which it rotates due to the lateral movement and trajectory changes of the telescopic rope. The socket embodiment includes a window cutout 1980 that restricts the movement of cylinder 1930 within a defined range of movement (in window 1932). The boundary of the window helps maintain optimal tracking volume for the electromechanical 3D tracking system without having multiple ball-and-socket systems that allow the ropes to cross or obstruct each other. The system also includes complementary anti-roll channels 1976 that allow the rod protrusion 1920 to travel from the restricted movement of the ball along a path that prevents ball 1901 from rotating around its cylinder 1930. The roll-limiting features of the system (1920, 1976) ensure that the cylindrical window is in a constant field of view within the sensor's preview window 1999, so that any movement of the pattern will always be visible to the imaging sensor. Multiple socket areas 1998 are removed from the top and bottom of the socket structure to minimize surface friction between the exterior of the ball and the interior of the socket. As repeatedly mentioned, minimizing friction between the socket, ball, and rope is paramount for the functionality of a 3D tracking system. The proposed method represents one embodiment of a ball-and-socket structure. One embodiment may include a layer of ball bearings mounted between the ball and socket surfaces. One embodiment may include some form of lubricant placed between the ball and socket surfaces. One embodiment may include some form of lubricant placed between the cylinder and rope surfaces. High-strength and high-durability materials are required to maintain the structural integrity of the ball-and-socket system. Other embodiments of the ball-and-socket system may be constructed of metals, polymers, and / or plastics.

[0559] Figure 20 A probe 2000 for a 3D tracking electromechanical system according to some embodiments of the present invention is shown. Figures 20A-20E Some embodiments of the present invention are shown. Figure 20 A view of the components of the probe 2000. Figures 23B-23CThis component of the electromechanical 3D tracking system depicted relates to a probe for registering 3D points in space, while the tracking system dynamically registers the probe's 3D position and orientation relative to the tracking system's coordinate system. The probe 2000 includes two freely rotatable fixed points 2010, where the distal ends of an extendable cord (e.g., 1705) being tracked in 3D space are mounted separately at fixed distances. In some embodiments, the probe 2000 may include a probe shaft 2025. The probe 2000 provides various functions for the electromechanical 3D tracking system. First, the probe 2000 allows the user to trace along a 3D surface. Second, the probe provides a fixed mechanical interface with the extendable cord of each encoder. The 3D orientation of the probe 2000 can be derived from calculated linear cord distances from each encoder, the rotation value (spherical coordinates) of the previously described ball 1901 within its ball-and-socket joint, the fixed distance between each cord connection point, and trigonometric identities. Using the orientation of the probe 2000 and the linear cord distances, the precise position of the probe tip 2024 can be extrapolated in 3D space. Third, the probe 2000 has the ability to identify interactions with a variety of materials through electrical, mechanical, optical, and / or electromechanical interfaces. Fourth, the probe 2000 has a gripping area 2025, which allows the user to hold the probe 2000 and trace three-dimensional surfaces without interfering with the rope or any additional measurement system.

[0560] Figure 20 An embodiment of the probe 2000 is shown, which has mounting points 2010 for two ropes. (Source: encoder (e.g., previously mentioned)) Figure 16 The cord (described herein) can be coupled to cord mounting members 2010, each of which is mechanically coupled to a separate bearing 2044 separated by cord mounting spacers 2001 coupled to probe shaft 2025, wherein the inner surface of each bearing is substantially rigidly linked to an internal rod structure (not shown) coaxial within the probe housing. Spacers 2001 and bearings 2044 are coaxial with the internal rod (e.g., see bearing 2044) fixed to the probe half 2025 that the user can grip. In some embodiments, the internal rod structure is held within the probe housing via a rigid cap 2005. However, it should be noted that several components, including but not limited to the probe cap 2005, are not essential to the functionality of the device. The cord mounting and bearing system allows the probe 2000 to move freely in any direction without affecting the accuracy of the measurement system in the encoder embodiment. The probe gripping area (on shaft 2025) provides space for the user to trace in three dimensions.

[0561] Some embodiments include Figures 23A-23C The electromechanical 3D tracking system depicted involves a probe mechanically linked to two tether anchor points for 3D tracking, the anchor points being spaced apart at an adjustable distance via mechanical actuation between the two anchor points. For example, Figures 21A-21BComponents of a 3D tracking system are shown, including probes 2100a and 2100b coupled to rope anchor points (see extendable ropes 2120 and 2150 extending from probes 2100a and 2100b). In some embodiments, the probes include probe handles 2130a and 2130b having a spring-loaded trigger 2140 (of probe 2100b) and pressable sliding shafts 2115a and 2115b. Each 3D tracking probe 2100a, 2100b includes an embedded mechanical system that increases the distance between dynamic rope mounts (2135a for probe 2100a; 2135b for probe 2100b) and static rope mounts (2136a for probe 2100a; 2136b for probe 2100b) when the pressable shaft (spring-loaded; spring not shown) 2115a linked to probe 2100a is pressed against a surface, or when manually actuated by a user via a spring-loaded button 2140 on shaft 2130b of probe 2100b, selectively altering the distance between the extendable rope mounts. Extendable ropes 2120, 2150 are mechanically linked to an electromechanical 3D tracking system (…). Figures 23A-23C (Example embodiment shown).

[0562] In some embodiments, the processing algorithm detects changes in the relative distance between rope mounts and signals the electromechanical 3D tracking system. It should proactively register points at the probe tip or interpret specific commands specifying the type of measurement the probe is performing or the identity of the object the probe is interacting with. By substantially rigidly transforming the 3D rope mount coordinates relative to the probe tip coordinates and orientation, the distance between two dynamic rope mounts can be calculated relative to the probe's axis. This allows for the calculation of the 3D distance between rope mounts without variations in the calculation due to changes in the relative distance between the rope mount and its distance to the electromechanical 3D tracking system compared to other rope mounts.

[0563] Figure 22 An example system capable of 3D tracking of a probe is shown according to some embodiments of the present invention. Figures 23A-23C The component of the electromechanical 3D tracking system shown relates to a system of active and passive components that communicate to enable 3D tracking of the probe's position and orientation. Numerous embodiments exist of probes linked to electromechanical 3D tracking systems. Figure 22 An interface between systems of components that communicate with each other to achieve 3D tracking of a probe is depicted. Some embodiments include probes without electrical or mechanical feedback systems, which are detected by encoder embodiments and processing software during tracing, as described in the embodiments above. In some embodiments, probes with embedded electronic systems ( Figure 22It can contain too many user-controlled toggle switches, allowing user control point registration and active probe tracing. Figures 21A-21B Some embodiments include a method of communicating with a microcontroller or computer processing system, the communication being transmitted via a radio electromagnetic radiation (RF) light-emitting device. In some embodiments, the rope may be mechanically linked to the docking tracking system. Some embodiments include a method of delivering power to the probe for position tracking by applying a voltage to two ropes mechanically linked to the probe. A rechargeable battery system or equivalent energy source, such as a capacitor, may be included. In some embodiments, an electrical connection exists between the probe and the housing to provide power during non-use periods when the probe is on the housing. In some embodiments, the multiple sensors of the sensing system may be multiple inertial measurement units, accelerometers, and / or gyroscopes for measuring the movement and / or attitude of the probe. This embodiment may eliminate the need for mechanical links to an encoder or an extendable rope. One embodiment may be a tilt sensor. One embodiment may be a sensor that measures the rotation of a rope mount on the probe. One embodiment may be a system that measures the mechanical forces applied to the probe and / or the probe tip. In some embodiments, a radio frequency identification (RFID) tag and / or reader placed at a fixed location on the probe may include an RFID reader and RFID placed within the probe. The RFID reader reads the RFID tag for registration of start or stop points and active tracking of the probe tip in 3D. One embodiment of RFID is an RFID reader placed within the probe that reads an RFID tag placed at a specific location to identify the location using a specific identifier during probe use. For example, see the power storage device 2212, power interface 2214, communication system 2216, microcontroller 2218, sensor 2220 and RFID 2222 of probe 2210, a cord 2230 coupled to encoder 2226, a cord 2232 coupled to encoder 2228, digital signal 2234a (from encoder 2226), and digital signal 2234b (from encoder 2228) of probe 2210. Furthermore, see the data acquisition controller 2224, which is coupled to data storage and processing software in a computer system 2238 coupled via interface 2236.

[0564] Some embodiments of the present invention include a housing for an electromechanical 3D tracking system that houses all components of the tracking system in a compact form, the components of which can be mounted on multiple various surfaces. For example, Figure 23A An example 3D tracking system 2300 according to some embodiments of the present invention is shown, including a ball-and-socket structure 2320 (e.g., as previously discussed). Figures 19A-19EThe description includes an extended extendable cord 2350, a coupled probe 2340, and a rigid surface mount 2305 coupled to structures 2310, 2330. As shown, one embodiment includes an interface for fastening the mounting mechanism, enabling it to be used in various settings. The fastening mounting mechanism 2305 may include, but is not limited to, suction cup mounts or fastening holes for mating with rigid structures (e.g., such as 2310, 2330). Some embodiments of the mounting mechanism 2305 include hooks and clamps for interfaceing with a removable instrument tray on an operating table, bed, anesthesia bar, a movable support (e.g., a Mayo support), and / or any other rigid structure configured to be positioned above or near the patient's surgical site, above or near the patient's anatomy. Some embodiments involve the user collecting discrete and continuous tracer registrations by using the extended cord (shown as 2350) retracted from the probe 2340.

[0565] In some embodiments, the components of the electromechanical 3D tracking system may be compiled into a compact design and surrounded by a housing device 2350. For example, Figure 23B A 3D tracking system in a housing 2360 according to some embodiments of the present invention is illustrated. In some embodiments, the housing 2360 is shown having an extendable rope 2370 extending from cylinders 2367, 2372 of balls 2374, 2365 (wherein the rope is coupled to a probe, such as...). Figure 20 The probe 2000). In some embodiments, the housing 2360 may protect internal components from debris, trauma, bodily fluids, and light exposure. Furthermore, the housing 2360 may include an external probe mounting system to hold the probe (e.g., such as an extendable probe system) when not using an extendable probe system. Figure 20 The probe 2000 shown is substantially rigidly fixed to the housing 2360. In some embodiments, the housing also houses a reel system (as previously described). Figures 17A-17B (As shown in 18A-18B), the reel system outputs two extendable ropes to attach to the probe, and each rope 2370 passes through the cylindrical structures 2367, 2372 of each ball 2365, 2374 to realize the probe (e.g., Figure 20 Electromechanical triangulation measurement using the probe 2000 shown.

[0566] Some embodiments include an internal light source to prevent variability in the camera system's illumination. Some embodiments include an electrical interface through which power and / or data can be transmitted to and / or received from the probe when it is docked. One embodiment of the electrical interface may be a metallic contact extending from the probe mounting system to couple to electrical contacts on the probe.

[0567] Figure 23C Some embodiments according to the present invention are shown. Figure 23BAn exploded view of the components of a 3D tracking electromechanical system. For example, some embodiments include a rotary encoder 2399, a retaining spring tension arm 2390 for a reel spring (not shown), a reel 2392, a lower half 2394 of a housing, and an upper half 2395 of a housing (see reference). Figure 19D-19E ), embedded unique pattern 2383, ball 2374 (reference) Figures 19A-19C ), the outer shell 2361 of the sphere cylinder 2365 and the outer shell cover 2362 with an embedded optical sensor (not shown). Figure 23C This diagram illustrates the components of one embodiment of an electromechanical 3D tracking system. Each of two rotary encoders 2399 measures the length of an extendable cord coupled to a probe (not shown). Each extendable cord (not shown) is stored in and retracted from a reel 2392 tensioned by a spring (not shown), one end of which is secured by a spring tensioning arm 2390, which is mounted to a rigid housing 2361. Each extendable cord passes through a ball 2374, which can be viewed through a viewing window (not shown). Figure 19D-19E The ball rotates within the sockets (2394, 2395) via a cylinder 2365 originating at the center of the ball 2374, allowing control of the rope's movement during the ball's rotation. The ball's rotation is measured by an embedded pattern 2383 on the ball's surface 2374, aligned above the ball's center and reflecting the ball's rotation in spherical coordinates. The sensor rotates at θ to visualize the image through the imaging sensor above. The housing includes a cover 2362 coupled to a bottom component of the housing 2361, which helps create a protected environment while also housing an optical sensor (not shown), a lamp (not shown), and a microcontroller (not shown) for recording and analyzing visual and electrical outputs from the embedded optical sensor and rotary encoder. In other embodiments, wireless communication components (not shown) are also included in the housing.

[0568] Figure 24A system capable of 3D tracking of a probe according to some embodiments of the invention is illustrated. This embodiment describes a system of components capable of electromechanically positioning a 3D point at the tip of a probe (e.g., any probe as described herein). Three extendable cords (2428, 2430, 2432) are mechanically linked to the probe tip 2421 of probe 2420 via connectors extending from three separate rotary encoders 2422, 2424, 2426 that measure the length of each cord, from which a software system calculates the 3D point of the probe tip via triangulation geometry equations. Embodiments of the encoders (e.g., those of encoders 2422, 2424, 2426) are represented by a spool wound with the extendable cords (e.g., 2428, 2430, 2432), a spring-loaded retractor system (not shown) that can be represented by any system providing tension, and a rotary encoder that can be represented by other sensors for detecting the degree of rotation. The three encoder embodiments are positioned at a fixed distance relative to each other. The probe 2420 includes a single wire mounting connector at the probe tip 2421, through which all the ropes 2428, 2430, and 2432 interface with the probe 2420. As the probe 2420 moves in 3D space, individual, different rope lengths are transmitted via rotary encoders 2422, 2424, and 2426 (e.g., as...). Figure 16 The length of the extended rope is measured using the encoder (as shown in the diagram); however, other sensors can be used to detect the length of the rope. Using the known distances between each encoder 2422, 2424, 2426 and the measured rope length to the probe tip 2421, the system's triangulation algorithm processes the data geometrically to calculate the 3D position of the probe tip 2421. A three-rope encoder system requires at least three encoder embodiments to calculate the 3D position of the probe 2420.

[0569] Figures 23B-23C Another embodiment of the electromechanical 3D tracking system shown can be included in Figure 25 In the system of components shown, the movement of the ball-and-socket joint is sensed by a mechanically linked rotary encoder that measures the Φ and θ movement of the ball in spherical coordinates (e.g., each ball-and-socket system or component uses two encoders). Figure 25The encoder-based 3D tracking system embodiment shown includes a probe 2510, ropes 2520 and 2522, encoders 2514 and 2526, mechanical linkages and measurements 2518, 2512, 2528, and 2530, a ball socket 2516 and 2524, digital signals from encoders 2515 and 2527, digital signals from mechanical linkages and measurements 2517, 2529, 2513, and 2531, data acquisition controllers 2550 and 2555, and a computer 2560. Each ball socket 2516 and 2524 is mechanically linked to two encoders 2514 and 2526. An extendable rope 2520 and 2522 passes radially through a cylinder located at the center of the ball and is connected to the probe 2510, allowing the cylinder to follow the position of the extendable rope. Because the cylinder is fixed at the center of the ball, and the axis of rotation of the ball is fixed by a rod located in a groove on the socket, the ball cannot rotate radially about the axis of the cylinder, and the cylinder can track the position of the probe. As the probe moves through 3D space, the rotation of the measuring sphere within the socket allows for the calculation of the cylinder's angle takeoff in spherical coordinates. (See also: Regarding...) Figure 16 As described, the rope length is measured via rotary encoders 2514 and 2526; however, other sensors can be used to detect the length of the extended rope. Measurements of the rope length and takeoff angle provide sufficient data to calculate the probe's 3D position in a spherical coordinate system.

[0570] One embodiment of a measurement system for calculating the angular take-off is a mechanical link between the ball surface and a rotary encoder; however, other sensors can also be used to detect the degree of rotation. As the ball rotates at θ due to probe translation... When rotating in the direction, the mechanical links (2512, 2518, 2528, 2530) cause the shaft of the rotary encoder (2514, 2526) to rotate, and the degree of rotation of the ball in each spherical coordinate plane can be calculated.

[0571] One possible mechanical link is a spherical or cylindrical coupling object, radially fixed to, such as Figure 16 The rotary measurement system described herein. One embodiment of the rotary measurement device may be a rotary encoder. The position of the rotary encoder is fixed such that the cylindrical object is in physical contact with the ball and is mechanically fixed to the rotary encoder shaft. Any movement of the probe results in the rotation of the ball, the rotation of the cylindrical object, and therefore the rotation of the rotary encoder shaft. Two mutually orthogonal embodiments of the described mechanical links (2512, 2518, 2528, 2530) are required to calculate the cylinder of the ball at θ and Rotation in direction.

[0572] In some embodiments, the algorithm calculates the radius of the sphere with respect to θ based on the radius of the cylindrical object, the rotation measured by the rotary encoder, and the radius of the sphere. The degree of rotation. In the calculation cylinder After θ, the system then uses spherical coordinate formulas to calculate the vector from the center of the ball to the position of the first rope when it engages with the probe. The same process is repeated for the second ball-and-socket pair, also using a mechanical link to sense the spherical rotation of the ball. The second ball-and-socket system calculates a 3D vector from the center of the ball to the end position of the second rope when it engages with the probe.

[0573] The probe's orientation is then calculated by subtracting the two calculated rope vectors. Given the probe's known dimensions and the distance between the rope anchor points on the probe, the three-dimensional position and orientation of the probe tip can be extrapolated.

[0574] Figures 23A-23C Another embodiment of the electromechanical 3D tracking system shown may include Figure 26 The system shown in the diagram involves a ball-and-socket joint where movement is sensed by an optical sensor that interprets the rotation and relative position of the ball mounting pattern with respect to an image sensor. This system measures the ball's position in a spherical coordinate system. And θ moves. Figure 26 The system 2600 shown, capable of 3D tracking of the probe's position and orientation, comprises a combination of mechanical, electrical, electromechanical, and optical components including a probe 2610, coupled cables 2612, 2614, coupled ball-and-socket assemblies 2616, 2620, unique patterns embedded in the surface of the spheres 2617, 2621, encoders 2618, 2622, cameras 2624, 2628, processors or controllers 2626, 2630, data acquisition 2632, a computer 2634, and a modem 2636. Two encoders are capable of measuring the length of the cable, and the two ball-and-socket assemblies enable measurement of the cable trajectory passing through the center of the sphere (see [link to documentation]). Figures 19A-19E An optical sensor and a unique pattern embodiment for each sphere-dwelling embodiment used to measure the spherical rotation of a sphere (in...) Figures 27A-27D (Depicted in the image). One probe embodiment links a 3D-tracking, extendable tether in 3D space and provides the user with a medium for acquiring 3D points (such as...). Figure 20 (As depicted in the text).

[0575] In one embodiment, an extendable cord passes through the center of rotation of the ball and exits via a radial tube that follows the position of the extendable cord end mounted to the probe. The position of the ball's center is fixed by the ball itself, which is constrained by a grooved socket to allow the tube free movement to track the exiting cord. The socket ensures that the ball cannot rotate about its tube axis via a radial groove that receives a complementary rod tip mounted to the ball and concentric with the ball's center.

[0576] The rope length is measured using a rotary encoder; however, other sensors, such as potentiometers, can be used to detect changes in rope length during use. Since the portion of the extendable rope beyond the center of the ball is no longer always coaxial with the beginning of the extendable rope near the encoder, the angle at which the rope passes through the ball must be measured to generate the spherical coordinates needed to calculate the 3D position of the rope end mounted to the probe.

[0577] One embodiment of calculating the angular takeoff of the ball from the cylinder is to embed a pattern on the cylindrical window of the ball, such that as the ball moves due to the translation of the rope in space, the pattern simulates the coordinate system generated by the cylinder relative to the center of the ball. It rotates around the center of the ball in a manner that is θ angle.

[0578] One possible pattern is a chessboard, with each square of the board containing a unique black and white label pattern similar to the pattern used in augmented reality registration markers (e.g., ...). Figure 26 (As shown by reference numerals 2617 and 2621 in the attached diagram). This unique chessboard has an established xy coordinate system, such that one corner of the chessboard is the origin, and each square represents a unit of known size.

[0579] An optical sensor embedded in the socket records the visible portion of the entire pattern as seen through the preview window of the socket, with the sensor concentrically positioned with both the center of the sphere and the preview window of the socket. The optical sensor transmits image frames to processing software to utilize computer vision algorithms to detect all visible corners of the chessboard pattern, identify features of each visible square, and reference the known position of each square within the entire pattern. Pixels in the image frame are converted to millimeters or any other physical unit by calculating the ratio between pixels and millimeters of the known side length of one of the visible squares on the pattern surface. The center of the image frame represents the center of the sphere.

[0580] The algorithm then calculates the absolute position of the image center along the unique pattern, thereby identifying the precise position in units of the physical pattern. When the cylinder is concentric with the side window of the socket, the vertical position of the image center is used to calculate θ of the cylinder by identifying the arc length between the current image center in the valid image frame and the position on the pattern surface aligned with the image center, resulting in θ being zero. This arc length input is combined with the known radius of the pattern surface relative to the center of the sphere, and then θ is calculated using the arc length formula extrapolated from the arc segment angle. The θ angle of the cylinder represents the vertical movement of the cylinder.

[0581] Furthermore, the vector between the checkerboard corner closest to the image center and the corner closest to the first corner is calculated, with the corners perpendicular to each other in the coordinate system of the pattern. A second vector is calculated along the vertical axis of the image, passing through the image center. The algorithm calculates the relative angle between the two vectors by calculating the inverse cosine of their cross product; this calculation can also be performed in several different ways using known geometric formulas. The angle between these vectors represents the cylinder's... The angle, indicated by the left and right movement of its indicator cylinder. The position of the image center via a unique pattern and the attitude calculation cylinder relative to the optical sensor. After θ, given the input length of the rope passing through the center of the sphere, the system then uses spherical coordinate formulas to calculate the end position of the rope end that mates with the probe tip. Given two rope anchor points with known, calculated 3D positions on the probe axis, the system can calculate the 3D vector between the two anchor points, then extrapolate the 3D position of the probe tip, given the known dimensions of the probe, and calculate the offset between the probe tip and the 3D line.

[0582] The same process is repeated for a second ball-and-socket pair, which also has an embedded pattern and optical sensor combination, to calculate the 3D position of the second extendable cord end mounted to the probe. One embodiment of the electromechanical 3D tracking system involves using optical sensors to measure the spherical rotation of a ball corresponding to the movement of the extendable cord, which traverses the center of rotation of the ball. When the cylinder is in the spherical coordinate system of the ball... When the system translates left or right in the plane, the embedded pattern also rotates by the same angle because the pattern visible to the camera is aligned above the center of the sphere. Therefore, the system measures the angle of the pattern relative to the optical sensor to calculate the cylinder's position in spherical coordinates. Angle 2710. Figures 23A-23C Some embodiments of the electromechanical 3D tracking system shown may include the use of unique patterns embedded on the surface of a sphere, such as Figures 27A-27D As shown (and previously regarding) Figure 23C (Discussion 2383), where the movement of the ball-and-socket joint is sensed by an optical sensor that interprets the rotation and relative position of the ball mounting pattern 2701 relative to the image sensor. This unique pattern enables the system's computer vision algorithm to calculate the absolute position of the image sensor's center relative to a grid-based pattern coordinate system. The system measures the ball 2705 in spherical coordinates. θ2710 and θ2715 move. Unlike typical optical sensors used in computer mice, this system does not lose its sensing of position relative to the pattern if an image frame is lost or cannot be calculated for any reason, because the pattern provides the system with the ability to calculate its absolute position on its surface. As shown in the figure, the cylinder... Rotation 2710, Sphere 2705, and Pattern 2701.

[0583] refer to Figure 27B An embodiment of the electromechanical 3D tracking system involves using an optical sensor to measure the spherical rotation of a sphere corresponding to the movement of an extendable cord that traverses the center of rotation of the sphere. As the cylinder translates vertically up and down in the θ plane of the sphere's spherical coordinate system, an embedded pattern translates away from the center of the image sensor as the sphere rotates about the y-axis. The system then measures the position of the image center relative to a grid coordinate system to calculate the translation along the vertical portion of the grid, and then uses the known radius between the sphere's center and the pattern surface to calculate the θ angle 2715 of the cylinder in spherical coordinates.

[0584] refer to Figure 27C-27D The algorithm calculates the vector between the chessboard corner closest to the image center and the corner closest to the first corner, where the corners are perpendicular to each other in the coordinate system of the pattern. It also calculates a second vector along the vertical axis of the image, passing through the image center. The algorithm calculates the relative angle between the two vectors by calculating the inverse cosine of their cross product; this calculation can also be done in several different ways using known geometric formulas. Using one vector from each of grid axis 2721a and camera axis 2719a, the vector closest to zero is selected. The angle is calculated using two vectors. The angle between these vectors represents the angle of the cylinder. The angle, its indicator cylinder moves left and right. The position of the image center via a unique pattern and the attitude calculation cylinder relative to the optical sensor. After θ, given the input length of the rope passing through the center of the sphere, the system then uses spherical coordinate formulas to calculate the end position of the rope end that mates with the probe tip. The angle θ of the tube represents the vertical movement of the tube. The system algorithm calculates the absolute position of the image center along a unique pattern, thus identifying the precise position in units of the physical pattern. First, the rotation of the grid axis 2721b is identified, and then the image center 2722 relative to the camera axis 2719b is identified. Next, the projected length of the vector between the grid axis origin 2723 and the image sensor center 2722 is calculated. This arc length input is combined with the known radius of the pattern surface relative to the center of the sphere, and then θ is calculated using the arc length formula extrapolated from the arc segment angle.

[0585] Figures 23A-23C Another embodiment of the electromechanical 3D tracking system shown may include Figure 28A The system shown includes components in which ball-and-socket movement is sensed by an optical sensor that interprets the relative translation of the ball's surface with respect to an image sensor as the ball rotates due to the movement of the cylinder. The system measures the ball's position in a spherical coordinate system. and θ movement. System 2800 may include an encoder embodiment for measuring the length of the rope, two ball-and-socket assemblies for measuring the rope trajectory passing through the center of the ball, two optical sensors for each ball-and-socket assembly for measuring the translation of the ball's surface relative to an image sensor to calculate the spherical rotation of the ball, and a probe assembly for linking the extendable rope for 3D tracking in space and providing a medium for acquiring 3D points to the user. For example, system 2800 may include coupling components including a probe 2802 with a probe tip 2803, ropes 2804, 2805, ball-and-socket assemblies 2809, 2815, optically coupled sensors and processing boards 2807, 2813, 2819 and 2821, coupled encoders 2811, 2817, data acquisition microcontrollers 2823, 2825, and a computer system 2827 with data storage and processing software.

[0586] For each ball-and-socket embodiment, there is one encoder embodiment and two optical sensor embodiments. An extendable cord passes radially through a cylinder located at the center of the ball and connects to the probe, allowing the cylinder to follow the position of the extendable cord. Because the cylinder is fixed at the center of the ball, and the ball's axis of rotation is fixed by a rod located in a groove in the socket, the ball cannot rotate radially about the cylinder's axis, and the cylinder can track the probe's position. Measurement of the ball's rotation in the socket as the probe moves through three-dimensional space allows for the calculation of the cylinder's angular take-off. Figure 16 As shown, the rope length is measured using a rotary encoder; however, other sensors can also be used to detect the length of the extended rope. Measurements of rope length and angled take-off provide sufficient data to calculate the probe's 3D position in a spherical coordinate system.

[0587] One embodiment of the measurement system used to calculate the angle of takeoff is a pair of optical sensors oriented perpendicular to the ball and orthogonal to each other, each optical sensor having an angle θ relative to the ball system. Spherical coordinate plane alignment.

[0588] In one embodiment, the light-emitting device emits light of a limited spectrum, which is reflected from the surface of a sphere and converted into an electrical signal by a photodetector array. An algorithm then processes the converted data to convert the photodetector array data into a translational change of the sphere's surface relative to the camera. The data acquisition and computation system converts the translational data from Cartesian coordinates to spherical coordinates, and then calculates the coordinates θ of the sphere based on the known radius of the sensed sphere. Rotation. One embodiment of the system may include an array of laser diodes and photodiodes, an array of light-emitting diodes and photodiodes, and / or an imaging sensor. Patterns or images are set on a cylindrical window of the sphere to increase the contrast, reflectivity, or sensitivity of the optical signal, and to produce a higher signal-to-noise ratio, as well as to increase θ and The accuracy of spherical coordinate calculations. Patterns or images may contain patterned and / or repeating variations in color and may be fabricated with reflective surfaces that maximize optical coupling between the light-emitting device and the photodetector array.

[0589] Another embodiment involves etching a surface pattern onto the surface of a sphere during the manufacturing process, and the surface pattern enhances the sensitivity of the optical signal to changes in the sphere surface at the slightest translational change relative to the image sensor.

[0590] Some embodiments may include an additional light source that provides illumination on the surface of the sphere with any possible finite spectrum, from which certain light source frequencies provide optimal sensitivity for the system to have high-resolution sensing of rotational changes, but without misestimating movement of artifacts that do not actually occur but are merely optical noise.

[0591] Figure 28B A computer system 2829 is illustrated, configured to operate and process components of any system disclosed herein. For example, in some embodiments, the computer system 2829 may operate and / or process computer-executable code of one or more software modules of any system shown in one or more figures herein, including but not limited to… Figure 24-26 And 28A. In some embodiments, system 2829 may include at least one computing device including at least one processor 2832. In some embodiments, at least one processor 2832 may include a processor residing in or coupled to one or more server platforms. In some embodiments, system 2829 may include a network interface 2835a and an application interface 2835b coupled to at least one processor 2832 capable of processing at least one operating system 2834. Furthermore, in some embodiments, interfaces 2835a, 2835b coupled to at least one processor 2832 may be configured to process one or more of software modules 2838 (e.g., enterprise applications). In some embodiments, software module 2838 may include server-based software and / or be operable to host at least one user account and / or at least one client account, and operate to transfer data between one or more of these accounts using at least one processor 2832.

[0592] Considering the above embodiments, it should be understood that the present invention can employ various computer-implemented operations involving data stored in a computer system. Furthermore, the aforementioned database and model throughout system 2829 can store analytical models and other data on a computer-readable storage medium within and coupled to system 2829. Additionally, the aforementioned application programs of system 2829 can be stored on a computer-readable storage medium within and coupled to system 2829. These operations are those requiring physical manipulation of physical quantities. Typically, although not essential, these quantities take the form of electrical, electromagnetic, or magnetic signals, or optical or magneto-optical signals capable of being stored, transmitted, combined, compared, and otherwise manipulated. In some embodiments of the invention, system 2829 may include at least one computer-readable medium 2836 coupled to at least one data source 2837a and / or at least one data storage device 2837b and / or at least one input / output device 2837c. In some embodiments, the invention can be implemented as computer-readable code on computer-readable medium 2836. In some embodiments, computer-readable medium 2836 may be any data storage device capable of storing data that can subsequently be read by a computer system (e.g., system 2829). In some embodiments, computer-readable medium 2836 may be any physical or material medium that can be used to tangibly store desired information or data or instructions and is accessible by a computer or processor 2832. In some embodiments, computer-readable medium 2836 may include hard disk drives, network attached storage devices (NAS), read-only memory, random access memory, FLASH-based memory, CD-ROMs, CD-Rs, CD-RWs, DVDs, magnetic tapes, and other optical and non-optical data storage devices. In some embodiments, various other forms of computer-readable medium 2836 may transmit or deliver instructions to computer 2840 and / or at least one user 2831, including routers, private or public networks, or other transmitting devices or channels, both wired and wireless. In some embodiments, software module 2838 may be configured to send data and receive data from a database (e.g., from a computer-readable medium 2836 containing data source 2837a and a data storage device 2837b that may include the database), and data may be received by software module 2838 from at least one other source. In some embodiments, at least one of software modules 2838 may be configured within the system to output data to at least one user 2831 via at least one graphical user interface rendered on at least one digital display.

[0593] In some embodiments of the invention, the computer-readable medium 2836 may be distributed over a conventional computer network via a network interface 2835a, wherein the system 2829, embodied in computer-readable code, may be stored and executed in a distributed manner. For example, in some embodiments, one or more components of the system 2829 may be coupled to transmit and / or receive data via a local area network (“LAN”) 2839a and / or an internet-coupled network 2839b (e.g., a wireless internet). In some further embodiments, networks 2839a, 2839b may include a wide area network (“WAN”), a direct connection (e.g., via a universal serial bus port), or other forms of computer-readable medium 2836, or any combination thereof.

[0594] In some embodiments, components of networks 2839a and 2839b may include any number of user devices, such as personal computers including, for example, desktop and / or laptop computers, or any stationary, typically non-mobile, Internet device coupled via LAN 2839a. For example, some embodiments include a personal computer 2840 coupled via LAN 2839a, which may be configured for any type of user, including an administrator. Other embodiments may include a personal computer coupled via network 2839b. In some other embodiments, one or more components of system 2829 may be coupled to send or receive data over an Internet network (e.g., network 2839b). For example, some embodiments include at least one user 2831 who is wirelessly coupled and accesses one or more software modules of a system including at least one enterprise application 2838 via input and output (“I / O”) device 2837c. In some other embodiments, system 2829 may enable at least one user 2831 to be coupled to access enterprise application 2838 via I / O device 2837c through LAN 2839a. In some embodiments, user 2831 may include user 2831a coupled to system 2829 using a desktop computer and / or laptop computer or any fixed, generally non-mobile Internet device coupled via Internet 2839b. In some further embodiments, user 2831 may include mobile user 2831b coupled to system 2829. In some embodiments, user 2831b may use any mobile computing device 2831c to wirelessly couple to system 2829, including, but not limited to, personal digital assistants and / or cellular phones 2831c, mobile phones or smartphones and / or pagers and / or digital tablets and / or fixed or mobile Internet devices.

[0595] In some embodiments of the invention, system 2829 may enable one or more users 2831 to couple to receive, analyze, input, modify, create, and send data from and to one or more enterprise applications 2838 running on system 2829, including receiving, analyzing, inputting, modifying, creating, and sending data. In some embodiments, at least one software application 2838 running on one or more processors 2832 may be configured to couple via Internet 2839b for communication on networks 2839a, 2839b. In some embodiments, one or more wired or wirelessly coupled components of networks 2839a, 2839b may include one or more resources for data storage. For example, in some embodiments, this may include any form of computer-readable medium other than computer-readable medium 2836 for storing information, and may include any form of computer-readable medium for transferring information from one electronic device to another electronic device.

[0596] Figures 29A-29B A screwdriver 2900 with a tracking dynamic reference frame, according to some embodiments of the present invention, is shown. Figure 29C Some embodiments according to the present invention are shown. Figures 29A-29B A close-up perspective view of the screwdriver head and pressable tip of screwdriver 2957. Additionally, Figure 29D A cross-sectional view of a screwdriver-screw interface according to some embodiments of the present invention is shown. Figures 29A-29B A tool is shown for three functions: 1.) it registers the 3D position and orientation of the screw shaft; 2.) it fully engages in the screw head interface; and 3.) it signals when fully engaged via a pressable sliding shaft 2957 extending from the probe shaft 2910 of the tool 2900, and this sliding shaft is coupled to a tracking movement stray marker actuated when the tool is fully engaged with the mating screw. The overall object of the invention is to identify the position and orientation of the screw via the connection mechanism with the screw head, and to enable the triggering system to indicate to the acquisition system via the TMSM 2945 when the tool is fully engaged with the screw. The tool 2900 and other embodiments can be applied when there is no bar located in the screw obstructing the interface between the tool and the screw head. Figure 29A As shown, the tool may include a tracking DRF 2929 (with marking 2930), a probe shaft 2910, a TMSM (not pressed) 2945, a handle 2940, a screwdriver head 2950, ​​a pressable sliding shaft (not pressed) 2957, a pedicle screw shaft 2960, a pedicle screw tulip-shaped head 2955, and a coupling mechanism 2905.

[0597] The tool (screwdriver) 2900 is designed to engage with the pedicle screw shaft 2960 in such a way that it can engage with the screw head to tighten and loosen the screw, and that when the tool 2900 is fully engaged in the screw head 2955, its 2910 is fixed in one orientation relative to the screw shaft 2960. Thus, the tool 2900 can be used to quickly align the position and orientation of the screw shaft 2960 by accessing only the screw head 2955 of the screw shaft 2960. Figure 29A As shown, TMSM 2945 is positioned corresponding to the pressable shaft 2957 of a screwdriver that is not depressed and therefore not engaged. This embodiment has the same characteristics as described above. Figure 10A-10G The design described above actuates the TMSM 2945 via a pressable tip 2957. It should be noted that the pressable tip 2957 of the tool 2900 and the screw head interface component 2950 can have many different embodiments.

[0598] In some embodiments, the sliding shaft (tip 2957) may be configured such that it is always held within the shaft of the tool or screwdriver, and the screw head 2960 is designed with a central projection to deflect the inner sliding shaft of the screwdriver. Thus, the tip 2957 of the sliding shaft cannot be actuated by any object that cannot fit within the shaft 2950. When the tracked moving stray marker 2945 is actuated, the software of the acquisition system detects its movement (shown linearly) and is able to distinguish, based on the known geometry of the tool and the interface screw, when it is fully or partially engaged with the screw head, as referenced below. Figure 63 The following is a more detailed description. It should be understood that the movement of TMSM 2945 can be linear, rotational, or any combination thereof. Furthermore, the mechanism for detecting TMSM movement may also include covering and exposing specific stray marks via an actuated sliding shaft, as described above with respect to Figure 14. Additionally, the screwdriver head 2950 may be designed to also have components that allow it to be mechanically coupled to the screw shaft 2960, such that it can achieve only one unique orientation when fully engaged. In some embodiments, structures that facilitate engagement in a unique configuration include, but are not limited to, an extended screwdriver head, a depth-stop flange that facilitates alignment of the screwdriver head with the screw head, and a screw with an increased depth designed to ensure that the screwdriver shaft is securely engaged in one orientation when fully seated in the head. Furthermore, since the depicted position of the tracked DRF 2929 is not the only way to substantially rigidly attach the DRF, it must be noted that the DRF 2929 can be placed anywhere on the surgical tool screwdriver 2900, as long as it can be substantially rigidly attached, even on an adjustable connector.

[0599] Figure 29B The previous reference was shown. Figure 29AAnother embodiment of the tool shown, except that in this image, tool 2900 is fully engaged with screw head 2960, highlighting the new position of TMSM 2945 to indicate to the acquisition software system that screwdriver head 2950 and pressable shaft 2957 are fully in place, and the position and orientation of screw shaft 2960 can then be calculated from that position.

[0600] Figure 29C Some embodiments according to the present invention are shown. Figures 29A-29B A close-up perspective view of the screwdriver head 2950 and the pressable tip 2957 of the screwdriver 2900, and the aforementioned pressable sliding shaft 2957 in the unpressed position is shown. Figure 29C Showing previous information about Figures 29A-29B A more detailed perspective view of the screwdriver head 2950 and pressable tip 2957 of the screwdriver tool 2900 described herein, and its interface 2905 with the pedicle screw head 2960. In this view, the interface at the top of the screwdriver head 2950 and the screw head 2960 can be seen, as well as the pressable tip 2957 shown as unpressed. Other embodiments involve a pressable sliding shaft contained within the screwdriver head. This spring-loaded pressable shaft engages only when a convex protrusion in the screw head engages coaxially with the screw head. The pressable shaft 2957 is then pushed upward, actuating the TMSM 2945 attached to the pressable shaft 2957 to signal that the 3D tracking tool 2900 and the screw shaft 2960 are fully engaged and coaxial, and thus ready for registration in 3D space.

[0601] Figure 29D A cross-sectional view of a screwdriver-screw interface 2905 according to some embodiments of the present invention is shown, and a pressable sliding shaft tip (partially pressable) 2965 is shown. Figure 29D As shown, the screwdriver tool 2900 will not send a signal to the acquisition system that it is fully engaged with the screw head 2960, because the partially pressed pressable shaft 2965 and its mechanically linked TMSM 2945 will not be fully actuated relative to the tracked DRF 2929.

[0602] In some embodiments, the tracking DRF does not need to be substantially rigidly attached to the tool's axis, but can be allowed to rotate about the tool axis (e.g., linked with a bearing) and adjust its position relative to the tool (while still being able to lock substantially rigidly when needed). (Simplified) Figures 29A-29B As shown, if the DRF 2929 is obstructed, it is very challenging for the user to use the tool as a screwdriver. It should be noted that in other embodiments of this design, the tracked DRF 2929 is positioned and attached to the screwdriver in a different manner, which better facilitates the user interface of the handle while maintaining the visibility of the DRF 2929.

[0603] For example, in some embodiments, the tracking DRF 2929 is coupled to the screwdriver shaft 2910 via a bearing (which may or may not be coupled to a lockable ratchet mechanism), allowing it to rotate about the long axis of the screwdriver shaft. In other embodiments, it is positioned above the handle and may or may not have a bearing to enable it to rotate about the screwdriver shaft axis.

[0604] In some embodiments of the present invention, such as Figure 30A As shown in -30C, a pedicle screw insertion cap 3060 with a series of coupled 3D-tracking markers 3070 forming a DRF is coupled to the tulip-shaped head 2955 of the pedicle screw. In this way, as long as the markers 3070 are within the line of sight of the camera 3000, the tulip-shaped head can be tracked in 3D space without the need for a probe to interface with them to register their position in space. Figure 30A The optical 3D tracking system 3000 is shown, which can be used as an acquisition device for these and any other tracked markers throughout this article. Figure 30B The image shows a tracking DRF with 3D tracking markers 3070 on a cap device equipped with a mating mechanism 3060 for substantially rigid mounting to a pedicle screw 2960 (not visible). Figure 30B A tulip-shaped head 2955 is inserted into the vertebral column 3055. The position of the pedicle screw 2960 can be tracked in 3D space via this tracking reference frame, which is coupled to the marker 3070 and the screw 2960, as long as it is within the line of sight of the 3D tracking camera 3000. The interface 3060 between the DRF marker 3070 and the tulip head 2955 can consist of a series of mechanisms, which will be referred to below. Figures 34A-34F 35A-35E, 36A-36I and 37A-37G are described in more detail.

[0605] Figure 31 A body-mounted 3D tracking camera according to some embodiments of the invention is illustrated, and its operation is shown in a manner that avoids visual obstruction between the 3D tracking camera and the surgical site or any other area of ​​interest for visualization. The design involves a user equipped with a body-mounted tracking DRF 3125 substantially rigidly fixed to the body-mounted 3D tracking camera 3135, allowing information to be fused between the user's field of view and an external 3D tracking camera (not shown), since the position and orientation of the body-mounted camera 3135 will generally be visible and known to the larger field-of-view 3D tracking camera (not shown). Figure 31A body-mounted 3D tracking sensor 3135 equipped with a tracking DRF 3125 is shown. One embodiment of the body mounting mechanism for the 3D tracking sensor 3135 is via a head-mounted fastener with adjustable components 3110, 3105. In this embodiment, surgical areas typically obscured by the field of view of a large field-of-view camera can be visualized via the body-mounted 3D tracking optical sensor 3135. Because the body-mounted optical sensor 3135 is equipped with the substantially rigidly mounted tracking DRF 3125, a large field-of-view camera (not shown) can be registered with the position and orientation of the body-mounted optical sensor in 3D space, and this information can be used to interpret the scene visualized by the head-mounted 3D tracking optical sensor 3135 to create a dynamic 3D stitching mapping of the global coordinate system relative to the large field-of-view camera coordinate system. The fusion of the coordinate systems of the body-mounted camera 3135 and the larger field-of-view camera (not shown) is calculated via a 3D rigid transformation, which is applied to the 3D data collected by the body-mounted camera 3135 for all frames it acquires. Therefore, this embodiment enables the calculation of the 3D position and orientation of objects of interest (e.g., 3D trackable tools, DRFs, anatomical landmarks, references, surgical accessories, other optical or electromagnetic sensors, etc.) within the field of view of the body-mounted camera 3135, which is being tracked by the larger field-of-view camera (not shown).

[0606] Figure 32 A method for interpreting the contour of a posterior spinal element is shown. This method involves placing an extendable object onto a surgically exposed bone element such that it matches the exposed spinal contour, then removing the extendable object and registering its contour with an optical system including a stereo camera. From this information, spinal alignment parameters for contour matching can be calculated, where this information pertains to the surface contour of the extendable object now used as a substitute for the posterior spinal element contour. Other related figures (involving the calculation of spinal alignment parameters and other anatomical landmarks of interest processed by software algorithms) include... Figure 65A-65E 66A-66B and 68. Figure 32 The system 3200 is shown, in which an extendable rod 3215 is placed on a surgically exposed element of the spine 3230, having adjustable clips 3210 for registration of specific spinal segments for software interpretation. After the rod 3215 is inserted into the surgical site, the extendable rod 3215 conforms to the contour 3225 of the exposed spinal element, and one or more mounted clips 3220 are aligned along the rod 3215 with nearby anatomical landmarks of interest. The extendable rod 3215 then undergoes topological registration 3240 via one or more imaging sensors 3241 to interpret the 3D contour of the rod 3215 that matches the contour 3225 of the spine 3230. This is then referred to below. Figure 65AThe software algorithms described in detail in -E, 66A-B, and 68 process the 3D profile of the extendable rod 3215. The optical registration system 3241 can be any optical system for registering 3D surface profiles, including but not limited to one or more depth sensors, stereo vision cameras, and structured light systems, wherein the rod is fixed to a stationary or movable platform base. Based on some embodiments of registering the 3D profile of the extendable rod 3215 using optical methods, and with associated clips 3210 indicating spinal segments, the system can calculate spinal alignment parameters 3250 for each anatomical plane of the rod 3215 and interpret the relative alignment and profile of the spine 3230.

[0607] Figure 33A-33I Some embodiments of the invention shown include a combination of a screw and a screwdriver, which allows for the mechanical coupling of the two devices such that the screwdriver is coaxial with the screw shaft, and also has the ability to subsequently manipulate the screw shaft substantially rigidly, and if the screw shaft is fixed in bone, the screw shaft has the ability to subsequently manipulate the associated bone structure. For example, Figure 33A The pedicle screw design according to some embodiments of the present invention is shown. Figure 33B A pedicle screw according to another embodiment of the present invention is shown. Furthermore, Figure 33C This illustrates a pedicle screw with a multi-axis tulip-shaped head according to some embodiments of the present invention. Figure 33D The design according to some embodiments of the present invention is shown to be consistent with Figure 33B Tools for pedicle screw connection. Figure 33E Some embodiments of the present invention are shown. Figure 33D tools and Figure 33C A view of the coupling between the screws. Furthermore, Figure 33F Examples of embodiments of the present invention are shown. Figure 33C The coupling to the pedicle screw shown Figure 33D The coupling tool shown, Figure 33G Some embodiments of the present invention are shown. Figure 33A A top view of the screw. Figure 33H Some embodiments of the present invention are shown. Figure 33B A top view of the screw. As shown, some embodiments include an Allen key insert 3325, a rigid single crossbar 3320, a coupled threaded shaft 3305, and a bent screw head 3315. Figure 33A and Figure 33I An embodiment of a screw is shown, comprising an Allen key insert 3325, a rigid crossbar 3320 spanning the sidewall of a screw head 3315 but allowing clearance above the insert, a threaded shaft 3305, and a bent screw head 3315 to accommodate a tulip-shaped head (in... Figure 33C The figure in the middle is labeled 3365. Figure 33B The above shows about Figure 33A Another embodiment of the screw described in detail. This embodiment shows a screw head 3345 with two intersecting crossbars 3350 to allow for interfacing with different tools. Figure 33D An exemplary embodiment is described herein. It should be noted that the examples of screws depicted in these figures represent only some embodiments of the invention. The crossbar 3350 may have different profiles, numbers, and relative arrangements of each screw head. Figure 33C The previous information was displayed. Figure 33B An embodiment of the screw is described, which mates with a multiaxial tulip-shaped head 3365 having a cutout 3375 for engaging with a shank and a thread 3370 for receiving a fastening cap.

[0608] Figure 33D It shows the design as previously mentioned Figure 33B A detailed description of one embodiment of a screw-interface tool. The tool includes four mechanically coupled extensions 3390 designed to engage with the screw head crossbar via a right-angle turn mechanism. After performing the right-angle turn, the tool becomes substantially rigidly fixed to the screw head and shaft, as... Figure 33B As depicted in the diagram. The end of the screw's central axis has a pressable sliding shaft 3393, which can be coupled to a TMSM (not shown) to indicate full engagement of the tool 3390 and the screw, as shown. Figure 33B As shown, in the previous discussion Figures 10A-10E and Figures 29A-29C In the detailed description of the communication method, it should be noted that the center of the tool tip 3393 can also be formed by a threaded shaft, which is fastened downward at the top section (not shown) of the tool 3390 to push the slide against the rigid crossbar of the screw head. This provides increased holding strength at the screw head interface. This threaded intermediate shaft can also be connected to a TMSM (not shown) to indicate its position relative to the DRF (not shown) mounted to the screwdriver's track. Furthermore, Figure 33E A transparent view showing the interface between the screw head, its crossbar, and the screwdriver-coupled end actuator, as previously described. Figure 33A-33I The discussed point. From this view, when the two tools are engaged with each other, the threaded screw shaft 3391, the bent screw head wall 3318, and the mechanical coupling extension 3390 of the tools are visible. Furthermore, with Figure 33E different, Figure 33F Different perspective views are shown of the interfacing screwdriver (3392) and the screw (3395) with a crossbar. From this view, the coaxial alignment of the screwdriver shaft and the screw shaft is evident. Figure 33G The previous information was displayed. Figure 33BThe figure depicts a bottom view of a screw equipped with a crossbar, highlighting the circular cutout 3380 of the tulip-shaped head that interfaces with the curved walls (3318, 3345; not shown) of the screw head.

[0609] Some embodiments include tools or components that interface directly with the tulip-shaped head of the pedicle screw, thereby substantially rigidly fixing the rotating tulip-shaped head relative to the pedicle screw axis, and then enabling measuring and manipulating devices to act on the coupled spinal element to aid in alignment, measurement, and fixation, as will be referred to below. Figures 39A-39F The 42A-42K are described in more detail.

[0610] Figure 34 Tools for interfacing with pedicle screws according to some embodiments of the present invention are shown. Figure 34A A cross-sectional view is shown of the direct interface between the threaded insert and the tulip-shaped head of the pedicle screw. The figure shows the pedicle screw shaft 3410 (thread not shown), its associated tulip-shaped head 3420, the threaded fastening knob 3440 of the interface device, its sleeve body 3425, the device body connector 3430, the protruding tip 3423 which is substantially rigidly pushed against the screw head, and the device's internal shaft thread 3422. Fastening the device via the threaded fastening knob 3440 causes the internal shaft thread 3422 to directly interface with the tulip-shaped head thread, allowing the protruding tip 3423 to push against the screw head. This fastening provides a rigid connection between the device, the tulip-shaped head, and the pedicle screw, restricting movement of the multi-axial tulip-shaped head and coupling all three components together. The device body connector 3430 shown in the figure is designed to engage with a larger tool, which will be referenced below. Figures 39A-39D 40A-40C, 41C, 42A42-F are described in more detail. It should be noted that the protruding tip shown in the figure is only one embodiment of the device, and other embodiments include, but are not limited to, cylindrical protrusions, spherical tips, and non-rigid cylindrical protrusions that are coaxial or perpendicular to the inner shaft and coupled by rivets or other mechanisms, enabling them to rotate about the axis of the inner shaft.

[0611] Figures 34B-34C Showing the interface with the pedicle Figure 34 A non-cross-sectional side view of the device shows side plate extensions 3421 extending over the tulip-shaped head cutout. These side plate extensions provide an additional rigid interface between the device and the tulip-shaped head of the screw, further facilitating the substantially rigid securing of the device, tulip-shaped head, and screw to each other.

[0612] Figure 34D Showing Figure 34A A cross-sectional view of the device and the pedicle screw interface. Figure 34E The diagram shows the interface with the pedicle screw. Figure 34A A non-cross-section, rendered side view of the device. Figure 34F The diagram shows the interface with the pedicle screw. Figure 34A The non-cross-section, rendered front view of the device.

[0613] Figures 35A-35F The diagram shows a component or tool 3500 designed to directly interface with the tulip-shaped head of a pedicle screw, in such a way that the tulip-shaped head, which rotates substantially rigidly relative to the axis of the pedicle screw, is then positioned to allow measuring and manipulating devices to act on the spinal element to aid in alignment, measurement, and fixation, as will be referenced below. Figures 39A-39F As described in more detail for 42A-42K. This is what was mentioned earlier regarding... Figures 34A-34F Alternative embodiments of the embodiments described in detail. As shown, tool 3500 includes a pedicle screw shaft 3510, a tulip-shaped head 3503, a pull-out shaft advance knob 3540, a sleeve body 3525, a device body connector 3530, a protruding tip 3504, an external shaft thread 3535, a protruding tip advance knob 3545, a pull-out pin 3546, a retaining ring 3502, and an expansion tooth 3527. In operation, after direct interface with the tulip-shaped head 3503, the pull-out pin advance knob 3540 guides the external shaft thread 3535 to drive the expansion of the expansion tooth 3527, thereby directly interfaceing with the tulip-shaped head thread. The retaining ring 3502 restricts the expansion of the device to prevent excessive stress, and the protruding tip advance knob 3545 can then be tightened to increase the tension on the expansion tooth with the tulip-shaped head thread, thereby substantially rigidly securing the device, the tulip-shaped head, and the screw shaft together. The device body connector 3530 shown in this figure is designed to interface with a larger tool, which will be referred to below. Figures 39A-39F A more detailed description of 42A-42K.

[0614] Figure 35B Showing about Figure 35A A non-cross-sectional front view of the device and the pedicle screw interface. Side extensions 3529 extending over the tulip-shaped head cutout can be seen in this figure. These side extensions provide an additional rigid interface between the device and the tulip-shaped head of the screw, further contributing to the substantially rigid fixation of the device, tulip-shaped head, and screw to each other. Figure 35C Showing about Figure 35A A non-sectional perspective view of the device and the pedicle screw interface. Figure 35D The diagram shows the interface with the pedicle screw. Figure 35A A cross-sectional perspective view of the device being described. Figure 35E The diagram shows the interface with the pedicle screw. Figure 35AA non-cross-sectional rendered front view of the device. Figure 35F Some embodiments of the present invention are shown. Figures 35A-35E A close-up perspective view of the tool, which does not have a coupled pedicle screw or a tulip-shaped head. Figure 35F Showing Figure 35A A non-cross-sectional rendered front view of the device, without the pedicle screws and tulip-shaped head attached. The expansion teeth and side plate extensions are more clearly visible in this view.

[0615] Some other embodiments of the invention include a tool or assembly capable of directly interfaced with the tulip-shaped head of a pedicle screw via a right-angle turning mechanism, such that the tool or assembly substantially rigidly fixes the tulip-shaped head, which rotates relative to the axis of the pedicle screw, thereby enabling measuring and manipulating devices to act on the spinal element to aid in alignment, measurement, and fixation, as will be referred to below. Figures 39A to 39F and Figures 42A to 42K A more detailed description. This is from the previous section about... Figures 34A-34F Alternative embodiments to the embodiments described in detail in 35A-35F. For example, Figure 36A A cross-sectional view of an embodiment of the invention is shown, which is used for direct interface with a threaded insert of a tulip-shaped head of a pedicle screw via a right-angle turning mechanism. The figure shows a pedicle screw shaft 3610 (thread not shown), its associated tulip-shaped head 3620, a right-angle turning knob 3635, its sleeve body 3640, a device body connector 3645, a protruding tip 3650 substantially rigidly pushed against the screw head, a protruding tip advance knob 3637, a side plate extension 3695, and a right-angle turning retainer 3699. After inserting the device into the tulip-shaped head such that the threads are not engaged, a quarter-turn knob is rotated 90 degrees to engage the quarter-turn thread with the thread of the tulip-shaped head. After rotating 90 degrees, the right-angle turning retainer prevents over-rotation, ensuring that the thread is engaged before increasing tension on the thread by tightening the protruding tip advance knob. By tightening the protruding tip advance knob, the protruding tip is directly driven against the screw head and increases tension on the quarter-turn thread, thereby removing tolerances from the multi-axial tulip-shaped head. In this way, the device essentially rigidly holds the tulip-shaped head and the screw shaft together. The device body connector 3645 shown in the figure is designed to interface with a larger tool, which will be referenced below. Figures 39A-39F A more detailed description of 42A-42K.

[0616] Figure 36B Showing about Figure 36A A non-cross-sectional front view of the device and its interface with the pedicle screw. The front reference can be seen more clearly in this figure. Figure 35BThe side plate extension 3695 is described in detail. Similarly, what is seen more ...

Claims

1. An intraoperative alignment assessment system, comprising: at least one dynamic reference frame (DRF) configured such that any fixed or moving portion of the DRF, or any component or part coupled to the DRF, can be registered in 3D space using a plurality of trackable markers, the plurality of trackable markers including at least one movable or triggerable marker; at least one user-actuated trigger or actuator coupled to the at least one movable or triggerable indicia, the at least one user-actuated trigger or actuator being configured and arranged to trigger or actuate the at least one movable or triggerable indicia; at least one 3D tracking camera or imaging system configured to track one or more of the plurality of trackable markers; and a processor and a memory coupled to the processor, the memory storing instructions executable by the processor to track one or more 3D coordinates of one or more trackable markers of the plurality of trackable markers.