Augmented reality guidance for imaging systems, external beam radiation systems, and mobile x-ray systems with x-ray detector plates

Abstract

Systems, devices and methods for augmented reality guidance of imaging systems, external beam radiation systems, and detector plates are described.

Description

[0001] Patent Application Attorney Docket No.172048-014306 / PCT AUGMENTED REALITY GUIDANCE FOR IMAGING SYSTEMS, EXTERNAL BEAM RADIATION SYSTEMS, AND MOBILE X-RAY SYSTEMS WITH X-RAY DETECTOR PLATES RELATED APPLICATIONS This application claims the benefit of and the priority to U.S. Provisional Patent Application Serial No. 63 / 569,829, filed March 26, 2024; U.S. Provisional Patent Application Serial No. 63 / 639,883, filed April 29, 2024; U.S. Provisional Patent Application Serial No. 63 / 642,949, filed May 6, 2024; U.S. Provisional Patent Application Serial No. 63 / 646,580, filed May 13, 2024; U.S. Provisional Patent Application Serial No. 63 / 674,954, filed July 24, 2024, and U.S. Provisional Patent Application Serial No. 63 / 715,688, filed November 4, 2024, the entire contents of each of which is hereby incorporated by reference in their entireties. TECHNICAL FIELD Aspects of the present disclosure relate to systems, devices and methods for operating an imaging system with augmented reality display of an image acquisition area or volume prior to image acquisition, augmented reality guidance of external beam radiation systems, virtual display of a collision of an imaging system or external beam radiation system with a patient or patient table, and virtual display of detector plates, for example when used with mobile x- ray systems. BACKGROUND Image acquisition systems are frequently mal positioned in clinical practice, which can lead to "cutting off" of anatomic structures, image acquisition outside a target region, area of volume of interest or only partially including the target region, area of volume of interest, or "cutting off" of a target region or area of an anatomic structure, landmark or area, for example with portable x-rays. Imaging systems or external beam radiation systems frequently collide with a patient or patient table. SUMMARY Aspects of the disclosure relate to a method for obtaining a portable x-ray image in a patient, the method comprising (a) tracking a detector plate in real time in a coordinate system; (b) tracking an augmented reality display device in real time in the coordinate system; (c) generating, by the at least one computer processor, a virtual 3D representation of at least a portion of the tracked detector plate; (d) generating, by at least one computer processor, an 1 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT augmented view comprising the virtual 3D representation of the at least portion of the tracked detector plate; (e) positioning the detector plate in relation to a surface of the patient or an anatomic structure of the patient; (f) superimposing, by the at least one computer processor, the augmented view onto the at least portion of the tracked detector plate; (g) updating in real time, by the at least one computer processor, the augmented view based on real time tracking information of the tracked detector plate so that the virtual 3D representation of the at least portion of the detector plate is maintained in relationship to the tracked detector plate as the detector plate moves; (h) moving the detector plate to align the augmented view of the virtual 3D representation of the at least portion of the detector plate with the surface or anatomic structure of the patient; and acquiring the x-ray image of the patient, wherein steps a. through h. are before the step of acquiring the x-ray image of the patient. In some embodiments, the step of superimposing is by the augmented reality device. In some embodiments, the augmented reality device comprises a computer monitor, a tablet computer, a smart phone, or a head mounted display. In some embodiments, the head mounted display is a video see through head mounted display or an optical see through head mounted display. In some embodiments, the method ensures inclusion of a target anatomic region, target anatomic structure or target surface of the patient in the x-ray image. In some embodiments, the method comprises moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate with a light marker visible on the surface or anatomic structure of the patient. In some embodiments, the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam, prior to emission of the x-ray beam from an x-ray tube, for acquiring the x-ray image. In other embodiments, the method comprises moving an x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam, prior to emission of the x-ray beam from the x-ray tube, to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate. Yet, in other embodiments, the method comprises moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the detector plate with a light marker of an x-ray beam prior to emission of the x-ray beam from an x-ray tube visible on the surface or anatomic structure of the patient and moving the x-ray tube with the 2 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT light marker indicative of a position, orientation, envelope, boundary, center or combination thereof of the x-ray beam prior to emission of the x-ray beam from the x-ray tube to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the detector plate. In some embodiments, the method comprises generating, by the at least one computer processor, a virtual 3D representation of at least a portion of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring the x-ray image, the virtual 3D representation being a 3D surface, 3D volume or combination thereof of an envelope, a boundary, a center, or combination thereof of the x-ray beam to be emitted from the x-ray tube; generating, by the at least one computer processor, an augmented view comprising the virtual 3D representation of the at least portion of the x-ray beam; superimposing, by the at least one computer processor, the augmented view onto the patient; and positioning the augmented view comprising the virtual 3D representation of the at least portion of the x-ray beam in relation to the patient by moving the x-ray tube, the patient, or a combination thereof. In some embodiments, the method comprises moving the detector plate to align the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view with the virtual 3D representation of the at least portion of the x-ray beam in the augmented view. In other embodiments, the method comprises moving the x-ray tube to align the virtual 3D representation of the at least portion of the x-ray beam in the augmented view with the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view. Yet in other embodiments, the method comprises moving the detector plate and moving the x-ray tube to align the virtual 3D representation of the at least portion of the x-ray beam and the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view. In some embodiments, the method comprises moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate with a light marker visible on the surface or anatomic structure of the patient. In some embodiments, the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring the x-ray image, or moving an x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring 3 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT the x-ray image to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate. In some embodiments, the method comprises tracking the detector plate, the augmented reality display device, an x-ray system, an x-ray tube, an x-ray detector, a component of an imaging system, the patient, the anatomic structure of the patient, a patient table, or a combination thereof using a radiofrequency tracking system, an optical tracking system, a camera, a 3D scanner, a scanner, a depth sensor, an inside out tracking system integrated or attached to the augmented reality display device, an outside in tracking system, an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof. In some embodiments, the method comprises moving the tracked detector plate to align the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient. In some embodiments, the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam by an x-ray tube for acquiring the portable x-ray image of the patient. In some embodiments, the virtual 3D representation of the at least portion of the detector plate comprises a 3D surface, a 3D volume or combination thereof. In some embodiments, the virtual 3D representation of at the least portion of the detector plate comprises a graphical representation of the at least a portion of the detector plate. Aspects of the disclosure relate to a system for acquiring an x-ray of a patient, the system comprising: a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and a detector plate, wherein the at least one computer processor is configured to track the detector plate in real time in a coordinate system, the at least one computer processor is configured to generate a virtual 3D representation of at least a portion of the tracked detector plate, the at least one computer processor is configured to generate an augmented view comprising the virtual 3D representation of the at least portion of the tracked detector plate, the at least one computer processor is configured to superimpose the augmented view onto the at least portion of the tracked detector plate, the augmented reality device is configured to display the augmented view onto the patient at a position and orientation in relation to the tracked detector plate and superimposed onto the tracked detector plate, the at least one computer processor is configured to update in real time the position and orientation of the augmented view based on real time tracking information of 4 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT the tracked detector plate so that the virtual 3D representation of the at least portion of the detector plate is maintained in relationship to the tracked detector plate as the tracked detector plate is moved to align the virtual 3D representation of the at least portion of the detector plate with a surface or anatomic structure of the patient; and the portable x-ray apparatus is configured to acquire the x-ray image of the patient. In some embodiments, the system further comprises a tracking device attached to the detector plate. In some embodiments, the tracking device is an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof. In some embodiments, the system further comprises a light marker configured to be visible on the surface or anatomic structure of the patient. In some embodiments, the light marker is configured to be indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of an x-ray beam from an x-ray tube for acquiring the x-ray image. In some embodiments, the light marker comprises a light source. In some embodiments, the light source comprises a laser. In some embodiments, the augmented reality device comprises a computer monitor, a tablet computer, a smart phone, a head mounted display. In some embodiments, the head mounted display is a video see through head mounted display or an optical see through head mounted display. In some embodiments, the at least one computer processor is configured to track the detector plate, the augmented reality display device, an x-ray system, an x-ray tube, an x-ray detector, a component of an imaging system, the patient, the anatomic structure of the patient, a patient table, or a combination thereof using a radiofrequency tracking system, an optical tracking system, a camera, a 3D scanner, a scanner, a depth sensor, an inside out tracking system integrated or attached to the augmented reality display device, an outside in tracking system, an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof. In some embodiments, the system is configured to allow for alignment of the augmented view of the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient when the tracked detector plate is moved, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam to be emitted from an x-ray tube for acquiring the x-ray image. In other embodiments, the system is configured to allow for 5 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT movement of the x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of the x-ray beam to be emitted from the x-ray tube to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the detector plate. Yet in other embodiments, the system is configured to allow for alignment of the augmented view of the virtual 3D representation of the at least portion of the detector plate with a light marker of an x-ray beam to be emitted from an x-ray tube visible on the surface or anatomic structure of the patient when the tracked detector plate is moved and to allow for the movement of the x-ray tube with the light marker indicative of a position, orientation, envelope, boundary, center or combination thereof of the x-ray beam to be emitted from the x-ray tube to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the detector plate. In some embodiments, the system is configured to allow for alignment of the virtual 3D representation of the at least portion of an x-ray beam in the augmented view with the virtual 3D representation of the at least portion of the detector plate in the augmented view when the detector plate is moved to align the virtual 3D representation of the at least portion of the detector plate in the augmented view with the virtual 3D representation of the at least portion of the x-ray beam in the augmented view. In other embodiments, the system is configured to allow for alignment of the virtual 3D representation of the at least portion of the x-ray beam and the virtual 3D representation of the at least portion of the detector plate in the augmented view when the detector plate is moved and the x-ray tube is moved. In some embodiments, the system is configured to allow for alignment of the augmented view of the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient when the tracked detector plate is moved, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam to be emitted from an x-ray tube for acquiring the x-ray image. In other embodiments, the system is configured to allow for to alignment of the light marker with the augmented view of the virtual 3D representation of the at least portion of the detector plate, when the an x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x- ray beam to be emitted from an x-ray tube for acquiring the x-ray image is moved. 6 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the surface or anatomic structure of the patient comprises a chest region of the patient. In some embodiments, the chest region comprises a lung apex, a costophrenic angle or combination thereof. In other embodiments, the surface or anatomic structure of the patient comprises an abdominal and / or pelvic region of the patient. In some embodiments, the abdominal and / or pelvic region of the patient comprises a diaphragm, a liver region, a spleen region, a gastric region, an intestinal region, a colon region, a rectum region, a symphysis pubis or combination thereof. Aspect of the disclosure relates to a method for obtaining a portable x-ray in a patient, the method comprising (a) tracking an augmented reality display device in real time in a coordinate system; (b) generating, by at least one computer processor, a virtual 3D representation of at least a portion of the physical detector plate; generating, by the at least one computer processor, an augmented view comprising the virtual 3D representation; (c) aligning and superimposing, by the at least one computer processor, the augmented view with a surface or anatomic structure of the patient; (d) aligning the physical detector plate with the virtual 3D representation of at least the portion of the physical detector plate in the augmented view; (e ) acquiring the x-ray image of the patient, wherein steps a. through e. are before the step of acquiring the x-ray image of the patient. Aspect of the disclosure relates to a system for acquiring an x-ray of a patient, the system comprising a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and a detector plate, wherein the at least one computer processor is configured to track the augmented reality display device in real time in a coordinate system, the at least one computer processor is configured to obtain information about a shape of the physical detector plate, the at least one computer processor is configured to generate a virtual 3D representation of at least a portion of the detector plate, the at least one computer processor is configured to generate an augmented view comprising the virtual 3D representation, the at least one computer processor is configured to align and superimpose the augmented view with a surface or anatomic structure of the patient, and the portable x- ray apparatus is a configured to acquire the x-ray image of the patient. In some embodiments, the system further comprises a user interface. In some embodiments, the user interface is configured to move the augmented view to so that augmented view is aligned and superimposed with a surface or anatomic structure of a patient. In some embodiments, the 7 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT user interface is configured to receive input from a gaze tracking, a gesture tracking, a finger and / or hand tracking, an eye tracking, a tracking of a physical tool or physical instrument, a virtual user interface, a keyboard, a mouse, a trackpad. In some embodiments, the user interface comprises a virtual object, a virtual button, a virtual field, a virtual cursor, a virtual pointer, a virtual slider, a virtual trackball, a virtual node, a virtual alphanumeric display, a virtual touchpad, a virtual keyboard, or a combination thereof. In some embodiments, the portable x-ray apparatus is a configured to acquire the x-ray image of the patient after the detector plate is aligned with the augmented view comprising the virtual 3D representation. Aspects of the disclosure relate to a method for obtaining a portable x-ray image in a patient, the method comprising (a) tracking a detector plate in real time in a coordinate system; (b) tracking an augmented reality display device in real time in the coordinate system; (c) obtaining, by at least one computer processor, information about a geometry of the detector plate; (d) generating, by the at least one computer processor, a 3D representation of a surface, a volume or combination thereof, wherein the 3D representation is a virtual 3D representation of at least a portion of the detector plate; (e) generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation of the surface, volume or combination thereof; (f) displaying, by an augmented reality display device, the augmented view of the 3D representation superimposed and aligned with the tracked detector plate; (g) updating in real time, by the at least one computer processor, the augmented view based on real time tracking information of the tracked detector plate so that the 3D representation is maintained in relationship to the tracked detector plate as the detector plate moves; (h) moving the detector plate to align the augmented view of the 3D representation with a surface or an anatomic structure of the patient; and (i) acquiring the portable x-ray image of the patient, wherein steps a. through h. are before the step of acquiring the portable x-ray image of the patient. In some embodiments, the method comprises moving the tracked detector plate to align the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient. In some embodiments, the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray source for acquiring portable x-ray image of the patient. 8 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Aspects of the disclosure relate to a system for obtaining a portable x-ray image in a patient comprising a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and a detector plate, wherein: the at least one computer processor is configured to track the detector plate in real time in a coordinate system; the at least one computer processor is configured to track the augmented reality display device in real time in the coordinate system; the at least one computer processor is configured to obtain information about a geometry of the detector plate; the at least one computer processor is configured to generate a 3D representation of a surface, a volume or combination thereof; the 3D representation is a virtual 3D representation of at least a portion of the detector plate; the at least one computer processor is configured to an augmented view comprising the 3D representation of the surface, volume or combination thereof; the augmented reality display device is configured to display the augmented view superimposed and aligned with the tracked detector plate; the at least one computer processor is configured to update in real time a position and orientation of the augmented view based on real time tracking information of the tracked detector plate so that the 3D representation is maintained in relationship to the tracked detector plate as the detector plate is moved to align the augmented view with a surface or an anatomic structure of the patient; and the portable x- ray apparatus is configured to acquire the x-ray image of the patient. Aspects of the disclosure relate to a method for obtaining a portable x-ray image in a patient, the method comprising (a) tracking one or more components of a portable x-ray apparatus, in a coordinate system; (b) tracking a detector plate in real time in the coordinate system; (c) tracking an augmented reality display device in real time in the coordinate system; (d) obtaining, by at least one computer processor, information about a geometry of the one or more components of the portable x-ray apparatus, information about a geometry of the image acquisition, information about one or more image acquisition parameters, or a combination thereof; (e) obtaining, by the at least one computer processor, information about a geometry of a detector plate; (f) generating, by the at least one computer processor, a first 3D representation of a surface, a volume or combination thereof, wherein the first 3D representation of the surface, the volume or combination thereof is derived, at least in part, from the information about the geometry of the one or more components of the portable x- ray apparatus, information about the geometry of the image acquisition, information about the one or more image acquisition parameters, or a combination thereof; (g) generating, by 9 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT the at least one computer processor, a second 3D representation of a surface, a volume or combination thereof, wherein the second 3D representation of the surface, the volume or combination thereof is a virtual 3D representation of at least a portion of the detector plate; (h) generating, by the at least one computer processor, an augmented view comprising the first 3D representation of the surface, volume or combination thereof and the second 3D representation of the surface, volume or combination thereof; (i) displaying, by an augmented reality display device, the augmented view onto the patient at a position and orientation in relation to the tracked one or more components of the portable x-ray apparatus and superimposed onto the tracked detector plate; (j) updating in real time, by the at least one computer processor, the augmented view based on real time tracking information of the tracked one or more components of the portable x-ray apparatus so that the first 3D representation is maintained in relationship to the tracked one or more components of the imaging system as the imaging system moves; (k) updating in real time the augmented view based on real time tracking information of the tracked detector plate so that the second 3D representation is maintained in relationship to the tracked detector plate as the detector plate moves; (l) moving the one or more components of the imaging system, the detector plate, or the one or more components of the imaging system and the detector plate to align at least a portion of the first 3D representation with at least a portion of the second 3D representation in the augmented view; and (m) acquiring the portable x-ray image of the patient, wherein steps a. through l. are before the step of acquiring the image of the patient. In some embodiments, the surface or anatomic structure of patient comprises a surface of a patient gown, a skin, an exposed tissue or a combination thereof. In some embodiments, the first 3D representation is a virtual 3D representation of an x-ray beam emitted by the portable x-ray apparatus prior to emission of the x-ray beam. In some embodiments, the information about a geometry of the image acquisition comprises information about a collimation of the x-ray beam. In some embodiments, the information about a geometry of the image acquisition comprises information about a trajectory, an outer envelope, a boundary, a surface, a volume or a combination thereof of an x-ray beam emitted by the portable x-ray apparatus. In some embodiments, the second 3D representation is a virtual 3D representation of the detector plate. In some embodiments, the detector plate is a photostimulable phosphorus plate. 10 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the augmented reality display device comprises a computer monitor, a tablet computer, a video see-through head mounted display, or an optical see-through head mounted display. In some embodiments, the surface or anatomic structure of the patient is visible directly through the optical see through head mounted display. In some embodiments, the surface or anatomic structure of the patient is captured by a camera integrated or attached to the computer monitor, tablet computer, or video see through head mounted display and the images or video of the surface or anatomic structure of the patient captured by the camera are displayed by the computer monitor, tablet computer, or video see through head mounted display. In some embodiments, the video see-through head mounted display or the optical see- through head mounted display are stereoscopic. In some embodiments, the information about the geometry of the detector plate comprises information about a length, a width, an area, a dimension, a shape or a combination thereof of the detector plate. In some embodiments, the at least one computer processor obtaining information about the geometry of the one or more components of the imaging system, information about the geometry of the image acquisition, information about one or more image acquisition parameters, or combination thereof, the computer processor obtaining information about the geometry of the detector plate, the computer processor generating the first 3D representation, the computer processor generating the second 3D representation, the computer processor generating the augmented view, the computer processor updating in real time the augmented view based on real time tracking information of the tracked one or more components of the portable x-ray apparatus, the computer processor updating in real time the augmented view based on real time tracking information of the tracked detector plate are the same. In some embodiments, two or more of the at least one computer processor obtaining information about the geometry of the one or more components of the imaging system, information about the geometry of the image acquisition, information about one or more image acquisition parameters, or combination thereof, the at least one computer processor obtaining information about the geometry of the detector plate, the at least one computer processor generating the first 3D representation, the at least one computer processor 11 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT generating the second 3D representation, the computer at least one processor generating the augmented view, the computer processor updating in real time the augmented view based on real time tracking information of the tracked one or more components of the portable x- ray apparatus, the at least one computer processor updating in real time the augmented view based on real time tracking information of the tracked detector plate are different. Aspect of the disclosure relate to a method of positioning an imaging system to avoid a collision with a patient and / or a patient table, the method comprising (a) tracking one or more components of the imaging system in real time; (b) tracking an augmented reality display device in real time; (c) obtaining, by at least one computer processor, information about a geometry, a clearance, an opening, a shape, a dimension, a travel path or a combination thereof of the one or more components of the imaging system; (d) generating, by the at least one computer processor, a 3D representation of a surface, a volume or combination thereof, wherein the 3D representation of the surface, the volume or combination thereof is at least in part derived from the information about the geometry, clearance, opening, shape, dimension, travel path or a combination thereof of the one or more components of the imaging system; (e) generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation of the surface, volume or combination thereof; (f) displaying, by an augmented reality display device, the augmented view onto the imaging system, the clearance or opening of the imaging system, or a combination thereof at a position and orientation relative to the one or more components of the imaging system; (g) updating in real time the augmented view based on real time tracking information of the augmented reality display device; (h) updating in real time the augmented view based on real time tracking information of the one or more components of the imaging system so that the 3D representation is maintained in relationship to the one or more components of the imaging system as the imaging system moves; (i) moving the imaging system so that the augmented view is not intersecting or colliding with at least a portion of the patient, the patient table, or a combination thereof; and (j) acquiring an image of the patient, wherein steps a. through i. are before the step of acquiring the image of the patient. In some embodiments, the step of acquiring comprises acquiring 2D, 3D, or 2D and 3D imaging data of the patient. In some embodiments, the augmented reality display device is a head mounted display, and the augmented view comprises a 3D stereoscopic view. In some embodiments, the 12 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT augmented reality display device is a tablet computer, or a smart phone, or comprises a computer monitor. In some embodiments, the 3D representation is fixed in relationship to the one or more components of the imaging system. In some embodiments, the surface, volume or combination thereof comprises information about a limit, an edge, a circumference, a perimeter, an envelope or a combination thereof of the imaging system. In some embodiments, the surface, volume or combination thereof comprises information about a travel path of the one or more components of the imaging system. In some embodiments, the travel path of the one or more components of the imaging system is a travel path from a first position, orientation, or position and orientation of the one or more components of the imaging system to a second position, orientation, or position and orientation of the one or more components of the imaging system. In some embodiments, the first position, orientation, or position and orientation is different from the second position, orientation, or position and orientation. In some embodiments, a first image is acquired at the first position, orientation, or position and orientation of the one or more components of the imaging system, and / or a second image is acquired at the second position, orientation, or position and orientation of the one or more components of the imaging system. In some embodiments, the travel path is a travel path of the one or more components of the imaging system during the step of acquiring the image of the patient. In some embodiments, the step of acquiring an image of the patient comprises a 3D volume of image data of the patient. In some embodiments, the step of acquiring an image of the patient comprises acquiring a cone beam computed tomography scan of a tissue of the patient. In some embodiments, the information about the geometry, clearance, opening, shape, dimension, travel path or a combination thereof of the one or more components of the imaging system comprises information about a geometric relationship between the one or more components of the imaging system, a geometric relationship between the one or more components of the imaging system and the patient, a geometric relationship between the one or more components of the imaging system and the patient table, or a geometric relationship between one or more components of the imaging system, the patient, and the patient table. 13 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the one or more components of the imaging system comprise a collimator, a grid, an image intensifier, an x-ray source, an x-ray detector, a housing, a mechanical member, a mechanical arm or a combination thereof. In some embodiments, the information about the geometry, clearance, opening, shape, dimension, travel path or a combination thereof comprises information about a tube – detector distance, a tube – patient distance, a patient – detector distance, a patient – image intensifier distance, a table distance relative to a tube, a table distance relative to a detector, a table position relative to a tube, a detector, or combination thereof, a patient position, a C- arm position, orientation, or combination thereof, a gantry position, orientation or combination thereof, a grid height, a grid position, orientation or combination thereof, a rotational axis of the imaging system, a rotational center of the imaging system, a travel path of the imaging system during the step of acquiring the image of the patient, a travel path of the patient table during the step of acquiring the image of the patient, or a combination thereof. In some embodiments, the imaging system comprises an x-ray system, a fluoroscopy system, a C-arm, a 3D C-arm, a digital tomosynthesis imaging system, an angiography system, a bi- planar angiography system, a 3D angiography system, a CT scanner, a PET scanner, a SPECT scanner, a nuclear scintigraphy system, or a combination thereof. In some embodiments, the method further comprises acquiring the real-time tracking information of the augmented reality display device, an anatomic structure of the patient, a patient table used with the imaging system, the imaging system, the one or more components of the imaging system, or a combination thereof using a camera, a scanner or a combination thereof. In some embodiments, the method further comprises obtaining real-time tracking information of the imaging system, the patient table, or a combination thereof using intrinsic information from the imaging system, the patient table, or combination thereof. In some embodiments, the intrinsic information comprises pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data, data from one or more potentiometers, data from one or more video systems, data from one or more LIDAR systems, data from one or more depth sensors, data from one or more inertial measurement units, data from one or more accelerometers, data from one or more magnetometers, data from one or more gyroscopes, data from one or more force sensors, data from one or more 14 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT pressure sensors, data from one or more position sensors, data from one or more orientation sensors, data from one or more motion sensors, position and / or orientation data from step motors, position and / or orientation data from electric motors, position and / or orientation data from hydraulic motors, position and / or orientation data from electric and / or mechanical actuators, position and / or orientation data from drives, position and / or orientation data from robotic controllers, position and / or orientation data from one or more robotic computer processors, or a combination thereof. In some embodiments, the travel path of the one or more components of the imaging system is concentric. In some embodiments, the travel path of the one or more components of the imaging system is around an isocenter. In some embodiments, the isocenter is fixed. In some embodiments, the travel path of the one or more components of the imaging system is not concentric. In some embodiments, the travel path of the one or more components of the imaging system comprises a rotational travel, translational travel, or rotational and translational travel. In some embodiments, at least a 3D surface of the patient, a patient drape, an anatomic structure of the patient, the patient table or a combination thereof are mapped using a camera, a 3D scanner, a depth sensor, a simultaneous mapping and localization (SLAM) system or a combination thereof. In other embodiments, at least a 3D surface of the patient, a patient drape, an anatomic structure of the patient, or a combination thereof are mapped using a camera, a 3D scanner, a depth sensor, a simultaneous mapping and localization (SLAM) system or a combination thereof and a 3D surface of the patient table is obtained from CAD data of the patient table. In some embodiments, the method further comprises detecting, by the at least one computer processor, a collision between the 3D representation of the surface, volume or combination thereof and the mapped 3D surface of the patient, patient drape, anatomic structure of the patient, patient table or combination thereof. In some embodiments, the method further comprises changing, by the at least one computer processor, the augmented view in areas of collision. In some embodiments, the change of the augmented view comprises a change in color, in transparency, in brightness or a combination thereof. Aspects of the disclosure relate to a method of positioning an imaging system to avoid a collision with a patient and / or a patient table comprising (a) tracking one or more 15 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT components of the imaging system in real time; (b) tracking an augmented reality display device in real time; (c) obtaining, by at least one computer processor, information about a geometry, a shape, a dimension, a travel path or a combination thereof of the one or more components of the imaging system; (d) generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system at a first position along the travel path of the one or more components of the imaging system; (e) generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system at a second position along the travel path of the one or more components of the imaging system, wherein the first and second position of the one or more components of the imaging system along the travel path are different, (f) generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation of the one or more components of the imaging system at the first position and the 3D representation of the one or more components of the imaging system at the second position; (g) displaying, by the augmented reality display device, the augmented view onto the imaging system, the clearance or opening of the imaging system, or a combination thereof at a predetermined position and orientation relative to the one or more components of the imaging system; (h) updating in real time the augmented view based on real time tracking information of the one or more components of the imaging system so that the 3D representation of the one or more components of the imaging system at the first position and the 3D representation of the one or more components of the imaging system at the second position are maintained as the imaging system moves; (i) moving the imaging system so that the augmented view is not intersecting or colliding with at least a portion of the patient, the patient table, or a combination thereof; and (j) acquiring the image of the patient, wherein steps a. through i. are before the step of acquiring the image of the patient. In some embodiments, the method comprises acquiring a first image at the first position of the one or more components of the imaging system, and / or acquiring a second image at the second position of the one or more components of the imaging system. In some embodiments, the travel path is a travel path of the one or more components of the imaging system during the step of acquiring the image of the patient. In some embodiments, the image of the patient is an image volume. In some embodiments, the image volume is generated using a cone beam computer tomography (CT). In some embodiments, the imaging system is a C-arm or an angiography system. In some embodiments, the travel path is C-shaped. In some 16 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT embodiments, the method comprises updating in real time the augmented view based on real time tracking information of the augmented reality display device. In some embodiments, the one or more components is an X-ray source, an x-ray detector or combination thereof. Aspects of the disclosure relate to a method of positioning an imaging system to avoid a collision with a patient and / or a patient table comprising (a) tracking one or more components of the imaging system in real time; (b) tracking an augmented reality display device in real time; (c) obtaining, by at least one computer processor, information about a geometry, a shape, a dimension, a travel path or a combination thereof of the one or more components of the imaging system; (d) generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system, wherein the 3D representation is a graphical representation of the one or more components of the imaging system moving along the travel path, a graphical representation of the travel path or a combination thereof; (e) generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation; (f) displaying, by an augmented reality display device, the augmented view onto the imaging system, the clearance or opening of the imaging system, or a combination thereof at a predetermined position and orientation relative to the one or more components of the imaging system; (g) updating in real time the position and orientation of the augmented view based on real time tracking information of the one or more components of the imaging system so that the 3D representation is maintained in relationship to the imaging system, the clearance of opening of the imaging system, or combination thereof as the imaging system moves; (h) moving the imaging system so that the augmented view is not intersecting or colliding with at least a portion of the patient, the patient table, or a combination thereof, (i) acquiring the image of the patient, wherein steps a. through h. are before the step of acquiring the image of the patient. In some embodiments, the travel path is a travel path of the one or more components of the imaging system during the step of acquiring the image of the patient. In some embodiments, the image of the patient is an image volume. In some embodiments, the image volume is generated using a cone beam computer tomography (CT). In some embodiments, the imaging system is a C-arm or an angiography system. In some embodiments, the travel path is C- shaped. In some embodiments, the method comprises updating in real time the augmented view based on real time tracking information of the augmented reality display device. In some 17 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT embodiments, the one or more components is an X-ray source, an x-ray detector or combination thereof. Other aspects of the disclosure relate to a method for augmented reality guidance of an imaging system, comprising (a) tracking an augmented reality display device, a patient, an operating room table, an imaging system or a combination thereof in a coordinate system; (b) generating a first virtual display of a 2D and / or 3D image acquisition by the augmented reality display device using a computer processor, wherein the first virtual display is based on a known geometry of the imaging system, known geometry of one or more components of the imaging system, and / or parameters of an image acquisition; (c) positioning the imaging system in relationship to a target anatomic structure of a patient for a 2D and / or 3D image acquisition using the first virtual display superimposed onto the imaging system or an opening of the imaging system; (d) performing a first image acquisition of the target anatomic structure; (e) storing and processing the location and orientation data of the first virtual display and first image acquisition for subsequent use; (f) re-displaying the first virtual display over the area of the first image acquisition; (g) displaying, by the augmented reality display device, a second virtual display, wherein the second virtual display is based on the known geometry of the imaging system, known geometry of one or more components of the imaging system, and / or parameters of a second image acquisition; (h) positioning the imaging system in relationship to the first virtual display displayed over the target anatomic structure with the second virtual display superimposed onto the imaging system or an opening of the imaging system, wherein the imaging system is positioned so that the second virtual display is partially overlapping with the first virtual display, the second virtual display is adjacent to or bordering the first virtual display, the second virtual display is separated from the first virtual display by a defined distance; and (i) performing a second image acquisition of the target anatomic structure. In some embodiments, the augmented reality display device is a head mounted display (HMD). In some embodiments, the HMD is an optical see-through head mounted display or a video see-through head mounted display. Other aspects of the disclosure relate to a system comprising an imaging system; at least on computer processor; and an augmented reality display device, wherein: the at least one computer processor is configured to track the augmented reality display device, a patient, an operating room table, an imaging system or a combination thereof in a coordinate system; 18 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT the at least one computer processor is configured to generate a first virtual display of a 2D and / or 3D image acquisition, wherein the first virtual display is based on a known geometry of the imaging system, known geometry of one or more components of the imaging system, and / or parameters of an image acquisition; the imaging system is configured to perform a first image acquisition of a target anatomic structure of the patient, when the imaging system is positioned in relationship to the target anatomic structure for the acquisition of a 2D and / or 3D image using the first virtual display superimposed onto the imaging system or an opening of the imaging system; the at least one computer processor is configured to store and process a location and orientation data of the first virtual display and first image acquisition for subsequent use; the at least one computer processor is configured to re-display the first virtual display over the area of the first image acquisition; the augmented reality display device is configured to display a second virtual display, wherein the second virtual display is based on the known geometry of the imaging system, known geometry of one or more components of the imaging system, and / or parameters of a second image acquisition; the imaging system is configured to be positioned in relationship to the first virtual display displayed over the target anatomic structure with the second virtual display superimposed onto the imaging system or an opening of the imaging system; the imaging system is configured to be positioned so that the second virtual display is partially overlapping with the first virtual display, the second virtual display is adjacent to or bordering the first virtual display, the second virtual display is separated from the first virtual display by a defined distance; and the imaging system is configured to perform a second image acquisition of the target anatomic structure. In some embodiments, the augmented reality display device is a head mounted display (HMD). In some embodiments, the HMD is an optical see-through head mounted display or a video see-through head mounted display. BRIEF DESCRIPTION OF THE DRAWINGS Illustrative, non-limiting example embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings. FIG. 1 shows a non-limiting example of a system configuration for tracking of, for example, anatomic structures, instruments, implants, robots, imaging systems, or any combination thereof and display by one or more including multiple head mounted displays, e.g. with rendering for the viewing direction of each head mounted display. 19 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT FIG. 2 shows a non-limiting example of a system with modular system configuration, comprising, for example, a tracking module, an instrument calibration module, a headset calibration module, an imaging and navigation module, an augmented reality (AR) wireless networking module, an AR visualization module, and an AR display module. FIG. 3 shows a non-limiting example of a tracking system, one or more computer systems, one or more robots, one or more imaging systems, and / or one or more head mounted displays, wherein, for example, a computer system can be configured to generate a command, e.g. by interaction of a user with a virtual object displayed by a virtual user interface, for activating, de-activating, operating, moving one or more systems, components, displays etc. of a navigation system, the one or more head mounted displays, the robot and / or the imaging system. FIG. 4 shows a non-limiting example of one or more tracking systems, in this example integrated or attached to one or more head mounted displays, one or more computer systems, one or more computer processors, one or more robots, one or more imaging systems, and / or one or more head mounted displays, for example configured for activating, de-activating, operating, moving one or more systems, components, displays etc. of a navigation system, the one or more head mounted displays, the robot and / or the imaging system. FIG. 5 shows a non-limiting example of one or more tracking systems, in this example integrated or attached to one or more head mounted displays, one or more computer systems, e.g. integrated, connected, or attached to a head mounted display, each with one or more computer processors, one or more robots, one or more imaging systems, and / or one or more head mounted displays, for example configured for activating, de-activating, operating, moving one or more systems, components, displays etc. of a navigation system, the one or more head mounted displays, the robot and / or the imaging system. FIG. 6A shows a non-limiting example of a C-arm system, e.g. a 2D or 3D C-arm, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device. FIG. 6B shows a non-limiting example of a C-arm system, e.g. a 2D or 3D C-arm, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of an outer envelope or perimeter of an x-ray beam prior to turning on the x-ray beam. 20 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT FIG. 6C-6E show non-limiting examples of a 3D C-arm system and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of an outer envelope or perimeter or limit of an intended 3D imaging data acquisition. FIG.7A shows a non-limiting example of a radiography (e.g.2D, 3D), angiography (e.g.2D, 3D, 4D) or other x-ray based imaging system, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device. FIGS.7B-7C show a non-limiting example of a radiography (e.g.2D, 3D), angiography (e.g.2D, 3D, 4D) or other x-ray based imaging system, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of a 3D representation of an outer envelope or perimeter of an x-ray beam prior to turning on the x- ray beam. FIGS.7D-7E show non-limiting examples of a radiography (e.g.2D, 3D), angiography (e.g.2D, 3D, 4D) or other x-ray based imaging system and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of a 3D representation of an outer envelope or perimeter or limit of a 3D imaging data acquisition prior to the actual imaging data acquisition. FIG. 8A shows a non-limiting example of a CT, cone beam CT, spiral CT, MRI system, SPECT system, PET system, or a combination thereof, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device. FIG. 8B shows a non-limiting example of a CT, cone beam CT, spiral CT, SPECT system, PET system, or a combination thereof, and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of an outer envelope or perimeter of an x-ray or energy beam prior to turning on the x-ray or energy beam. FIG.8C-8E show non-limiting examples of a CT, cone beam CT, spiral CT, MRI system, SPECT system, PET system, or a combination thereof and applications of a virtual display by a head mounted display (HMD) or other augmented reality device, e.g. with display of an outer envelope or perimeter or limit of a 3D imaging data acquisition prior to the actual imaging data acquisition. FIG.9 shows a non-limiting example of the use of multiple HMDs or other augmented reality display systems for multiple viewer’s, e.g. a primary surgeon, second surgeon, surgical assistant(s) and / or nurses(s) according to some embodiments of the present disclosure. 21 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT FIG.10 shows a non-limiting example of a workflow for segmentation and select subsequent steps according to some embodiments of the present disclosure. FIG.11 illustrates a non-limiting example of registering a digital hologram for an initial surgical step, performing the surgical step and re-registering one or more digital holograms for subsequent surgical steps according to some embodiments of the present disclosure. FIGS. 12A-12C are illustrative, non-limiting examples of virtual objects, e.g. arbitrary virtual planes, in a hip and a virtual femoral neck cut plane according to some embodiments of the present disclosure, e.g. for use in moving, directing, operating a surgical robot and / or an imaging system. FIG.13 shows an illustrative, non-limiting example how multiple HMDs or other augmented reality display systems can be used during a surgery, for example by a first surgeon, a second surgeon, a surgical assistant and / or one or more nurses and how a surgical plan can be modified and displayed during the procedure by multiple HMDs or other augmented reality display systems while preserving the correct perspective view of virtual data and corresponding live data for each individual operator according to some embodiments of the present disclosure. FIGS.14A-14F are illustrative, non-limiting examples of displaying virtual surgical guides, e.g. a virtual acetabular reaming axis, using one or more HMDs or other augmented reality display systems and aligning a physical acetabular reamer (e.g. attached to or part of a surgical robot) with the virtual reaming axis for placing an acetabular cup with a predetermined cup angle, offset, medial or lateral position and / or anteversion according to some embodiments of the present disclosure. FIGS.15A-15D provide illustrative, non-limiting examples of the use of virtual surgical guides such as a virtual distal femoral cut block displayed by an HMD and physical surgical guides such as physical distal femoral cut blocks (e.g. attached to or part of a surgical robot) for knee replacement according to some embodiments of the present disclosure. FIGS.16A-16C provide an illustrative, non-limiting example of the use of virtual surgical guides such as an AP femoral cut block displayed by an HMD and physical surgical guides such as physical AP cut blocks (e.g. attached to or part of a surgical robot) for knee replacement according to some embodiments of the present disclosure. FIGS. 17A-17F provide an illustrative, non-limiting examples of the use of virtual surgical guides such as a virtual proximal tibial cut guide displayed by an HMD and physical surgical 22 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT guides such as physical proximal tibial cut guide (e.g. attached to or part of a surgical robot) according to some embodiments of the present disclosure. FIG.18 shows a wooden board with 25 squares and four 4.0x4.0cm optical markers. FIG.19 shows an illustrative, non-limiting example of registration of four cubes in relationship to four optical markers using the image capture system of an HMD. FIG.20 shows an illustrative, non-limiting example of optical markers. FIG.21 shows an illustrative, non-limiting example of detection of optical markers using the image capture system of an HMD. FIG. 22 shows an illustrative, non-limiting example of the accuracy of detecting an optical marker using a video camera integrated into an HMD. FIGS. 23A-23E show an illustrative, non-limiting example for placing an intended path of a pedicle screw using a virtual interface. The placement can be executed via free hand technique or, for example, using a surgical robot, e.g. with a robotic tool or instrument sleeve or drill guide. FIGS.24A-24B provide illustrative, non-limiting examples of one or more augmented reality HMD displays including a virtual user interface for virtual placing, sizing, fitting, selecting and aligning of virtual pedicle screws and including HMD displays (e.g. optical head mounted display) for guidance of spinal instruments and implants. FIGS.25A-25B provide illustrative, non-limiting examples of one or more augmented reality HMD displays (e.g. optical head mounted display) for virtual placing, sizing, fitting, selecting and aligning of implant components for free hand or robotic surgery. Fig. 26A is a non-limiting example of an imaging system and an augmented reality display device. Fig.26B is a non-limiting example of a virtual display of the travel path and / or one or more components of the imaging system and / or geometry of the imaging system. Fig. 26C is a non-limiting example of a virtual display of one or more radii, diameters, clearances, circumferences of an imaging system. Fig. 26D is a non-limiting example of a virtual display of one or more radii, diameters, clearances, circumferences of an imaging system. Fig. 26E is a non-limiting example of a virtual display of one or more radii, diameters, clearances, circumferences of an imaging system. 23 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Fig. 26F is a non-limiting example of a virtual display of one or more radii, diameters, clearances, circumferences of an imaging system. FIGS. 27A-27C are non-limiting examples of a biplanar angiography imaging system with virtual display of the travel path, trajectory, circumference, one or more geometries of one or more components of the angiography system. FIGS. 28A-28D are non-limiting examples of a cone beam CT imaging system that can be opened or closed in relationship to a patient and / or patient table. FIGS.29A-29F are non-limiting examples of obtaining chest x-rays in a patient using a mobile x-ray unit, for example in an emergency room. Virtual displays, e.g. using a head mounted display, tablet computer, or other display device of a detector plate and / or an x-ray beam are shown for positioning x-ray system and / or the detector plate. DETAILED DESCRIPTION The following description provides exemplary embodiments only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the following description of the exemplary embodiments will provide those skilled in the art with an enabling description for implementing one or more exemplary embodiments. It will be understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the presently disclosed embodiments. Aspects of the present disclosure provide, among other things, systems, devices and methods for a simultaneous visualization of live data of the patient and digital representations of virtual data such as virtual operating ranges, virtual operating areas, virtual operating volumes, e.g. for robots and / or imaging system, virtual image acquisition ranges, virtual image acquisition areas, virtual image acquisition volumes, e.g. for imaging systems, virtual cuts and / or virtual surgical guides including cut blocks, drilling guides, one or more virtual axes, one or more virtual planes or a combination thereof through a head mounted display (HMD) or other augmented reality display system. In some embodiments, the system can include one or more HMDs or other augmented reality display systems, one or more processors and one or more user interfaces. In some embodiments, the surgical site including live data of the patient, the HMD, and the virtual data are registered in a common coordinate system. In some embodiments, the virtual data are superimposed onto and aligned with the live data of the patient. In some embodiments, the head mounted display is a see-through HMD, e.g. a video see-through HMD or an optical see-through HMD. Unlike virtual reality head systems that 24 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT blend out live data, the HMD can allow the surgeon to see the live data of the patient through the HMD, e.g. the surgical field, while at the same time observing virtual data of the patient and / or virtual surgical instruments or implants with a predetermined position and / or orientation using the display of the HMD unit. In any of the embodiments of the disclosure, a video see-through HMD or an optical see- through HMD can be used. In any of the embodiments of the disclosure, other augmented reality display devices can be used, e.g. in conjunction with an HMD or instead of an HMD, for example a tablet, e.g. an iPad (Apple, Cupertino, CA) or Surface (Microsoft, Redmond, WI), or a smart phone, e.g. an iPhone (Apple Cupertino, CA). When other augmented reality display devices are used, they can comprise an optional video camera or scanner, e.g. 3D scanner, including, for example, a LIDAR system, for scanning physical objects, such as an imaging system, a surgical robot (also referred herein as robotic system or surgical robotic system), an OR table, a patient on the OR table, an imaging system table, a patient on the imaging system table, a physical tool, a physical instrument, an end effector etc. The augmented reality display can comprise a composite or mixed reality or augmented reality display of the video feed and virtual devices or virtual objects, e.g. a virtual end effector or a 3D representation of an x-ray beam or intended image acquisition. Any virtual devices, virtual surgical guide, virtual tool or instrument, or virtual object known in the art or described in the specification can be co-displayed with the video feed or video images. The virtual devices, virtual surgical guide, virtual tool or instrument, or virtual object known in the art or described in the specification can be displayed in conjunction with the video feed and can optionally be registered with the physical objects, devices (e.g. an imaging system or a surgical robot) or a physical patient or target anatomic structure included in the video feed or video images. Any of the registration techniques described in the specification or known in the art can be used. The terms mixed reality and augmented reality as used throughout the disclosure can be used interchangeably. In any of the illustrations, the term HMD (i.e. head mounted display) can be used interchangeably with an augmented reality display device, mixed reality display device, e.g. a tablet or smart phone. In some embodiments, the terms head mounted display, HMD, augmented reality display device, mixed reality display device can be used interchangeably. In some embodiments, an operator such as a surgeon can look through an HMD observing physical data or information on a patient, e.g. a surgical site or changes induced on a surgical 25 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT site, while pre-existing data of the patient are superimposed onto the physical visual representation of the live patient. Systems, methods and techniques to improve the accuracy of the display of the virtual data superimposed onto the live data of the patient are described in International Patent Application No. PCT / US2018 / 012459, which is incorporated herein by reference in its entirety. Methods and systems of registration and cross-referencing including registration and cross- referencing surgical sites and one or more HMDs or other augmented reality display systems (e.g. using inside-out tracking techniques, outside-in tracking techniques, and combinations thereof) such as the ones described in PCT International Application Serial Nos. PCT / US2017 / 021859, PCT / US2018 / 013774 and PCT / US2019 / 015522 can be used. Methods, techniques, and systems of displaying virtual data in various surgical, medical or dental applications using one or more HMDs or other augmented reality display systems such as the ones described in PCT International Application Serial Nos. PCT / US2017 / 021859, PCT / US2018 / 013774, PCT / US2019 / 61698, PCT / US2019 / 015522, and U.S. Patent No. 9,861,446 can be used. These applications are hereby incorporated by reference in their entireties. Aspects of the present disclosure relate to systems, devices and methods for performing a surgical step or surgical procedure with visual guidance using a head mounted display. In some embodiments, the head mounted display can be a see-through head mounted display, e.g. an optical see-through head mounted display, for example for augmented reality applications. In some embodiments, the head mounted display can be a non-see through head mounted display, e.g. video-see through type, for virtual reality applications, optionally with video display including video streaming of live data from the patient, e.g. video feed from a camera integrated into, attached to, or separate from the head mounted display. The head mounted display can provide surgical guidance in a mixed reality environment. In some embodiments, head mounted displays (HMD) can be used. In some embodiments, the HMD comprises an optical see-through head mounted displays and / or video see-through head mounted displays. In some embodiments, an imaging system can be a 2D imaging system, a 3D imaging system, a 2D and a 3D imaging system including radiographic based imaging systems, e.g.2D and / or 3D C-arms, angiography systems, interventional radiology and / or cardiology imaging systems. An imaging system can also comprise 2D and / or 3D radiography systems. The term "imaging 26 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT system" can be substituted for with the term "external beam radiation system"; embodiments are applicable to both imaging systems and external beam radiation systems. Any of the embodiments throughout the specification are applicable to external beam radiation methods, devices and systems. For example, the planning and augmented reality display of an image acquisition volume can be applied to the planning and augmented reality display of a radiation volume using external beam radiation. The augmented reality display of a collision of an imaging system can be applied to an augmented reality display of an external beam radiation system. Illustrations and examples demonstrating augmented reality display of image acquisition volumes are also representative of augmented reality display of radiation volumes using external beam radiation systems. Illustrations and examples demonstrating augmented reality display of collision of imaging systems (e.g. with a patient or patient table) are also representative of augmented reality display of collision of external beam radiation systems. In any embodiment, tracking of a head mounted display, a patient, an OR table, an imaging system or combination thereof can be accomplished using one or more markers, for example, optical markers, including, for example, with geometric pattern(s), fiducial markers, infrared markers, retro-reflective markers, radio-frequency markers, fiducial arrays, and any combinations of the foregoing. Any of these tracking means can be attached or integrated to the head mounted display, the patient, the OR table, the imaging systems, or combination thereof. In some embodiments, tracking of a head mounted display, a patient, an OR table, an imaging system or combination thereof can be accomplished using a scanner, a 3D scanner, a camera, a depth sensor, SLAM (simultaneous localization and mapping) techniques. In some embodiments, an optical see-through head mounted display, a patient, an OR table, an imaging system, an external beam radiation system or combination thereof are tracked in a coordinate system using any of the methods, devices, systems and techniques described throughout the specification, including but not limited to inside out and outside in tracking, or any of the methods, devices, systems and techniques known in the art. The coordinate system can be the coordinate system of the patient, the OR table, the imaging system, the external beam radiation system, the head mounted display, or a combination thereof. In some embodiments, multiple coordinate systems can be used, for example a coordinate system of the patient, the OR table, the imaging system, the external beam radiation system, 27 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT the head mounted display, which can optionally be referenced in relationship with each other. For example, in spinal imaging, a pelvic pin with an attached marker and / or array, a spinal clamp with an attached marker and / or array can be used for tracking a patient in a coordinate system using, for example, a tracking camera and / or tracking system. The coordinate system can be the coordinate system of the marker and / or array attached to the pelvic pin and / or spinal clamp. In some embodiments, an HMD can display a virtual 2D and / or 3D image acquisition and / or a virtual 2D and / or 3D radiation field, area, and / or volume. One or more computer processors can, for example, track an HMD, a patient or anatomic structure of a patient, the imaging system, or an external beam radiation system, including one or more of its components, and can generate a virtual display, by the HMD, of a 2D and / or 3D image acquisition or a 2D and / or 3D radiation field, area, volume, for example when the geometry of the 2D and / or 3D image acquisition or the radiation field, area, or volume are known, and, optionally, when the 2D and / or 3D image acquisition parameters or radiation parameters are known, as described, for example, in U.S. Patent No. 11,786,206, which is hereby incorporated in its entirety. The virtual display of the 2D and / or 3D image acquisition and / or 2D and / or 3D radiation field, area, or volume can be performed without activating the x-ray beam and / or radiation beam, as described, for example, in U.S. Patent No.11,786,206, which is hereby incorporated in its entirety. In some embodiments, multiple 2D and / or 3D image acquisitions and / or 2D and / or 3D radiation field, area, or volume can be planned and / or intended. The multiple 2D and / or 3D image acquisitions and / or 2D and / or 3D radiation field, area, or volume can be at defined spatial locations, for example adjacent to each other, “touching each other”, e.g. with coordinates bordering each other, contiguous with each other, at defined intervals in relationship to each other, e.g. intervals in distance and / or volume. For example, with 2D radiographic images, the 2D radiographic images can be planned or intended to be adjacent to each other and to cover anatomic structures of a patient continuously or near continuously. For example, with 3D image acquisitions, the 3D image acquisitions can be planned or intended to be adjacent to each other, continuously covering and / or including anatomic structures of a patient. For example, with 3D radiation volumes, the 3D radiation volumes can be planned or intended to be adjacent to each other, continuously covering and / or including anatomic structures of a patient. 28 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Some aspects of the disclosure relate to a system for performing a surgical procedure, the system comprising: a processor; a see-through head mounted display or other augmented reality display device; and a marker attached to a patient, wherein, the system is configured to generate a 3D stereoscopic view or augmented view of a virtual surgical guide, wherein the virtual surgical guide is a placement indicator at one or more predetermined coordinates indicating a predetermined position, predetermined orientation or combination thereof for aligning a physical surgical tool or a physical surgical instrument, wherein the system is configured to display the 3D stereoscopic view by the see through head mounted display onto the patient, e.g. a patient’s spine, a patient’s joint, a patient’s tooth, gum, dental structure or combination thereof. The processor can be configured to determine a distance between one or more predetermined coordinates of the virtual surgical guide and the see through head mounted display, wherein the one or more predetermined coordinates of the virtual surgical guide can be referenced to or based on the marker. In some embodiments, the processor can be configured to adjust at least one focal plane, focal point, convergence or combination thereof of the display of the 3D stereoscopic view based on a determined distance, e.g. using inside-out or outside-in tracking or a combination thereof. In some embodiments, the system can be configured to track, e.g. in real-time, a robot component, an end effector, an imaging system component, an external beam radiation system component, or a combination thereof. Inside-out tracking can comprise tracking, for example, a head mounted display, an augmented reality display device, an anatomic structure of the patient, a patient table used with the imaging system or an external beam radiation system, an imaging system or an external beam radiation system, one or more components of the imaging system or an external beam radiation system, a surgical instrument, a surgical tool, an implant, a surgical robot, a robot integrated with or part of the imaging system or an external beam radiation system, a physical object or any combination thereof using at least one camera, scanner (including navigation systems, LIDAR systems etc.) or combination thereof integrated into a head mounted display or augmented reality display device. Outside-in tracking can comprise tracking, for example, a head mounted display, an augmented reality display device, an anatomic structure of the patient, a patient table used with the imaging system or an external beam radiation system, an imaging system or an external beam radiation system, one or more components of the imaging system or an external beam radiation system, a surgical instrument, a surgical tool, an implant, a surgical robot, a robot integrated with or part of the 29 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT imaging system or an external beam radiation system, a physical object or any combination thereof using at least one camera, scanner (including navigation systems, LIDAR systems etc.) or combination thereof separate from a head mounted display or augmented reality display device. In some embodiments, the system comprises one or more markers. In some embodiments, the marker can be configured to reflect or emit light with a wavelength between 380nm and 700nm. In some embodiments, the marker can be configured to reflect or emit light with a wavelength greater than 700nm. In some embodiments, the marker can be a radiofrequency marker, or the marker can be an optical marker, wherein the optical marker can include a geometric pattern. A radiofrequency marker can comprise, for example, a radiofrequency transmitter, a computer processor, and / or other components. A radiofrequency marker can transmit digital radiofrequency data. The radiofrequency marker can be attached, for example, to a detector plate, an x-ray system, an x-ray detector, an x-ray tube, an image intensifier, one or more components of an imaging system or an external beam radiation system, an augmented reality display device. A radiofrequency marker can comprise a small radio transponder or transmitter. A radiofrequency tracking system can comprise a radiofrequency radio transponder or transmitter, a radiofrequency radio receiver, and radiowaves. In some embodiments, the one or more markers can comprise at least one marker attached to the patient, at least one marker attached to a see-through head mounted display, at least one marker attached to a structure in the operating room or any combination thereof. In some embodiments, the system can be configured to determine one or more coordinates using one or more cameras. In some embodiments, the one or more cameras detect light with a wavelength between 380nm and 700nm. In some embodiments, the one or more cameras detect light with a wavelength above 700nm. In some embodiments, the one or more cameras detect light with a wavelength between 380nm and 700nm, above 700 nm or a combination thereof. In some embodiments, the system comprises at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, inertial measurement unit (IMU), oscilloscope, gyroscope, or a combination thereof integrated into or attached to the head mounted display. In some embodiments, at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU, oscilloscope, gyroscope or a combination thereof is separate from the head mounted display. In some embodiments, the one or more camera, scanner, 3D scanner, LIDAR system, depth 30 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT sensor, IMU, oscilloscope, gyroscope or a combination thereof are configured to determine the position, orientation, or position and orientation of the marker. In some embodiments, the one or more camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU, oscilloscope, gyroscope or a combination thereof are configured to determine one or more coordinates of the marker. In some embodiments, the one or more camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU, oscilloscope, gyroscope or a combination thereof are configured to track the one or more coordinates of the marker during movement of the marker. In some embodiments, the one or more camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU, oscilloscope, gyroscope or a combination thereof are configured to determine one or more coordinates of the patient directly (e.g. markerless), e.g. by detecting select anatomic landmarks and / or structures and / or surfaces, e.g. a spinal structure and / or surface, articular structure and / or surface, tooth and / or surface, gum and / or surface, dental structure and / or surface, other structure and / or surface or body tissues. In some embodiments, the one or more camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof are configured to determine one or more coordinates of the see through head mounted display. In some embodiments, the system is configured to track the one or more coordinates of the see through head mounted display during movement of the patient, the see through head mounted display, or the patient and the see through head mounted display. The movement of the patient can be, for example, the movement of a spine, one or more spinal elements, a head, a joint, one or more articular surfaces, a mandible, a maxilla, a tooth. In some embodiments, the system comprises one or more processors. In some embodiments, the one or more processors are configured to generate the 3D stereoscopic view of the virtual surgical guide, virtual display, e.g. virtual axis, virtual plane, virtual operating range, area or volume (e.g. of a robot and / or imaging system or an external beam radiation system), virtual image acquisition range, area or volume (e.g. of an imaging system or an external beam radiation system). In some embodiments, the one or more processors are configured to determine the distance between the one or more predetermined coordinates of the virtual surgical guide, virtual display, e.g. virtual axis, virtual plane, virtual operating range, area or volume (e.g. of a robot and / or imaging system or an external beam radiation system), virtual image acquisition range, area or volume (e.g. of an imaging system or an external beam radiation system) and the see through head mounted display. In some embodiments, the one 31 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT or more processors are configured to track one or more coordinates of at least one or more markers, one or more anatomic structures, one or more see through head mounted displays, or combinations thereof during movement of the patient, the see through head mounted display or the patient and the see through head mounted display. In some embodiments, the one or more processors are configured to determine the distance between the one or more predetermined coordinates of the virtual surgical guide, virtual display, e.g. virtual axis, virtual plane, virtual operating boundary, virtual operating range, area or volume (e.g. of a robot and / or imaging system or an external beam radiation system), virtual image acquisition range, area or volume (e.g. of an imaging system or an external beam radiation system) and the see through head mounted display during movement of the marker and / or the anatomic structure, movement of the see through head mounted display, or movement of the marker and / or the anatomic structure and the see through head mounted display. In some embodiments, one or more processors are configured to adjust at least one focal plane, focal point, convergence or combination thereof based on a change in a determined distance, e.g. from an HMD to a surgical site and / or anatomic structure. In some embodiments, one or more computer processors and / or computing systems, e.g. a first, second, third, fourth, etc. computer processor and / or computing systems are configured to display, e.g. by a computer monitor and / or one or more head mounted displays, a virtual surgical guide, e.g. a virtual axis, virtual plane, a virtual operating range, virtual operating area or virtual operating volume (e.g. of a robot and / or imaging system or an external beam radiation system), a virtual image acquisition range, virtual image acquisition area or virtual image acquisition volume (e.g. of an imaging system or an external beam radiation system). A first computer processor and / or computing system can be configured to communicate (e.g. via direct cable connection or wireless connection) to a robot and / or an imaging system or an external beam radiation system or to be communicatively coupled to the robot and / or imaging system or an external beam radiation system. A second computer processor and / or computing system can be configured to communicate (e.g. via direct cable connection or wireless connection) to one or more head mounted displays or to be communicatively coupled to the head mounted display(s). In some embodiments, the physical surgical tool or physical surgical instrument can be configured to effect a tissue removal in the patient. A tissue removal can be, for example, an osteotomy of a bone (e.g. using an osteotome, as used in spinal deformity operations or in 32 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT articular procedures), a pinning, drilling, milling, reaming, broaching, impacting and / or cutting of a bone using, for example, a pin, drill, mill, reamer, broach, impactor, and / or saw or sawblade, optionally attached to or integrated into a robot (e.g. hand-held or attached to an OR table) or a robotic arm. In some embodiments, a robotic end effector can be configured to effect a tissue removal or tissue alteration in the patient. The tissue removal or tissue alteration can be a removal of bone or a removal of cartilage or a removal of bone and cartilage, or a removal of a tooth and / or dental tissue, a tissue ablation, a tissue coagulation, a cell transfer, an implantation etc. Examples include a thermocoagulation, a cryoablation, a cutting with a scalpel or other cutting device. A tissue removal or alteration can be a removal or addition / supplementation of bone, bone tissue, cartilage, dental tissue, gum, gum tissue, brain, brain tissue, organ (e.g. liver, spleen, kidneys, bowel, stomach, heart, lung, thyroid, parathyroid tissue), skin, dermal tissue, subcutaneous tissue, or any combination thereof. Aspects of the present disclosure relate to devices and methods for performing a surgical step or surgical procedure with visual guidance using one or more head mounted displays and with display of one or more imaging studies, e.g. x-rays, Panorex views, CT scan (for example, spiral CT, cone beam CT), MRI scan, ultrasound scan, PET scan, SPECT scan or a combination thereof. Bluetooth In some embodiments, the device can comprise a Bluetooth transmitter and / or receiver. Bluetooth can be a packet-based protocol with a master / slave architecture. One master can communicate with multiple slaves in a piconet. A master Bluetooth device can communicate with multiple devices in a piconet. The devices can switch roles, by agreement, and the slave can become the master (for example, a headset initiating a connection to a phone can begin as master—as an initiator of the connection—but may subsequently operate as the slave). Bluetooth can be a layer protocol architecture comprising core protocols, cable replacement protocols, telephony control protocols, and adopted protocols. The device can, in some embodiments, employ high-speed Bluetooth protocols. The device can comprise an interface between a server and the device using a Bluetooth device. The interface can be HCI (Host Controller Interface). The Host Controller Interface can provide a command interface for the controller and for the link manager, which can allow access to the hardware status and control certain registers. This interface can provide an access layer for all Bluetooth devices. The HCI layer of the machine can exchange commands and data with the HCI firmware present in the Bluetooth 33 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT device. The HCI can, in some embodiments, automatically discover other Bluetooth devices that are within the coverage radius. The hardware that constitutes a Bluetooth device, including the Bluetooth device that can optionally be within the device, can include two parts: a radio device, responsible for modulating and transmitting the signal and a digital controller. These specific parts can, in some embodiments be physically separate and can in other embodiments be physically together. The digital controller can, in some embodiments, be a computer processor or a central processing unit (CPU). In some embodiments, the computer processor CPU can run a Link Controller; and interfaces with the host device, such as the Host Controller Interface. The Link Controller can be responsible for the processing of the baseband and the management of ARQ and physical layer FEC protocols. The computer processor or the CPU can, in some embodiments, handle the transfer functions (both asynchronous and synchronous), audio coding, and data encryption. The computer processor or CPU of the device can, in some embodiments, be responsible for performing the instructions related to the Bluetooth of the host device, in order to simplify its operation. For the performance of specific instructions related to the Bluetooth of the host device, the computer processor or the CPU can run software called Link Manager that has the function of communicating with other devices through the LMP protocol. The Link Manager can, in some embodiments, establish the connection between devices. For example, the Link Manager can establish the connection between the devices. The Link Manager can be responsible for the establishment, authentication and configuration of the link. The Link Manager can furthermore find other managers and communicates with them due to the management protocol of the LMP link. The Link Manager Protocol can comprise a number of PDUs (Protocol Data Units) that can be sent from one device to another. The following is a list of supported services: 1) Transmission and reception of data; 2) Name request; 3) Request of the link addresses; 4) Establishment of the connection; 5) Authentication; 5) Negotiation of link mode and connection establishment. The system, when in discoverable mode, can transmit the following information on demand: 1) Device name; 2) Device class; 3) List of services; 4) Technical information (for example: device features, manufacturer, Bluetooth specification used, clock offset). 34 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT The system can have a unique 48-bit address. The system can have a friendly Bluetooth name, which can be set by the user. This name can appear when another user scans for devices and in lists of paired devices. During pairing between the server and the system the two can establish a relationship by creating a shared secret or a link key. If both devices store the same link key, they can be paired or bonded. The following are pairing mechanisms that can be used in some embodiments of the disclosure: 1) Legacy pairing, wherein each device must enter a PIN code; pairing is only successful if both devices enter the same PIN code. Legacy has the following authentication mechanisms: a. Limited input devices, wherein the devices have a fixed PIN, for example "1111" or "2222", that are hard-coded into the device b. Numeric input devices, wherein the user can enter a numeric value up to 16 digits in length c. Alpha-numeric input devices wherein the user can enter full UTF-8 text as a PIN code 2) Secure Simple Pairing (SSP), using a public key cryptography, and certain modifications can help protect against man in the middle, or MITM attacks. SSP has the following authentication mechanisms: a. Just works: This method functions with no user interaction. However, the device may prompt the user to confirm the pairing process. b. Numeric comparison: The devices being paired display a 6-digit numeric code. The user can compare the numbers to ensure they are the exact same. If the comparison succeeds, the user(s) can confirm pairing on the device(s) that can accept an input. This method provides MITM protection, assuming the user confirms on both devices and actually performs the comparison properly. c. Passkey Entry: This mechanism can be used between a device with a display and a device with numeric keypad entry (such as a keyboard), or two devices with numeric keypad entry. In the first case, the display presents a 6-digit numeric code to the user, who then enters the code on the keypad. In the second case, the user of each device enters the same 6-digit number. 35 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT d. Out of band (OOB): This method uses an external means of communication, such as near-field communication (NFC) to exchange information used in the pairing process. Pairing is completed using the Bluetooth radio, but requires information from the OOB mechanism. In some embodiments, the device comprises a Bluetooth transmitter and / or receiver wherein the Bluetooth transmitter and / or receiver is configured to work in conjunction with an augmented reality surgical guidance system, a surgical navigation system, a robot, a robotic system, and / or a handheld robot. In some embodiments, the Bluetooth transmitter and / or receiver and the established connection between the Bluetooth transmitter and / or receiver and the augmented reality surgical guidance system, surgical navigation system, robot, robotic system, and / or handheld robot can work in conjunction with one or more on / off switches and / or one or more potentiometers, e.g. digital potentiometers, and / or one or more rheostats and / or one or more actuators to regulate the speed of the movement of the saw blade or movement of the drill bit or to provide haptic feedback. For example, in cases where the augmented reality surgical guidance system, surgical navigation system, robot, robotic system, and / or handheld robot detects a movement of a surgical instrument or tool deviating from an intended surgical axis, target, target area, target volume, tissue resection target, area, volume (e.g. bone or tissue removal or resection, e.g. with a bone drill or bone saw) by a specific distance in any direction in one or more dimensions, the augmented reality surgical guidance system, surgical navigation system, robot, robotic system, and / or handheld robot can transmit information to the Bluetooth receiver which can regulate the Bluetooth switch, including both a transmitter and receiver, to activate an on / off switch and / or a potentiometer, e.g. digital, and / or a rheostat and / or a specific actuator for haptic feedback. In cases where the augmented reality surgical guidance system, surgical navigation system, robot, robotic system, and / or handheld robot detects a movement of a drill or saw or other power tool that approaches, for example, a specific anatomical structure or safe zone, the augmented reality surgical guidance system, surgical navigation system, robot, robotic system, and / or handheld robot can similarly work in conjunction with the Bluetooth switch within the device attached to the drill or saw to adjust, control, and / or regulate an on / off switch and / or a potentiometer and / or a rheostat and / or a specific actuator for haptic feedback. The same concept can similarly work for turning on or 36 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT increasing the speed of the movement of the saw blade or the drill bit or other power tool or instrument when approaching certain anatomic structures. The Bluetooth switch, Bluetooth receiver, and / or Bluetooth transmitter can, in some embodiments, employ low latency Bluetooth in order to provide instant saw or drill speed regulation or instant haptic feedback. WiFi In some embodiments, the device comprises a WiFi transmitter and / or receiver. In some embodiments, the device can comprise WiFi capability. Different versions of WiFi can be used including but not limited to: 802.11a, 802.11b, 802.11g, 802.11n (Wi-Fi 4

[0040] ), 802.11h, 802.11i, 802.11-2007, 802.11-2012, 802.11ac (Wi-Fi 5

[0040] ), 802.11ad, 802.11af, 802.11-2016, 802.11ah, 802.11ai, 802.11aj, 802.11aq, 802.11ax (Wi-Fi 6

[0040] ), and 802.11ay. In some embodiments, the device comprises a WiFi transmitter and / or receiver wherein the WiFi transmitter and / or receiver is configured to work in conjunction with a surgical guidance system. In some embodiments, the system can include routers that can be configured for intranet and internet connections. In some embodiments, the system can utilize several distinct radio frequency ranges. For example, the system utilizes the 802.11 standard, it can include distinct radio frequencies ranges for use in Wi-FI communications such as: 900 MHz, 2.4 GHz, 5 GHz, 5.9 GHz, and 60 GHz bands. Each frequency or range can have a multitude of channels. In some embodiments, the system and / or device’s Wi-Fi can be part of the IEEE 802 protocol family. In some embodiments, the system and / or device can comprise one or more transmitters. WiFi transmitters are low power devices. In some embodiments, the system and / or device can comprise one or more antennas. The system and / or device can comprise an access point compliant with 802.11b and / or 802.11g. Using the stock omnidirectional antenna can have a range of 100 m (0.062 mi). The identical radio with an external semi parabolic antenna (15 dB gain) with a similarly equipped receiver at the far end can have a range over 20 miles. In some embodiments, the system and / or device can comprise multiple-input and multiple- output. The system and / or device including but not limited to standards such as IEEE 802.11n and IEEE 802.11ac, can comprise multiple antennas for extended range and higher speeds. In some embodiments, the WiFi can comprise Local Area Networks (LAN). In some embodiments, the device can include one or more access points. A wireless access point can 37 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT connect a group of wireless devices to an adjacent wired LAN. In some embodiments, the device can include one or more wireless adapters. Wireless adapters can allow devices to connect to a wireless network In some embodiments, the device can include one or more routers. Wireless routers can integrate a Wireless Access Point, Ethernet switch, and internal router firmware application that provides IP routing, NAT, and DNS forwarding through an integrated WAN-interface. In some embodiments, the device can include one or more wireless network bridges. Wireless network bridges can act to connect two networks to form a single network at the data-link layer over Wi-Fi. The main standard is the wireless distribution system (WDS). Wireless bridging can connect a wired network to a wireless network. In some embodiments, the device can include one or more security features. Security features can be any security standard known in the art. In some embodiments, the WiFi transmitter and / or receiver and the established connection between the WiFi transmitter and / or receiver and the augmented reality surgical guidance system can work in conjunction with one or more on / off switches and / or one or more potentiometers and / or one or more rheostats and / or one or more actuators to regulate the oscillation of a saw blade or movement of a drill bit or to provide haptic feedback. For example, in cases where the augmented reality surgical guidance system detects a movement of a drill or saw or other power tool or instrument deviating from the intended cut / drill surgical axis, the surgical guidance system can regulate a WiFi switch, including both a transmitter and receiver, to activate an on / off switch and / or a potentiometer, e.g. digital, and / or a rheostat and / or a specific actuator for haptic feedback. In cases where the surgical guidance system detects a movement of a drill or saw or other power tool or instrument that approaches, for example, a specific anatomical structure or safe zone, the surgical guidance system can similarly work in conjunction with a WiFi switch within the device attached to a drill or saw or other power tool or instrument to activate an on / off switch and / or a potentiometer and / or a rheostat and / or a specific actuator for haptic feedback. The same concept can similarly work for turning on or increasing the speed of the movement of a saw blade or a drill bit or other power tool or instrument when approaching certain anatomic structures. LiFi 38 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the device can comprise a LiFi transmitter and / or receiver. In some embodiments, the device can comprise LiFi capability. LiFi can use light from light-emitting diodes (LEDs) as a medium to deliver networked, mobile, high-speed communication. In some embodiments, the system can comprise visible light communications (VLC). VLC works by switching the current to the LEDs off and on at very high speeds. In some embodiments, the system can comprise Bg-Fi. Bg-Fi can be a Li-Fi system consisting of an application for a mobile device, and a simple consumer product device, with color sensor, microcontroller, and embedded software. Light from the mobile device display communicates to the color sensor on the consumer product, which converts the light into digital information. Light emitting diodes enable the consumer product to communicate synchronously with the mobile device. In some embodiments, the Li-Fi system can be wireless and can use 802.11 protocols. In some embodiments, the LiFi system can use ultraviolet, infrared and visible light communication. One part of the visible light communication can be designed from communication protocols established by the IEEE 802 workgroup. The IEEE 802.15.7 standard can, in some embodiments, define the physical layer (PHY) and media access control (MAC) layer. The modulation formats recognized for PHY I and PHY II are on-off keying (OOK) and variable pulse position modulation (VPPM). The Manchester coding used for the PHY I and PHY II layers can include the clock inside the transmitted data by representing a logic 0 with an OOK symbol "01" and a logic 1 with an OOK symbol "10", all with a DC component. The DC component avoids light extinction in case of an extended run of logic 0's. The use of LiFi provides additional benefits as the light waves are unlikely to affect or hinder the efficiency of a medical procedure or medical devices. In some embodiments, the device can comprise a LiFi transmitter and / or receiver wherein the LiFi transmitter and / or receiver is configured to work in conjunction with a surgical guidance system. In some embodiments, the LiFi transmitter and / or receiver and the established connection between the LiFi transmitter and / or receiver and the augmented reality surgical guidance system can work in conjunction with one or more on / off switches and / or one or more potentiometers and / or one or more rheostats and / or one or more actuators to regulate the oscillation of a saw blade or movement of a drill bit or to provide haptic feedback. 39 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT For example, in cases where an augmented reality surgical guidance system detects a movement of a drill or saw deviating from the intended cut / drill surgical axis, the surgical guidance system can regulate the LiFi switch, including both a transmitter and receiver, to activate an on / off switch and / or a potentiometer and / or a rheostat and / or a specific actuator for haptic feedback. In cases where the surgical guidance system detects a movement of a drill or saw that approaches, for example, a specific anatomical structure or safe zone, the surgical guidance system can similarly work in conjunction with the LiFi switch within a device attached to or integrated into a drill or saw to activate an on / off switch and / or a potentiometer and / or a rheostat and / or a specific actuator for haptic feedback. The same concept can similarly work for turning on or increasing the speed of the movement of a saw blade or a drill bit when approaching certain anatomic structures. In some embodiments, other forms of wireless data transmission known in the art can be used, not only Bluetooth, Wifi, Lifi, but also, but not limited to, a radiofrequency signal, a microwave signal, an ultrasound signal, an infrared signal, an electromagnetic wave or a combination thereof. Any form of wireless data transmission known in the art can be used in any of the embodiments. In some embodiments, the system comprises at least one camera, video system and / or scanner (e.g. a 3D scanner, a laser scanner, a LIDAR system or LIDAR scanner), a depth sensor, an IMU or a combination thereof integrated into or attached to the see through head mounted display. In some embodiments, at least one camera, video system and / or scanner (e.g. a 3D scanner, a laser scanner, a LIDAR system or LIDAR scanner), a depth sensor, an IMU or a combination thereof is / are separate from the head mounted display. In some embodiments, one or more camera, video system, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof are configured to determine the position, orientation, or position and orientation of a marker, a surface, and / or a tissue. In some embodiments, one or more camera, video system, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof are configured to determine one or more coordinates of a marker, a surface, and / or a tissue. In some embodiments, one or more camera, video system, scanner, 3D scanner, LIDAR system, depth sensor, IMU, oscilloscope, gyroscope or a combination thereof are configured to track one or more coordinates of a marker, a surface, and / or a tissue during movement of the marker, the surface, and / or the tissue. In some embodiments, one or more camera, video system, scanner, 3D scanner, LIDAR system, depth sensor, IMU, 40 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT oscilloscope, gyroscope or a combination thereof are configured to determine one or more coordinates of a see-through head mounted display. In some embodiments, one or more markers can be attached to or integrated into a physical instrument, a physical tool, a physical trial implant, a physical implant, a physical device, one or more HMDs or other augmented reality display systems, a robot, a robotic arm, a handheld robot, an end effector, an imaging system or an external beam radiation system, one or more components of an imaging system or an external beam radiation system or a combination thereof. Imaging Systems The term imaging system as used throughout the specification can comprise any imaging system using ionizing or non-ionizing radiation; the term "imaging system" can be substituted for with the term "external beam radiation system"; embodiments are applicable to both imaging systems and external beam radiation systems. The term imaging system as used throughout the specification can comprise any imaging system utilizing x-rays, e.g. a radiography system, a projection radiography system, a fluoroscopy system, a 2D fluoroscopy system, a 3D fluoroscopy system (e.g. using a 3D C-arm system), a cone beam CT system, a spiral CT system, CT imaging systems using pencil beam geometry, fan beam geometry, open beam geometry, a CT imaging system using a single detector array, a CT imaging system using multiple detector arrays, an electron beam CT imaging system, a conventional radiography system, a digital radiography system, a digital tomosynthesis system, a dual energy imaging system, a dual energy subtraction imaging system, a subtraction imaging system, an angiography imaging system, a uni-planar angiography system, a bi-planar angiography system, a 3D angiography system; the term imaging system as used throughout the specification can comprise a magnetic resonance imaging (MRI) system, an ultrasound imaging system; the term imaging system as used throughout the specification can comprise a radionuclide imaging system, a scintillation detector imaging system for radionuclide imaging, a semiconductor detector imaging system for radionuclide imaging, a pulse height spectroscopy imaging system for radionuclide imaging, a planar nuclear imaging system, a cardiac radionuclide imaging system, a single photon emission computed tomography (SPECT) imaging system, a positron emission tomography (PET) imaging system. The term imaging system as used throughout the specification can comprise or any combination of the foregoing imaging systems, e.g. a combined x-ray – ultrasound imaging system, a SPECT MRI 41 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT imaging system, a PET MRI imaging system, a 2D radiography / fluoroscopy – 3D cone beam CT imaging system etc. In any of the embodiments, the term imaging parameter can be used interchangeably with the terms image acquisition parameter, acquisition parameter, acquisition setting, image acquisition setting. EXTERNAL BEAM RADIATION AND RELATED METHODS, DEVICES, AND SYSTEMS Aspects of the disclosure relate to methods (e.g. computer implemented methods) and systems to display a radiation target volume, radiation target surface, radiation target area e.g. prior to or without activating any beams and / or radiation. Provided herein are methods and systems comprising a compute processor, an augmented reality display device and an external beam emitting radiation device. Any of the embodiments throughout the specification can be applied to external beam radiation emitting devices, external beam radiation therapy, electron beam emitting devices, proton therapy devices. Any of the embodiments throughout the specification using imaging system, C-arm, angiography system, can be applied to an external beam radiation emitting device, external beam radiation therapy, external beam radiation therapy system, electron beam emitting device, proton therapy device and / or system. Any of the embodiments throughout the specification can be applied to using external beam radiation emitting devices, external beam radiation therapy, external beam radiation therapy system, electron beam emitting devices, proton therapy devices, in which case the terms image acquisition volume, image acquisition surface, image acquisition area can be exchanged for radiation target volume, radiation target surface, radiation target area. Non-limiting examples of external beam radiation emitting device include, for example, 1. Linear Accelerators (LINACs): Linear Accelerators (LINACs) are the most common devices used for delivering external beam radiation therapy (EBRT). They produce high-energy X-rays or electrons that can be shaped to match a tumor’s shape. Commercially available LINAC systems are, for example: Varian (Palo Alto, CA) TrueBeam, Elekta (Stockholm, Sweden) Versa HD, Siemens (Erlangen, Germany) Artiste, CyberKnife, other robotic radiosurgery systems. 2. Proton Therapy Systems: Proton therapy is an advanced form of radiation therapy that uses protons instead of X-rays. It can deliver highly targeted doses, minimizing damage to surrounding healthy tissues. Commercially available Proton Therapy Systems include, for example: Varian ProBeam, IBA (Lovain-La-Neuve, Belgium) Proteus, Hitachi (Tokyo, Japan) 42 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Proton Therapy System. 3. Stereotactic Radiosurgery (SRS) & Stereotactic Body Radiation Therapy (SBRT) Systems: SRS and SBRT deliver high doses of radiation with extreme precision in fewer treatment sessions, often in a single session for brain tumors. Commercially available SRS / SBRT Systems include, for example: Gamma Knife (Elekta, (Stockholm, Sweden)), CyberKnife (Accuray (Sunnyvale, CA)) 4. Tomotherapy: Tomotherapy is an advanced form of radiation therapy that combines imaging with intensity-modulated radiation therapy (IMRT) for precise treatments. Commercially available Tomotherapy System include, for example: TomoTherapy (Accuray (Sunnyvale, CA), Radixact). 5. Brachytherapy Systems (Used in Combination with EBRT): Brachytherapy involves placing radioactive sources inside or near the tumor, delivering a high dose of radiation to a specific area. Commercially available Brachytherapy Systems include, for example: Elekta Flexitron, Varian GammaMed Plus 6. Specialized Heavy Ion Therapy Systems: Heavy ion therapy, such as carbon-ion radiation therapy, is an advanced treatment that delivers highly energetic particles for increased biological effectiveness against tumors. Non-limiting examples of EBRT techniques include, for example: 1. IMRT (Intensity-Modulated Radiation Therapy) IMRT is an advanced form of radiation therapy that modulates (varies) the intensity of the radiation beams to precisely conform to the shape of the tumor. 2. IGRT (image Guided Radiation Therapy) IGRT is a radiation therapy technique that uses real-time imaging before and / or during treatment to improve precision and accuracy. 3. VMAT (Volumetric Modulated Arc Therapy) VMAT is a faster and more advanced version of IMRT, where the radiation machine continuously rotates around the patient while adjusting the beam intensity and shape. 4. SBRT (Stereotactic Body Radiation Therapy) SBRT is a specialized form of radiation therapy that delivers very high doses of radiation in a few sessions with high precision. In some embodiments, when external beam radiation emitting devices, external beam radiation therapy, external beam radiation therapy systems, electron beam emitting devices, 43 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT proton therapy devices move, e.g. rotate or translate in one or more direction(s) or dimension(s), a computer processor is configured to display, by augmented reality display device (including but not limited to a head mounted display (e.g. optical see-through or video- see through), a tablet computer or other computer with computer monitor), a radiation target volume, radiation target surface, radiation target area, e.g. prior to or without activating any beams and / or radiation. In some embodiments, a computer processor is configured to display virtually, by augmented reality display device (e.g. a head mounted display (e.g. optical see- through or video-see through), a tablet computer or other computer with computer monitor), a virtual collision, a virtual circumference, a virtual clearance (e.g. area, surface, volume), a virtual geometry (e.g. area, surface, volume), a predetermined position and / or orientation, a simulated position and / or orientation, a 2D or 3D travel path of an external beam radiation emitting device, external beam radiation therapy, external beam radiation therapy system, electron beam emitting device, proton therapy device, e.g. prior to or without activating any beams and / or radiation. Optionally, one or more patient surfaces can be scanned and / or detected using a SLAM or other camera system and can be co-displayed by an augmented reality display device (e.g. a head mounted display (e.g. optical see-through or video-see through), a tablet computer or other computer with computer monitor). In some embodiments, the display comprises a display of a virtual a radiation target volume, radiation target surface, radiation target area, a patient surface, e.g. detected using a SLAM system, a table surface, e.g. detected using a SLAM system (or using known geometries, e.g. in CAD files), a virtual collision, a virtual circumference, a virtual clearance (e.g. area, surface, volume), a virtual geometry (e.g. area, surface, volume), a predetermined position and / or orientation, a simulated position and / or orientation, a 2D or 3D travel path of an external beam radiation emitting device, external beam radiation therapy, external beam radiation therapy system, electron beam emitting device, proton therapy device or any combination of the foregoing. The display of a virtual a radiation target volume, radiation target surface, radiation target area, a patient surface, e.g. detected using a SLAM system, a table surface, e.g. detected using a SLAM system (or using known geometries, e.g. in CAD files), a virtual collision, a virtual circumference, a virtual clearance (e.g. area, surface, volume), a virtual geometry (e.g. area, surface, volume), a predetermined position and / or orientation, a simulated position and / or orientation, a 2D or 3D travel path of an external beam radiation emitting device, external beam radiation therapy, external beam radiation therapy system, 44 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT electron beam emitting device, proton therapy device can be performed, e.g. by one or more computer processors, before, during and after a table or patient movement, for example moving a patient into a gamma knife system. Table 1: Non-limiting examples of imaging parameters, settings, geometries (partial list) of one or more components of an imaging system or external beam radiation system, available for setting, adjustment, modification for different imaging systems, e.g. using a virtual user interface displayed by one or more head mounted displays or other augmented reality display systems: X-ray, fluoroscopy, C-arm (2D, 3D imaging, e.g. including cone beam CT), CT (e.g. for different scanners, geometries, CT technologies (for example spiral CT, etc.) described in specification or known in the art): x-ray tube setting kVp mAs collimation radiation dose photon count tube – detector distance tube – patient distance patient – detector distance patient – image intensifier distance table height (e.g. relative to tube, detector, or combination thereof) table position (e.g. relative to tube, detector, or combination thereof) patient position C-arm position, orientation, location gantry position, orientation, location collimation grid height grid width grid ratio field of view center of a field of view 45 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT margins, perimeter, limits of a field of view matrix pixel size voxel size image size image volume radiation volume imaging plane image dimensions in x, y, z and / or oblique directions, e.g. scan coverage image location image volume location pitch in plane resolution slice thickness increment detector configuration detector resolution detector density tube current tube potential reconstruction algorithm, e.g. brain, soft-tissue, abdomen, bone scan range, scan boundary scan limit scan range rotational center (e.g. of a spiral acquisition, a detector movement, a tube movement, a C- arm movement) rotational axis (e.g. of a spiral acquisition, a detector movement, a tube movement, a C-arm movement) reconstructed slice thickness segmentation algorithm window and / or level 46 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT brightness contrast display resolution Ultrasound: wavelength frequency speed speed of sound depth gain frame rate width line density persistence sensitivity dynamic range relative intensity (e.g. in dB) relative pressure (e.g. in dB) amplitude pressure amplitude ratio intensity ratio power transducer geometry linear / phased transducer activation near field geometry far field geometry beam geometry beam divergence transmit focusing receive focusing acoustic lens geometry (e.g. deformable) pre-amplification settings 47 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT beam steering settings dynamic focusing settings signal summation settings time gain compensation settings logarithmic compression settings demodulation, envelope detection settings A-mode settings B-mode settings M-mode settings Doppler settings Doppler wave settings Doppler angle Doppler shift Doppler shift settings Respiratory gating Cardiac gating Respiratory gating settings Cardiac gating settings Harmonic imaging settings Harmonic wave settings Aliasing, anti-aliasing settings patient position transducer position / orientation patient scan region position / orientation field of view matrix pixel size voxel size image size image volume imaging plane in plane resolution 48 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT slice thickness scan range reconstructed slice thickness segmentation algorithm window and / or level brightness contrast display resolution MRI: repetition time echo time inversion time flip angle echo train length number of excitations pulse sequence, e.g. spin echo, gradient echo, fast field echo, turbo spin echo, table height table position patient position field of view matrix pixel size voxel size image size image volume imaging plane image dimensions in x, y, z and / or oblique directions, e.g. scan coverage in plane resolution slice thickness 2D Fourier Transform acquisition parameters 3D Fourier Transform acquisition parameters magnetization transfer contrast parameters 49 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT k-space sampling parameters coil coil parameters coil geometry phased array coil system transmit and / or receive coil coil sensitivity coil sensitivity profile gradient coil settings gradient rise time gradient strength reconstruction algorithm scan range reconstructed slice thickness segmentation algorithm window and / or level brightness contrast display resolution Radionuclide based imaging, e.g. nuclear scintigraphy, SPECT, PET etc., external beam radiation systems: table height table position patient position gantry position, orientation, location detector dimensions detector resolution image resolution scatter collimation collimator settings position of septal collimators, collimator rings 50 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT single energy acquisition settings multi energy acquisition settings 2D acquisition settings 3D acquisition settings field of view matrix pixel size voxel size image size image volume imaging plane image dimensions in x, y, z and / or oblique directions, e.g. scan coverage in plane resolution slice thickness reconstruction algorithm filter parameters filter kernel radionuclide decay scan range reconstructed slice thickness segmentation algorithm window and / or level brightness contrast display resolution The term imaging parameter or imaging parameters as used throughout the specification can comprise one or more of the above parameters and / or other parameters known in the art. The term imaging parameter or imaging parameters, as used herein, can be substituted with the term external beam radiation parameter or external beam radiation parameters when external beam radiation systems are used. Any of the foregoing parameters can be set, defined, determined, adjusted, modified using a user interface, including a graphical user interface. The graphical user interface can comprise virtual user interface, e.g. using a head 51 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT mounted display or other augmented reality display device. The virtual interface can, for example, use a collision detection, e.g. for generating and / or enabling one or more commands. Any of the above imaging parameters and / or other imaging parameters known in the art can be set, defined, determined, adjusted, modified using a virtual user interface, using any of the embodiments described in the specification, and / or any combination of embodiments described in the specification. The term virtual interface can be used interchangeably with the term virtual user interface. A virtual user interface can be a graphical user interface. A virtual user interface can be displayed by one or more head mounted displays or other augmented reality display devices. The virtual user interface displayed by a first, second, third, fourth etc. head mounted display can be the same or different. A virtual user interface can comprise at least one virtual object. A virtual user interface or the at least one virtual object can comprise one or more virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof. One or more commands can be generated by an interaction, e.g. of a user, with a virtual user interface. The interaction can be, for example, a collision detection, e.g. between a user’s finger and a virtual object, e.g. a virtual button, or between a tracked pointer or tool or surgical instrument and a virtual object. In one embodiment, as shown in non-limiting, strictly exemplary fashion in FIG.1, the system can comprise, for example, a tracking camera or tracking system 1170 (e.g. an optical tracking system, an electromagnetic tracking system, one or more visible light and / or infrared cameras, video systems, scanners, e.g. 3D scanners, laser scanners, LIDAR systems, depth sensors); a server / controller / computing unit 1180; a tracker controller 1190 to receive tracking data, e.g. for markers detected by camera 1170, optionally in real-time. The server / controller / computer unit can process and / or comprise current pose data, for example for detected markers, e.g. on a patient, e.g. a spinal clamp, one or more tools or instruments, and / or optionally one or more HMDs. A transform manager can convert tracked items, for example from a local coordinate system (CS) to a camera coordinate system (CS) 1210. A registration and / or calibration 1220 can transform a local coordinate system to a marker coordinate system, optionally. Steps, processes, commands and / or functions 1190, 1200, 1210, 1220 can be processed or operated by the server / controller / computing unit 1180. The current pose data 1230 for tracked items, e.g. a patient, an anatomic structure, a marker (for 52 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT example on a spinal clamp, and / or any marker attached to a patient, and / or any marker on any tool or instrument, and / or any marker on one or more HMDs or other augmented reality display devices), a physical tool or instrument, and / or one or more HMDs or other augmented reality display devices including information about the viewing direction of the one or more HMDs or other augmented reality display devices, can be located in the camera coordinate system and can be transferred to one or more HMDs or other augmented reality display devices, e.g. a first, second, third, fourth etc. HMD 1240 or other augmented reality display devices. The one or more HMDs 1240 or other augmented reality display devices can, for example, run a Unity app and render the one or more tracked items in the viewing perspective of the respective one or more HMDs or other augmented reality display devices. In some embodiments, a first computing system comprising one or more processor can be configured to transmit data to a second computing system configured to generate a display by a head mounted display or other augmented reality display device based on the transmitted data. In some embodiments, a first computing system comprising one or more processor can be configured to transmit data to a second computing system configured to generate a display by a head mounted display or other augmented reality display device. In some embodiments, a second computing system configured to generate a display by a head mounted display or other augmented reality display device can be configured to transmit data to a first computing system separate from the head mounted display or other augmented reality display device. In some embodiments, the first computing system and the second computing system can be configured to transmit and / or receive data from each other, e.g. for updating a display by a head mounted display or other augmented reality display device. The data or data packets that can be received and / or transmitted can comprise, for example, any of the data listed in Table 2: Table 2: Data or data packets for wireless transmission and / or reception between two or more computing systems, including computing systems communicably connected to one, two or more mobile HMD units and / or other augmented reality display devices and / or computing systems communicably connected to a surgical robot and / or an imaging system or an external beam radiation system. - 2D imaging data (including data derived from 2D imaging studies) of a patient, e.g. of an anatomic structre, at least a portion of a spine, spinal structure, joint, tooth, dental structure, vascular structure, or other body part of the patient, e.g. 53 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT o Pre-operative imaging data (CT, MRI, ultrasound etc.) o Intra-operative imaging data, for example received from an intra-operative imaging system, such as a 2D, 3D C-arm, cone beam CT, CT etc. - 3D imaging data (including data derived from 2D and / or 3D imaging studies) of at least a patient, e.g. of an anatomic structure, a portion of a spine, spinal structure, joint, tooth, dental structure, vascular structure, or other body part of the patient o Pre-operative imaging data (CT, MRI, ultrasound etc.) o Intra-operative imaging data, for example received from an intra-operative imaging system, such as a 2D, 3D C-arm, cone beam CT, CT etc. - Coordinate data or information of a patient, e.g. of an anatomic structure, a spine, spinal structure, joint, tooth, dental structure, vascular structure, or other body part of the patient - Real-time or near real-time tracking data or information of a patient, e.g. of an anatomic structure, a spine, spinal structure, joint, tooth, dental structure, vascular structure, or other body part of the patient - Coordinate data or information of one or more physical pointer - Real-time or near real-time tracking data or information of one or more physical pointer - Coordinate data or information of one or more physical tools or instruments - Real-time or near real-time tracking data or information of one or more physical tools or instruments - Coordinate information of one or more physical implants, physical implant components, or physical trial implants - Real-time or near real-time tracking data or information of one or more physical implants, physical implant components, or physical trial implants - Coordinate data or information of one or more end effectors, physical tools or instruments integrated or attached to or part of a robot, e.g. a robotic arm, handheld robot or a combination thereof, and / or coordinate data or information of one or more components of the robot, for example with at least a portion of the coordinate data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or a combination thereof of the robot (e.g. intrinsic data) (for example obtained using internal or 54 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from robotic controllers, position and / or orientation feedback from one or more robotic computer processors, or a combination thereof) - Real-time or near real-time tracking data or information of one or more end effectors, physical tools or instruments integrated or attached to or part of a robot, e.g. a robotic arm, handheld robot or a combination thereof, and / or real-time or near real-time tracking data or information of one or more components of the robot, for example with at least a portion of the tracking data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or a combination thereof of the robot (e.g. intrinsic data) (for example obtained using internal or integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from robotic controllers, position and / or orientation feedback from one or more robotic computer processors, or a combination thereof) - Coordinate information of one or more physical implants, physical implant components, or physical trial implants attached to a robot, e.g. a robotic arm, handheld robot or a combination thereof, for example with at least a portion of the coordinate data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or 55 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT a combination thereof of the robot (e.g. intrinsic data) (for example obtained using internal or integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from robotic controllers, position and / or orientation feedback from one or more robotic computer processors, or a combination thereof) - Real-time or near real-time tracking data or information of one or more physical implants, physical implant components, or physical trial implants attached to a robot, e.g. a robotic arm, handheld robot or a combination thereof, for example with at least a portion of the tracking data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or a combination thereof of the robot (e.g. intrinsic data) (for example obtained using internal or integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from robotic controllers, position and / or orientation feedback from one or more robotic computer processors, or a combination thereof) - Coordinate data or information of one or more components of an imaging system or an external beam radiation system, for example with at least a portion of the coordinate data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, or a combination thereof of the one or more components of the imaging system or an external beam 56 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT radiation system (e.g. intrinsic data) (for example obtained using internal or integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from one or more controllers, position and / or orientation feedback from one or more computer processors, or a combination thereof) - Real-time or near real-time tracking data or information of one or more components of an imaging system or an external beam radiation system, for example with at least a portion of the tracking data or information generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, or a combination thereof of the one or more components of an imaging system or an external beam radiation system (e.g. intrinsic data) (for example obtained using internal or integrated sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from step motors, position and / or orientation feedback from electric motors, position and / or orientation feedback from hydraulic motors, position and / or orientation feedback from electric and / or mechanical actuators, position and / or orientation feedback from drives, position and / or orientation feedback from one or more controllers, position and / or orientation feedback from one or more computer processors, or a combination thereof) - Coordinate data or information of one or more end effectors, physical tools or instruments integrated or attached to or part of a robot, e.g. a robotic arm, handheld robot or a combination thereof, and / or coordinate data or information of one or more components of the robot, for example with at least a portion of the coordinate data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or 57 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more end effectors, physical tools or instruments integrated or attached to or part of a robot, and / or one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more physical tools or instruments, integrated or attached to at least portions of the robot (e.g. the robotic arm, handheld robot or the combination thereof), or integrated or attached to the one or more physical tools or instruments and integrated or attached to at least portions of the robot - Real-time or near real-time tracking data or information of one or more end effectors, physical tools or instruments integrated or attached to a robot, e.g. a robotic arm, handheld robot or a combination thereof, and / or real-time or near real-time tracking data or information of one or more components of the robot, for example with at least a portion of the tracking data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more end effectors, physical tools or instruments integrated or attached to or part of a robot, and / or one or more markers, e.g. active markers (e.g. RF markers), passive 58 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more physical tools or instruments, integrated or attached to at least portions of the robot (e.g. the robotic arm, handheld robot or the combination thereof), or integrated or attached to the one or more physical tools or instruments and integrated or attached to at least portions of the robot - Coordinate information of one or more physical implants, physical implant components, or physical trial implants attached to a robot, e.g. a robotic arm, handheld robot or a combination thereof, for example with at least a portion of the coordinate data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more physical implants, physical implant components, or physical trial implants attached to a robot, and / or one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more physical tools or instruments, integrated or attached to at least portions of the robot (e.g. the robotic arm, handheld robot or the combination thereof), or integrated or attached to the one or more physical tools or instruments and integrated or attached to at least portions of the robot - Real-time or near real-time tracking data or information of one or more physical implants, physical implant components, or physical trial implants attached to a robot, e.g. a robotic arm, handheld robot or a combination thereof, for example with at least 59 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT a portion of the tracking data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more physical implants, physical implant components, or physical trial implants attached to a robot, and / or one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more physical tools or instruments, integrated or attached to at least portions of the robot (e.g. the robotic arm, handheld robot or the combination thereof), or integrated or attached to the one or more physical tools or instruments and integrated or attached to at least portions of the robot - Coordinate data or information of one or more components of an imaging system or an external beam radiation system, for example with at least a portion of the coordinate data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, the imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more components of the imaging system or an external beam radiation system, and / or one 60 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more components of the imaging system or an external beam radiation system - Real-time or near real-time tracking data or information of one or more components of an imaging system or an external beam radiation system, for example with at least a portion of the tracking data or information generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, the imaging system or an external beam radiation system (e.g. x-ray, cone beam CT, CT)), or a combination thereof, with one or more computer processors configured, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof, to determine, for example, the position, orientation, direction of movement, one or more coordinates, or combination thereof of the one or more components of the imaging system or an external beam radiation system - Coordinate data or information of one or more HMDs or other augmented reality display systems (including, for example, but not limited to, HMD housing, HMD visor, HMD display [e.g. a mirror, combiner, optical waveguide, optics, display unit]), comprising, for example, information about HMD or other augmented reality display system position, orientation, pitch or tilt, direction of movement, optionally labeled or coded for each specific HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) - Real-time or near real-time tracking data of one or more HMDs or other augmented reality display systems (including, for example, but not limited to, HMD housing, HMD 61 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT visor, HMD display [e.g. a mirror, combiner, optical waveguide, optics, display unit]), comprising, for example, information about HMD or other augmented reality display system position, orientation, pitch or tilt, direction of movement, optionally labeled or coded for each specific HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) - Real-time or near real-time data about the position, orientation, position and orientation, pitch or tilt, direction of movement of one or more HMDs or other augmented reality display system (including, for example, but not limited to, HMD housing, HMD visor, HMD display [e.g. a mirror, combiner, optical waveguide, optics, display unit]), optionally labeled or coded for each specific HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) - User specific settings and / or parameters o User specific display settings (e.g. color preferences, location of alphanumeric data, scan data, image data, 3D displays within the field of view of an HMD) o Interpupillary distance, e.g. determined via physical measurement and / or electronic measurement (for example by moving / aligning virtual objects displayed by an HMD); optionally stored on a first computing system, e.g. communicably coupled to a server, for example connected to a navigation system, robot, and / or imaging system or an external beam radiation system, and transmitted to / received by a second computing system communicably coupled to the HMD; or optionally stored on a second computing system communicably coupled to the HMD and transmitted to / received by a first 62 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT computing system, e.g. communicably coupled to a server, for example connected to a navigation system, robot, and / or imaging system or an external beam radiation system - Coordinate data or information of one or more virtual display (including, for example, a virtual retinal display) (e.g. a virtual interface) by one or more HMDs or other augmented reality display systems, comprising, for example, information about virtual display position, orientation, pitch or tilt, direction of movement, optionally labeled or coded for each specific virtual display and / or HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) - Real-time or near real-time tracking data of one or more virtual display (including, for example, a virtual retinal display) (e.g. a virtual interface) by one or more HMDs or other augmented reality display systems, comprising, for example, information about virtual display position, orientation, pitch or tilt, direction of movement, optionally labeled or coded for each specific virtual display and / or HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) - Real-time or near real-time data about the position, orientation, position and orientation, pitch or tilt, direction of movement of one or more virtual display (including, for example, a virtual retinal display) (e.g. a virtual interface) by one or more HMDs or other augmented reality display system, optionally labeled or coded for each specific virtual display and / or HMD or other augmented reality display system (e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner, a computer processor integrated into, attached to, or connected to a first 63 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system) 3D volume information of one or more physical tools or instruments - Real-time or near real-time data about one or more interactions, e.g. one or more collisions, of a tracked physical tool or instrument, e.g. a tracked pointer, a tracked stylus, a tracked tool, a tracked instrument or a combination thereof, with one or more virtual displays (e.g. a virtual interface) (including, for example, a virtual retinal display) - Real-time or near real-time changes, modifications, or alterations of one or more virtual displays (e.g. a virtual interface) (including, for example, a virtual retinal display) as a result of or triggered by one or more interactions, e.g. one or more collisions, with a tracked physical tool or instrument, e.g. a tracked pointer, a tracked stylus, a tracked tool, a tracked instrument or a combination thereof - 3D volume information of one or more physical implants, physical implant components, or physical trial implants - 3D volume information of one or more physical tools or instruments - 3D surface information of one or more physical tools or instruments - 3D surface information of one or more physical implants, physical implant components, or physical trial implants - 2D or 3D representations (for example 2D or 3D anatomic models, models derived from imaging data, e.g. of a patient) (including, for example, 3D volume or 3D surface data) of at least a portion of one or more structures or body parts of a patient e.g. of at least a portion of a spine, spinal structure, joint, tooth, dental structure, vascular structure, or other body part - 2D or 3D representations (including, for example, 3D volume or 3D surface data) of at least a portion of one or more virtual tools or instruments (e.g. corresponding to at least a portion of one or more physical tools or instruments, e.g. a tool or instrument axis) - 2D or 3D representations (including, for example, 3D volume or 3D surface data) of at least a portion of one or more virtual implants, virtual implant components, or virtual 64 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT trial implants (e.g. corresponding to at least a portion of one or more physical implants, physical implant components, or physical trial implants, e.g. an implant axis and / or an implant outline) - 2D or 3D representations (including, for example, 3D volume or 3D surface data) of virtual surgical guides, e.g. one or more virtual lines, virtual trajectories, virtual axes, virtual planes, virtual cut planes, virtual saw blades, virtual cut blocks, virtual inserts etc. - Target data, targeting data, e.g. in 2D or 3D - Stereoscopic view of any of the foregoing, e.g. generated for one or more HMDs (for example accounting for user specification and / or characteristics, such as interpupillary distance - Any combination of one or more of the foregoing The data or data packets can comprise stereoscopic and / or non-stereoscopic views or data prepared for stereoscopic and / or non-stereoscopic views or displays by one or more HMDs or other augmented reality display systems. Stereoscopic and / or non-stereoscopic views or data prepared for stereoscopic and / or non-stereoscopic views or displays by one or more HMDs or other augmented reality display systems can be updated in near real-time or real- time, e.g. with a rate of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. Position, orientation, position and orientation, direction of movement and / or tracking data for one or more HMDs or other augmented reality display systems can be obtained, measured and / or generated using, for example, one or more cameras or scanners (e.g. video systems, 3D scanners, LIDAR systems, depth sensors; using visible light and / or infrared and / or any other wavelength) integrated into or attached to the one or more HMDs or other augmented reality display systems, one or more cameras and / or scanners (e.g. video systems, 3D scanners, LIDAR systems, depth sensors; using visible light and / or infrared and / or any other wavelength) separate from the one or more HMDs or other augmented reality display systems, one or more lasers, e.g. integrated or attached to the one or more HMDs or other augmented reality display systems and / or separate from the one or more HMDs or other augmented reality display systems, one or more inertial measurement units integrated or attached to the one or more HMDs or other augmented reality display systems or a surgeon’s 65 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT head, one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.) integrated or attached to the one or more HMDs or other augmented reality display systems, any combination thereof optionally visible to the camera(s) and / or scanner(s), or any combination thereof. Position, orientation, position and orientation, direction of movement and / or tracking data for one or more HMDs or other augmented reality display systems can be generated, transmitted and / or received in near real time or in real time, e.g. with a rate of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. Position, orientation, position and orientation, direction of movement and / or tracking data for one or more HMDs or other augmented reality display systems can be transmitted by one or more computer processors integrated into or connected to the one or more HMDs or other augmented reality display systems via a wireless access point or router wirelessly to a separate computing system with one or more computer processors. The separate computing system can process the data about the position, orientation, position and orientation, direction of movement and / or tracking data of the one or more HMDs or other augmented reality display systems received and package them with other data for corresponding time points or time intervals, e.g. patient tracking data and / or instrument tracking data, for transmission, optionally back to the one or more HMDs or other augmented reality display systems. Position, orientation, position and orientation, direction of movement and / or tracking data for one or more HMDs or other augmented reality display systems can be obtained, acquired and / or generated by one or more cameras or scanners separate from the one or more HMDs or other augmented reality display systems and can be processed by one or more computer processors connected to or integrated into the camera and / or scanner and / or connected to or integrated into a separate computing system, e.g. a server, optionally connected directly or wirelessly to the camera or scanner. The separate computing system can process the data about the position, orientation, position and orientation, direction of movement and / or tracking data of the one or more HMDs or other augmented reality display systems received and package them with other data for corresponding time points or time intervals, e.g. patient 66 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT tracking data and / or instrument tracking data, for transmission (and / or reception), for example back to the one or more HMDs or other augmented reality display systems. Any of the data listed in Table 2 and any additional data can be transmitted and / or received in real-time, or near real-time, with transmitting and / or receiving rates of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. When multiple data sets, e.g. different types of data such as instrument tracking data and / or HMD or other augmented reality display system tracking data and / or patient or surgical site (e.g. a spine, joint, tooth or vascular structure) tracking data and / or virtual user interface and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) are transmitted and / or received, they can be transmitted and / or received simultaneously or non-simultaneously. Data sets including any of the data listed in Table 2 can optionally be labelled, e.g. with a time stamp, time point, time interval (e.g. within 1 transmission or data reception, for example, for a rate of 60Hz, within 16.66ms or less or, for example, any other value within the time allocated for transmission and reception), a time label, a time tag or any combination thereof. In some embodiments, coordinate information, registration data, tracking data or a combination thereof of one or more HMDs or other augmented reality display systems can optionally be labeled or coded for each specific HMD or other augmented reality display system, e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner (optionally part of a first or second computing unit), a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system). In some embodiments, data packets (for example, as listed in Table 2) can comprise multiple types of data, e.g. data comprising instrument tracking data, data comprising HMD or other augmented reality display system tracking data and / or a data comprising patient or surgical site (e.g. a spine, joint, dental, vascular, organ or neural structure) tracking data and / or virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument), all packaged within the same data packet. As the data packet(s) is / are transmitted or received, e.g. data comprising instrument tracking data and / or data 67 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT comprising HMD or other augmented reality display system tracking data and / or a data comprising patient or surgical site (e.g. a spine, joint, dental, vascular, organ or neural structure) tracking data and / or virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted or received together, e.g. simultaneously. In some embodiments, transmission and / or reception can be processed by one or more computer processors, e.g. in a first and / or a second computing system, and / or integrated or attached to a camera or scanner (e.g. integrated or attached to an HMD or other augmented reality display system, integrated or attached to a robot, separate from an HMD or other augmented reality display system or robot etc.), so that data, for example, instrument tracking data and / or HMD or other augmented reality display system tracking data and / or patient or surgical site (e.g. a spine or joint) tracking data, acquired with the same time stamp, time point, time label, time tag, or within the same time interval or any combination thereof are transmitted and / or received in the same data packet. In some embodiments, transmission and / or reception can be processed by one or more computer processors so that data, for example, instrument tracking data and / or HMD or other augmented reality display system tracking data and / or patient or surgical site (e.g. a spine or joint) tracking data and / or virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument), acquired within the same time interval (and optionally labelled with the same time interval) are transmitted and / or received by one or more computer processors, e.g. in a first and / or a second computing system, within a defined time period in multiple data packets; the defined time period can be corresponding to, matching, or overlapping with the time interval. Optionally the defined time period for transmitting and / or receiving data packets can be a time period bounded or defined by or derived from the transmission and / or reception rate, e.g. <0.16666666 sec for a transmission and / or reception rate of 60Hz, or <0.0333333 sec for a transmission and / or reception rate of 30Hz, <0.04 sec for a transmission and / or reception rate of 25Hz, or any other value. Data packets (for example, as listed in Table 2), e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine, joint, dental, vascular, organ or neural structure) tracking data and / or a fourth data 68 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received simultaneously, for example using different frequencies. Data packets, e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine or joint) tracking data and / or a fourth data packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received sequentially (e.g. using the same or different frequencies). Data packets, e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine or joint) tracking data and / or a fourth data packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received in an offset manner, e.g. with a pause or lag interval spaced in between. Data packets, e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine or joint) tracking data and / or a fourth data packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received in an interleaved manner. Data packets, e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine or joint) tracking data and / or a fourth data packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received in a non- overlapping manner during the transmission and / or the reception. Data packets, e.g. a first data packet comprising instrument tracking data, a second data packet comprising HMD or other augmented reality display system tracking data and / or a third data packet comprising patient or surgical site (e.g. a spine or joint) tracking data and / or a fourth data packet comprising virtual user interface data and / or interaction with virtual user interface data (e.g. with a tracked physical tool or instrument) can be transmitted and / or received in an overlapping manner during the transmission and / or the reception. 69 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Thus, data packets, e.g. comprising one or more of data comprising instrument tracking data, data comprising HMD or other augmented reality display system tracking data, or data comprising patient or surgical site data can be transmitted or received in a simultaneous, synchronous fashion and / or alternatively in an non-synchronous or asynchronous fashion. The data can be transmitted in near real time or in real time, e.g. with a rate of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. Data transmission can be performed using wireless data transmission protocols known in the art, e.g. Bluetooth, Wifi, LiFi, etc. and, as described, for example in PCT International Application Serial Nos. PCT / US2017 / 021859, PCT / US2018 / 013774, PCT / US2019 / 061698 and PCT / US2019 / 015522, which are hereby incorporated by reference in their entirety. In some embodiments, the system can comprise a tracking system or sensor, e.g. optical tracking systems, for example using infrared and / or visible light cameras, video systems, 3D scanners, LIDAR systems, depth sensors, radiofrequency tracking systems, or combinations thereof, e.g. for outside-in or inside-out tracking. Multiple tracking systems can be used at the same time or, optionally combined, e.g. inside-out and outside-in tracking. Any tracking, sensor, or registration system known in the art (e.g. optical tracking systems, for example using infrared and / or visible light cameras, video systems, 3D scanners, LIDAR systems, depth sensors, radiofrequency tracking systems, or combinations thereof), can be used, for example as described in a non-limiting fashion in PCT International Application Serial Nos. PCT / US2017 / 021859, PCT / US2018 / 013774, PCT / US2019 / 061698 and PCT / US2019 / 015522, which are hereby incorporated by reference in their entirety. A first computing system can comprise one or more computer processors. The second computing system can comprise one or more computer processors. The second computing system can be part of one or more mobile, wireless HMD or other augmented reality display system units. The second computing system can be part of a first mobile, wireless HMD or other augmented reality display system unit. A third computing system can be part of a second mobile wireless HMD or other augmented reality display system unit. A fourth computing system can be part of a third mobile wireless HMD or other augmented reality display system unit. A fifth computing system can be part of a third mobile wireless HMD or other augmented reality display system unit, etc. 70 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT A first computing system can comprise one or more computer processors. A first computing system can, for example, be a server or controller or computing unit as shown in FIG.1, 1180. The one or more computer processors can be configured to run different operating modules as shown, for example, in FIG.2, e.g. - A tracking module or tracking engine 1100. The tracking module or tracking engine can comprise a tracking system or sensor, e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system etc., e.g. for outside-in or inside-out tracking. The one or more computer processors and software running on the one or more computer processor can comprise an interface, e.g. a graphical user interface, for operating the tracking system or tracking sensor. An interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. The tracking module or tracking engine 1100 can, for example, obtain tracking information or data and / or track one or more physical instruments and / or tools, one or more anatomic structures, landmarks, and / or surfaces of a patient (e.g. in a surgical site) and / or one or more HMDs or other augmented reality display systems. The tracking module or engine 1100 can, optionally, label or code the tracking data and / or information for each specific HMD or other augmented reality display system, e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner (optionally part of a first or second computing unit), a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system). The tracking module or engine 1100 can, for example, apply a label or code specific for each HMD or other augmented reality display system based on tracking data and / or information received for and / or from each individual HMD or other augmented reality display system. The tracking data and / or information can, for example, be data or information from a camera or scanner integrated into or attached to an HMD or other augmented reality display system. The tracking data and / or information can, for example, be from a camera or scanner separate from an HMD or other augmented reality display system. The tracking data and / or information can, for example, be from one or more 71 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT cameras or scanners integrated into an HMD or other augmented reality display system or attached or connected to an HMD or other augmented reality display system and from one or more cameras or scanners separate from an HMD or other augmented reality display system (e.g. attached to an OR light, OR fixture, OR wall, a robot etc.). The tracking data and / or information can, for example, comprise data of one or more markers, e.g. attached to one or more HMDs or other augmented reality display systems, a patient (e.g. an anatomic structure, landmark or surface of the patient), a physical surgical tool or instrument, a physical implant or a combination thereof. In some embodiments, one or more markers can be configured specific for each HMD or other augmented reality display system, e.g. using a unique bar code, QR code, fiducial marker configuration, RF signal etc., which can, for example, be recognized by one or more computer processors. - An instrument calibration module 1110. The one or more computer processors can be configured to run an instrument calibration module. The instrument calibration module can comprise an interface. The instrument calibration module can be configured for determining an instrument or tool tip, an instrument or tool axis, an instrument or tool length, an instrument or tool rotational wobble etc. The tracking module or tracking engine and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - A headset calibration module 1120. The one or more computer processors can be configured to run a headset calibration module. The headset calibration module can comprise an interface. The headset calibration module, including its interface, can, for example, be configured for determining an interpupillary distance, a distance from the eye (e.g. pupil, iris, retina) to the display (e.g. a waveguide, mirror etc.), and / or for setting or adjusting an interpupillary distance in the headset, for setting or adjusting a field of view, for setting or adjusting a distance from the eye to the display for a given user, for setting or adjusting user display preferences (e.g. color, targeting tools, magnification, alphanumeric display, display window location, alphanumeric data location etc. The headset calibration module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. 72 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT - An imaging and navigation module 1130. The one or more computer processors can be configured to run an imaging and navigation module. The imaging and navigation module can, for example, comprise a PACS interface, an interface to an imaging system, e.g. x-ray, C-arm, 3D C-arm, cone-beam CT, CT, MRI etc., a DICOM reader, an image processing and display unit, e.g. for multi-planar reconstruction and / or display, 3D reconstruction and / or display, a planning module, e.g. with an interface for a user, surgeon (e.g. for screw or implant selection and placement), a navigation module, e.g. with coordinate output from a planning module. The imaging and navigation module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - An AR or VR wireless networking module 1140. In the AR or VR wireless networking module, one or more computer processors can be configured for packaging of data, e.g. data listed in Table 2. Packing of data can, optionally, comprise data compression. Packaging of data can, optionally, comprise segmentation or separation into different time segments. Data packets for different time segments can, for example, be generated at a rate of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. One or more computer processors can be configured to transmit data packets using a wireless access point to a second, third, fourth or more computing system. One or more computer processors can be configured to receive data packets using the wireless access point from a second, third, fourth or more computing system. In some embodiments, multiple wireless access points can be used. Any wireless communication protocol known in the art, e.g. Bluetooth, WiFi, LiFi, can be used. - An AR or VR visualization module 1150. One or more computer processors can be configured for generating display data for display by one or more HMDs or other augmented reality display systems. The display data can comprise targeting displays, e.g. target disk like, magnified displays, color labeled displays (e.g. red, yellow, green indicating position or alignment accuracy or thresholds), 3D models of the patient, image slices, 3D models or 3D or 2D graphical representations of tools or instruments (e.g. tracked physical tools or instruments) alphanumeric displays, and / or an AR or VR 73 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT enabled graphical user interface (e.g. gesture recognition, using gesture recognition, virtual pointers, a virtual mouse, a virtual keyboard, virtual buttons, gaze recognition, gaze lock or a combination thereof). An AR or VR visualization module can comprise a display of a virtual user interface and / or a display of one or more virtual interactions, e.g. collisions, with a virtual user interface (e.g. with a tracked physical tool or instrument). The AR or VR visualization and / or display module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - An AR or VR display module 1160. One or more computer processors can be configured for generating one or more 3D stereoscopic views, for example at a rate similar to the data transmission or reception and / or at a different rate. The 3D stereoscopic view can, for example, be adjusted for user specific characteristics (e.g. interpupillary distance, distance from pupil to mirror etc.). The 3D stereoscopic view can, for example, be adjusted for the distance from the pupil or the display to the patient, e.g. a surgical site, for example, in a spine, knee, hip, organ, vessel etc.; adjustments can comprise adjustments of focal plane or point, adjustments of scale or magnification of virtual displays and display items, adjustments of convergence. Adjustments can be in real-time or near real-time. Adjustments can be at less than real-time. An AR or VR display module can comprise a display of a virtual user interface and / or a display of one or more virtual interactions, e.g. collisions, with a virtual user interface (e.g. with a tracked physical tool or instrument). One or more of the modules 1100 – 1160 can be integrated or combined. For example, the AR visualization module 1150 can be integrated or combined with the AR display module 1160. One or more of the modules 1100 – 1160 can be run by the same computer processor or the same group of computer processors. One or more of the modules 1100 – 1160 can be run by different computer processors. One or more of the computer processors operating a tracking engine or tracking module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more 74 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be the same. One or more of the computer processors operating a tracking engine or tracking module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be different. The first computing system can, for example, be stationary, e.g. on a cart or stand. In some embodiments, the first computing system can also be mobile, e.g. part of a mobile, wireless HMD system or other augmented reality display system. A second, third, fourth, fifth or more computing systems can comprise one or more computer processors. The one or more computer processors can be configured to run different operating modules as shown, for example, in FIG.2, e.g. - A tracking module or tracking engine 1100. The tracking module or tracking engine can comprise a tracking system or sensor, e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system or an external beam radiation system etc., e.g. for outside-in or inside-out tracking. The one or more computer processors and software running on the one or more computer processor can comprise an interface, e.g. a graphical user interface, for operating the tracking system or tracking sensor. An interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. The tracking module or tracking engine 1100 can, for example, obtain tracking information or data and / or track one or more physical instruments and / or tools, one or more anatomic structures, landmarks, and / or surfaces of a patient (e.g. in a surgical site) and / or one or more HMDs or other augmented reality display systems. The tracking module or engine 1100 can, optionally, label or code the tracking data and / or information for each specific HMD or other augmented reality display system, e.g. by a computer processor integrated into, attached to, or connected to a camera or scanner (optionally part of a first or second computing unit), a computer processor integrated into, attached to, or connected to a first computing unit (e.g. in a server), 75 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT and / or a computer processor integrated into, attached to, or connected to a second computing unit (e.g. in a client, for example integrated into an HMD or other augmented reality display system or connected to an HMD or other augmented reality display system). The tracking module or engine 1100 can, for example, apply a label or code specific for each HMD or other augmented reality display system based on tracking data and / or information received for and / or from each individual HMD or other augmented reality display system. The tracking data and / or information can, for example, be data or information from a camera or scanner integrated into or attached to an HMD or other augmented reality display system. The tracking data and / or information can, for example, be from a camera or scanner separate from an HMD or other augmented reality display system. The tracking data and / or information can, for example, be from one or more cameras or scanners integrated into an HMD or other augmented reality display system or attached or connected to an HMD or other augmented reality display system and from one or more cameras or scanners separate from an HMD or other augmented reality display system (e.g. attached to an OR light, OR fixture, OR wall, a robot etc.). The tracking data and / or information can, for example, comprise data of one or more markers, e.g. attached to one or more HMDs or other augmented reality display systems, a patient (e.g. an anatomic structure, landmark or surface of the patient), a physical surgical tool or instrument, a physical implant or a combination thereof. In some embodiments, one or more markers can be configured specific for each HMD or other augmented reality display system, e.g. using a unique bar code, QR code, fiducial marker configuration, RF signal etc., which can, for example, be recognized by one or more computer processors. - An instrument calibration module 1110. The one or more computer processors can be configured to run an instrument calibration module. The instrument calibration module can comprise an interface. The instrument calibration module can be configured for determining an instrument or tool tip, an instrument or tool axis, an instrument or tool length, an instrument or tool rotational wobble etc. The tracking module or tracking engine and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. 76 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT - A headset calibration module 1120. The one or more computer processors can be configured to run a headset calibration module. The headset calibration module can comprise an interface. The headset calibration module, including its interface, can, for example, be configured for determining an interpupillary distance, a distance from the eye (e.g. pupil, iris, retina) to the display (e.g. a waveguide, mirror etc.), and / or for setting or adjusting an interpupillary distance in the headset, for setting or adjusting a field of view, for setting or adjusting a distance from the eye to the display for a given user, for setting or adjusting user display preferences (e.g. color, targeting tools, magnification, alphanumeric display, display window location, alphanumeric data location etc. The headset calibration module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - An imaging and navigation module 1130. The one or more computer processors can be configured to run an imaging and navigation module. The imaging and navigation module can, for example, comprise a PACS interface, an interface to an imaging system, e.g. x-ray, C-arm, 3D C-arm, cone-beam CT, CT, MRI etc., a DICOM reader, an image processing and display unit, e.g. for multi-planar reconstruction and / or display, 3D reconstruction and / or display, a planning module, e.g. with an interface for a user, surgeon (e.g. for screw or implant selection and placement), a navigation module, e.g. with coordinate output from a planning module. The imaging and navigation module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - An AR or VR wireless networking module 1140. In the AR or VR wireless networking module, one or more computer processors can be configured for packaging of data, e.g. data listed in Table 2. Packing of data can, optionally, comprise data compression. Packaging of data can, optionally, comprise segmentation or separation into different time segments. Data packets for different time segments can, for example, be generated at a rate of 10Hz, 15 Hz, 20Hz, 25Hz, 30Hz, 35Hz, 40Hz, 45Hz, 50Hz, 55Hz, 60Hz, 65Hz, 70Hz, 80Hz, 90Hz, 100Hz, or any other rate or frequency including higher rates or frequencies. One or more computer processors can be configured to transmit data packets using a wireless access point to a second, third, fourth or more 77 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT computing system. One or more computer processors can be configured to receive data packets using the wireless access point from a second, third, fourth or more computing system. In some embodiments, multiple wireless access points can be used. Any wireless communication protocol known in the art, e.g. Bluetooth, WiFi, LiFi, can be used. - An AR or VR visualization module 1150. One or more computer processors can be configured for generating display data for display by one or more HMDs or other augmented reality display systems. The display data can comprise targeting displays, e.g. target disk like, magnified displays, color labeled displays (e.g. red, yellow, green indicating position or alignment accuracy or thresholds), 3D models of the patient, image slices, 3D models or 3D or 2D graphical representations of tools or instruments (e.g. tracked physical tools or instruments) alphanumeric displays, and / or an AR or VR enabled graphical user interface (e.g. gesture recognition, using gesture recognition, virtual pointers, a virtual mouse, a virtual keyboard, virtual buttons, gaze recognition, gaze lock or a combination thereof). An AR or VR visualization module can comprise a display of a virtual user interface and / or a display of one or more virtual interactions, e.g. collisions, with a virtual user interface (e.g. with a tracked physical tool or instrument). The AR or VR visualization and / or display module and / or an interface can be configured for communication with other operating modules, e.g. integrated with the first computing system or the second computing system. - An AR or VR display module 1160. One or more computer processors can be configured for generating one or more 3D stereoscopic views, for example at a rate similar to the data transmission or reception and / or at a different rate. The 3D stereoscopic view can, for example, be adjusted for user specific characteristics (e.g. interpupillary distance, distance from pupil to mirror etc.). The 3D stereoscopic view can, for example, be adjusted for the distance from the pupil or the display to the patient, e.g. a surgical site, for example, in a spine, knee, hip, organ, vessel etc.; adjustments can comprise adjustments of focal plane or point, adjustments of scale or magnification of virtual displays and display items, adjustments of convergence. Adjustments can be in real-time or near real-time. Adjustments can be at less than real-time. An AR or VR display module can comprise a display of a virtual user 78 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT interface and / or a display of one or more virtual interactions, e.g. collisions, with a virtual user interface (e.g. with a tracked physical tool or instrument). The second computing system can be part of one or more mobile, wireless HMD or other augmented reality display system units. A second computing system can be part of a first mobile, wireless HMD or other augmented reality display system unit. A third computing system can be part of a second mobile wireless HMD or other augmented reality display system unit. A fourth computing system can be part of a third mobile wireless HMD or other augmented reality display system unit. A fifth computing system can be part of a third mobile wireless HMD or other augmented reality display system unit, etc. The first, second, third, fourth etc. mobile wireless HMD unit can be worn by a user, e.g. a physician, a surgeon, a dentist, a physician or dental assistant etc. The first, second, third, fourth etc. mobile wireless HMD unit can be a video see-through HMD. The first, second, third, fourth etc. mobile wireless HMD unit can be an optical see-through HMD. One or more modules can be combined or integrated and can, for example, be operated by the same one or more computer processors or, optionally, by different one or more computer processors. One or more of the computer processors operating a tracking engine or tracking module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be the same. One or more of the computer processors operating a tracking engine or tracking module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be different. One or more modules can be operated by a first computing system, while one or more different modules can be operated by a second, or third, or fourth, etc. computing system. 79 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT One or more modules can be operated by a first computing system, while one or more different modules can be operated by a second, and third, and fourth, etc. computing system. One or more modules can be operated by a first computing system, while one or more same modules can be operated by a second, or third, or fourth, etc. computing system. One or more modules can be operated by a first computing system, while one or more same modules can be operated by a second, and third, and fourth, etc. computing system. In one example, a first computing system can comprise a tracking module or tracking engine 1100, an instrument calibration module 1110, a headset calibration module 1120, an imaging and navigation module 1130, a AR wireless networking module 1140, and an AR visualization module 1150; a second computing system can comprise an AR display module 1160. In another example, a first computing system can comprise a tracking module or tracking engine 1100, an instrument calibration module 1110, a headset calibration module 1120, an imaging and navigation module 1130, and a AR wireless networking module 1140; a second computing system can comprise an AR visualization module 1150 and an AR display module 1160. In another example, a first and a second computing system can comprise one or more of the same modules, for example dedicated to the same and / or different functions. For example, a first computing system can comprise an AR wireless networking module 1140, for example for data transmission; a second computing system can also comprise an AR wireless networking module 1140, for example for data reception. In another example, a first computing system can comprise a tracking module or tracking engine 1100, an instrument calibration module 1110, an imaging and navigation module 1130, and an AR wireless networking module 1140; a second computing system can comprise a headset calibration module 1120, an AR wireless networking module 1140, an AR visualization module 1150 and an AR display module 1160. Any combination of same and / or different modules, including duplication of modules on different (first, second, third, fourth, fifth) computing systems is possible and within the scope of this disclosure. Using one or more computer processors, e.g. in a second computing system, the AR display 1160 module can generate the stereoscopic or non-stereoscopic view of a first person for the first person’s respective view angle in relationship to one or more anatomic landmarks or anatomic structures of a patient. Using one or more computer processors, e.g. in a third 80 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT computing system, the AR display 1160 module can generate the stereoscopic or non- stereoscopic view of a second person for the second person’s respective view angle in relationship to one or more anatomic landmarks or anatomic structures of the patient. Using one or more computer processors, e.g. in a fourth computing system, the AR display 1160 module can generate the stereoscopic or non-stereoscopic view of a third person for the third person’s respective view angle in relationship to one or more anatomic landmarks or anatomic structures of the patient. Using one or more computer processors, e.g. in a fifth computing system, the AR display 1160 module can generate the stereoscopic or non- stereoscopic view of a fourth person for the fourth’s person’s respective view angle in relationship to one or more anatomic landmarks or anatomic structures of the patient, etc.. The second, third, fourth, fifth or more computing systems can be the same. The second, third, fourth, fifth or more computing systems can be different, e.g. integrated or connected to different mobile units and / or different HMDs or other augmented reality display systems. A first, second, third, fourth, fifth or more computing systems can be the same. A first, second, third, fourth, fifth or more computing systems can be different. A first, second, third, fourth, fifth or more computer processors can be the same. A first, second, third, fourth, fifth or more computer processors can be different. A first, second, third, fourth, fifth or more computer processor can have the same processing speed. At least one of a first, second, third, fourth, fifth or more or more computer processor can have a different processing speed. For example, a computer processor can have a processing speed of 1GHz, 1.5GHz, 2.0GHz, 2.1GHz, 2.2GHz, 2.3GHz, 2.4GHz, 2.5GHz, 2.6GHz, 2.7GHz, 2.8GHz, 2.9Ghz, 3.0GHz or greater. Any value is possible. Some applications of the disclosure can benefit from higher processing speeds, e.g. above 1.5GHz or 2.0GHz, for example when data intense, complex data packets are being acquired, generated, transmitted and / or received (see Table 2 also). A computer processor can, for example, be a Qualcomm Snapdragon 845 or later (Qualcomm, San Diego, CA 92121). Unicast, Multicast, or Broadcast Transmission and / or Reception Unicast In some embodiments, data or data packets, e.g. as listed in Table 2, can be transmitted and / or received with unicast transmission and / or reception, for example between a first computing system or server and a second computing system or client; the second computing 81 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT system can be configured to generate the stereoscopic or non-stereoscopic 2D or 3D display 1160 by the HMD or other augmented reality display system. In some embodiments, a first unicast transmission can be transmitted from a first computing system and received by a second computing system, e.g. integrated into or connected to a first HMD or other augmented reality display system, with the first unicast transmission comprising the specific tracking information for the first HMD or other augmented reality display system and, optionally, instrument and / or surgical site tracking data. A second, third, fourth, fifth or more unicast transmission can be transmitted from a first computing system to a third, fourth, fifth, sixth or more computing system, e.g. integrated into or connected to a second, third, fourth, fifth or more HMD or other augmented reality display system, respectively. The second, third, fourth, fifth or more unicast transmission can be sequential, e.g. overlapping or non-overlapping. A second unicast transmission can be transmitted from a first computing system and received by a third computing system, e.g. integrated into or connected to a second HMD or other augmented reality display system, with the second unicast transmission comprising the specific tracking information for the second HMD or other augmented reality display system and, optionally, instrument and / or surgical site tracking data. A third unicast transmission can be transmitted from a first computing system and received by a fourth computing system, e.g. integrated into or connected to a third HMD or other augmented reality display system, with the third unicast transmission comprising the specific tracking information for the third HMD or other augmented reality display system and, optionally, instrument and / or surgical site tracking data. A fourth unicast transmission can be transmitted from a first computing system and received by a fifth computing system, e.g. integrated into or connected to a fourth HMD or other augmented reality display system, with the fourth unicast transmission comprising the specific tracking information for the fourth HMD or other augmented reality display system and, optionally, instrument and / or surgical site tracking data. A fifth unicast transmission can be transmitted from a first computing system and received by a sixth computing system, e.g. integrated into or connected to a fifth HMD or other augmented reality display system, with the fifth unicast transmission comprising the specific tracking information for the fifth HMD or other augmented reality display system and, optionally, instrument and / or surgical site tracking data. 82 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT Any number of unicast transmissions can be transmitted from a first computing system and received by a corresponding number of HMDs or other augmented reality display systems. If an overall transmission and reception rate of 30Hz, 40Hz, 50Hz, 60Hz, or 70Hz is desired, the sequential unicast transmissions can be completed within 0.0333 sec, 0.025 sec, 0.02 sec, 0.0166 sec, 0.01428 sec, or any other value. The next round of sequential unicast transmissions and / or receptions can then start in order to achieve near real-time or real-time transmission and / or reception of specific tracking information for the different headsets, along with, optionally, instrument tracking and / or patient tracking data for stereoscopic and / or non-stereoscopic display of instrument and / or patient data by the one or more HMDs or other augmented reality display systems. Multicast, Broadcast In some embodiments, data or data packets, e.g. as listed in Table 2, can be transmitted and / or received with multicast transmission and / or reception, for example between a first computing system or server and multiple clients, e.g. a second computing system, third computing system, fourth computing system, fifth computing system, etc., optionally each with one or more computer processors; the second computing system, third computing system, fourth computing system, fifth computing system, etc. can be configured to generate the stereoscopic or non-stereoscopic 2D or 3D display 1160 by the corresponding first, second, third, and fourth etc. HMDs or other augmented reality display systems. In some embodiments, data or data packets, e.g. as listed in Table 2, can be transmitted and / or received with broadcast transmission and / or reception, for example between a first computing system or server and multiple clients (for example all available clients), e.g. a second computing system, third computing system, fourth computing system, fifth computing system, etc., optionally each with one or more computer processors; the second computing system, third computing system, fourth computing system, fifth computing system, etc. can be configured to generate the stereoscopic or non-stereoscopic 2D or 3D display 1160 by the corresponding first, second, third, and fourth etc. HMDs or other augmented reality display systems. With multicast or broadcast transmission and / or reception, the position, orientation, position and orientation, direction of movement and / or tracking data for each HMD or other augmented reality display system can be labelled for each HMD or other augmented reality display system, e.g. corresponding to the HMD or other augmented reality display system 83 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT number, for example label “1” for the first HMD or other augmented reality display system, label “2” for the second HMD or other augmented reality display system, label “3” for the third HMD or other augmented reality display system, label “4” for the fourth HMD or other augmented reality display system, label “5” for the fifth HMD or other augmented reality display system, etc.. The second computing system, third computing system, fourth computing system, fifth computing system, etc. can be configured to generate the stereoscopic or non-stereoscopic 2D or 3D display 1160 for the corresponding first, second, third, and fourth etc. HMDs or other augmented reality display systems based on the labels corresponding to each HMD or other augmented reality display system and tracking data for each respective HMD or other augmented reality display system. For example, the second computing system can identify the label for the first HMD or other augmented reality display system, e.g. “1”, in the received data and generate the stereoscopic or non-stereoscopic 2D or 3D display for the first HMD or other augmented reality display system using the HMD or other augmented reality display system tracking data labeled for the first HMD or other augmented reality display system; the third computing system can identify the label for the second HMD or other augmented reality display system, e.g. “2”, in the received data and generate the stereoscopic or non-stereoscopic 2D or 3D display for the second HMD or other augmented reality display system using the HMD or other augmented reality display system tracking data labeled for the second HMD or other augmented reality display system; the fourth computing system can identify the label for the third HMD or other augmented reality display system, e.g. “3”, in the received data and generate the stereoscopic or non- stereoscopic 2D or 3D display for the third HMD or other augmented reality display system using the HMD or other augmented reality display system tracking data labeled for the third HMD or other augmented reality display system; the fifth computing system can identify the label for the fourth HMD or other augmented reality display system, e.g. “4”, in the received data and generate the stereoscopic or non-stereoscopic 2D or 3D display for the fourth HMD or other augmented reality display system using the HMD or other augmented reality display system tracking data labeled for the fourth HMD or other augmented reality display system; and so forth for any number of HMDs or other augmented reality display systems used. In this manner, each client or second, third, fourth, fifth etc. computing system, optionally with one or more computer processors, can generate the stereoscopic or non-stereoscopic 2D or 3D display or augmented view for each HMD or other augmented reality display system with the 84 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT correct view angle and viewing perspective for each specific HMD or other augmented reality display system, for example in relationship to one or more tracked anatomic structures of the patient and / or one or more tracked physical tools, instruments and / or implants and / or one or more markers attached to a patient, e.g. a fiducial array attached to a bone. For example, each client or second, third, fourth, fifth etc. computing system, optionally with one or more computer processors, can generate the stereoscopic or non-stereoscopic 2D or 3D display for each HMD or other augmented reality display system with the correct view angle and viewing perspective for each specific HMD or other augmented reality display system for a virtual display, e.g. a virtual user interface or display of one or more interactions of a tracked physical surgical tool or instrument with a virtual user interface, for example in relationship to one or more tracked anatomic structures of the patient and / or one or more tracked physical tools, instruments and / or implants and / or one or more markers attached to a patient, e.g. a fiducial array attached to a bone. In this manner, a display of a virtual user interface or of one or more interactions therewith can, for example, be displayed in the display plane of the physical HMD unit, e.g. a waveguide display or mirror based display. In this manner, for example, a display of a virtual user interface or of one or more interactions therewith can be displayed in a predetermined display plane for a first, second, third, fourth, fifth and / or sixth HMDs, for example a display plane substantially parallel to the user’s retina or a display plane substantially perpendicular to one or more pupillary axes of the user’s eyes. In other embodiments, a display of a virtual user interface or of one or more interactions therewith can be displayed in a predetermined position and / or orientation for a first, second, third, fourth, fifth and / or sixth HMDs, for example a display plane at a predetermined position and / or orientation in relationship to a patient, a surgical site, one or more markers attached to the patient, e.g. a fiducial array attached to a bone, one or more markers attached to a structure in an operating room, e.g. an OR table, OR light etc. Network of HMD or other augmented reality display system systems In some embodiments, a network of HMDs or other augmented reality display systems can be used. One or more HMDs or other augmented reality display systems can comprise at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to the HMD or other augmented reality display system. The at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to the one or more HMDs or other augmented reality 85 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT display systems can be used to generate coordinate and / or tracking information of one or more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more robot (e.g. a robot with a robotic arm, a handheld robot, or a combination thereof) or a combination thereof. Two or more of the HMDs or other augmented reality display systems can optionally interconnect and create a network, e.g. for a shared experience of the augmented views and / or for multi-directional generation of coordinate information and / or tracking information. The use of multi-directional generation of coordinate information and / or tracking information can be helpful to reduce or avoid line of sight issues. For example, when the line of sight is blocked for a first camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to a first HMD, the line of sight can be intact or maintained for a second, third, fourth, fifth, etc. or combination thereof camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to a first, second, third, fourth of fifth, etc. HMD. The HMDs or other augmented reality display systems can be organized in a client-server network where multiple HMD clients can centralized around a single server, e.g. a first computing unit. Thus, HMD devices can be relieved of computing power when outsourcing tasks which are computational intensive (image processing) to the server. Moreover, battery life of the HMD’s can be significantly prolonged which can make th approach attractive even in case of a single HMD client. The server can be accessible in the OR. In case of multiple clients, different data inputs from the various perspectives (e.g. from a first, second, third, fourth, fifth etc. HMD) can be used by the server to increase the accuracy of the calculations (e.g. by averaging out errors). In some embodiments, coordinate information and / or tracking information, e.g. from spatial maps from two or more HMD clients, can be obtained and processed by the server. For example, spatial maps can consist of triangular meshes built from each HMD’s depth sensor information. Once spatial maps have been transferred from a first, second, third, fourth, fifth or combination there of HMD to the server, the different meshes can be combined into a combined, more accurate mesh using, for example, an averaging algorithm: For example, the data from a first HMD can be used as the baseline. From each face in the baseline mesh, a ray can be cast along the surface normal of the face. Intersection points between the ray and all other meshes can be 86 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT calculated. A new vertex for the combined mesh can be derived as the average of all intersection points along the ray. The new vertices from adjacent triangles in the baseline mesh can be connected to form the faces in the combined mesh. The combined mesh can then be transferred back to the individual HMD’s for refinement of the registration, corrdinate or tracking information and / or for refinement of the real-time or near real-time updating of the stereoscopic or non-stereoscopic HMD display, e.g. superimposed and / or aligned with an anatomic structure or anatomic landmark of a patient. In some embodiments, once coordinate information, registration information, tracking information, surface information, e.g. of one or more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more robot or a combination thereof has been obtained using at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to the HMDs or other augmented reality display systems and the information has been transferred from a first, second, third, fourth, fifth or combination there of HMD to the server, the data generated by the at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to the two or more HMDs or other augmented reality display systems can be combined, e.g. into a combined, more accurate surface or surface mesh using, for example, an averaging algorithm. Optionally, a weighting can be applied to the data transferred by different HMDs or other augmented reality display systems, e.g. with a higher weight for HMDs or other augmented reality display systems located closer to the patient and / or closer to the at least one camera, scanner, 3D scanner, LIDAR system, depth sensor, IMU or a combination thereof. Intrinsic and / or Extrinsic Tracking of Surgical Robots In some embodiments, surgical robots can comprise a robotic arm, a handheld robot, handheld portions, or a combination thereof. In some embodiments, surgical robots can comprise one or more sensor, camera, video system, scanner, e.g. 3D scanner, LIDAR system, depth sensor, controller, electric controller, mechanical controller, drive, actuator, end effector, attachment mechanism, potentiometer, inertial measurement unit, accelerometer, magnetometer, gyroscope, force sensor, pressure sensor, position sensor, orientation sensor, motion sensor, wire, step motor, electric motors, hydraulic motor, electric and / or mechanical actuator, switch, display unit, computer processor, or a combination thereof. 87 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, coordinate information, tracking data or a combination thereof of one or more end effectors, physical tools or instruments integrated or attached to a or part of a robot and / or of one or more physical implants, physical implant components, or physical trial implants attached to a robot can be generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or a combination thereof of the robot or one or more robot components, for example obtained using intrinsic or internal data generated by or including intrinsic or internal, integrated or attached sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from robot step motors, position and / or orientation feedback from robot electric motors, position and / or orientation feedback from robot hydraulic motors, position and / or orientation feedback from robot electric and / or mechanical actuators, position and / or orientation feedback from robot drives, position and / or orientation feedback from robotic controllers, position and / or orientation feedback from one or more robotic computer processors, or a combination thereof. If one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof is used for generating intrinsic or internal robot data, the data can optionally be corrected for any distance and / or angular offset between the one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof and an end effector, a surgical tool or instrument attached to or integrated into or part of the robot, e.g. a cutting tool, tissue removal tool (e.g. a drill, saw, reamer, impactor), or an ablation tool. Alternatively and / or additionally, If one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof is used for generating intrinsic or internal robot data, the data can optionally be corrected for any distance and / or angular offset between the one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof and an anatomic structure, surface and / or landmark of a patient. Any combination of offset, e.g. distance and / or angle, correction is possible. In some embodiments, one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors external to a robot (e.g. on a stand, in an OR light and / or one or more HMDs or other 88 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT augmented reality display systems) can be used for determining the distance and / or angle offset. In some embodiments, coordinate information, tracking data or a combination thereof of one or more end effectors, physical tools or instruments integrated or attached to or part of a robot and / or of one or more physical implants, physical implant components, or physical trial implants attached to a robot can be obtained or generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof extrinsic or external to the robot and, for example, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system (e.g. x-ray, cone beam CT, CT)), or a combination thereof. One or more computer processors can be configured, for example, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof extrinsic or external to the robot, to determine the position, orientation, direction of movement, one or more coordinates, or combination thereof of at least a portion of the one or more end effectors, physical surgical tools, at least a portion of the robot, or a combination thereof (e.g. using image processing and / or pattern recognition and / or an artificial neural network) or of one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more end effectors, physical tools or instruments, integrated or attached to at least portions of the robot, or a combination thereof (extrinsic or external data). In some embodiments, one or more displays by one or more computer monitors or by one or more HMDs or other augmented reality display systems can be generated, wherein the display can be non-stereoscopic (e.g. by the computer monitor, other augmented reality display device(s) and / or the HMD) or stereoscopic (e.g. by the HMD). In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide) and / or one or more patient surface(s) using intrinsic or internal robot data, e.g. registration data, coordinate data, and / or tracking data of one or 89 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more robot, or a combination thereof. In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide) and / or one or more patient surface(s) using extrinsic or external robot data, e.g. registration data, coordinate data, and / or tracking data of end effectors, one or more physical surgical tools, one or more physical surgical instruments, one or more robot, or a combination thereof. In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide) and / or one or more patient surface(s) using intrinsic or internal and extrinsic or external robot data, e.g. registration data, coordinate data, and / or tracking data of one or more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more robot, or a combination thereof. In this example, intrinsic and or internal robot data can, optionally, be displayed using a different color or display pattern than extrinsic or external robot data, thereby highlighting potential differences and / or deviations. In some embodiments, one or more computer processors can be used to compute any differences and / or deviations between intrinsic or internal and extrinsic or external robot data, e.g. a difference in a projected instrument or tool path, e.g. a drill path, a saw path, a difference in a planned or executed tissue resection. One or more computer processors can be configured to generate a difference display, for example by a computer monitor and / or one or more HMDs or other augmented reality display systems, e.g. using color coding, line or bar charts or any other chart known in the art, and / or alphanumeric display. The difference between intrinsic or internal and extrinsic or external robot data, e.g. registration data, coordinate data, and / or tracking data of one or more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more robot, or a combination thereof can be used to highlight any potential deviation of a robot from a 90 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT predetermined plan, e.g. a predetermined tissue resection (for example a predetermined tissue resection volume, tissue resection area, tissue resection surface, bone cut, drilling, reaming, milling, impacting). Intrinsic and / or Extrinsic Tracking of Imaging Systems and Imaging System Components or External Beam Radiation Systems In some embodiments, an imaging system or an external beam radiation system can comprise one or more imaging system or external beam radiation system components. In some embodiments, one or more imaging system or external beam radiation system components can comprise one or more sensor, camera, video system, scanner, e.g. 3D scanner, LIDAR system, depth sensor, controller, electric controller, mechanical controller, drive, actuator, end effector, attachment mechanism, potentiometer, inertial measurement unit, accelerometer, magnetometer, gyroscope, force sensor, pressure sensor, position sensor, orientation sensor, motion sensor, wire, step motor, electric motors, hydraulic motor, electric and / or mechanical actuator, switch, display unit, computer processor, or a combination thereof. In some embodiments, coordinate information, tracking data or a combination thereof of one or more imaging system or external beam radiation system components can be generated with use of pose data, sensor data, camera data, 3D scanner data, controller data, drive data, actuator data, end effector data or a combination thereof of the one or more imaging system or external beam radiation system components, for example obtained using intrinsic or internal data generated by or including intrinsic or internal, integrated or attached sensors, potentiometers, cameras, video systems, 3D scanners, LIDAR systems, depth sensors, inertial measurement units, accelerometers, magnetometers, gyroscopes, force sensors, pressure sensors, position sensors, orientation sensors, motion sensors, position and / or orientation feedback from imaging system or external beam radiation system component step motors, position and / or orientation feedback from imaging system or external beam radiation system component electric motors, position and / or orientation feedback from imaging system or external beam radiation system component hydraulic motors, position and / or orientation feedback from system component electric and / or mechanical actuators, position and / or orientation feedback from imaging system or external beam radiation system component drives, position and / or orientation feedback from imaging system or external beam radiation system component controllers, position and / or orientation feedback from imaging system or 91 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT external beam radiation system component computer processors, or a combination thereof. If one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof is used for generating intrinsic or internal imaging system or external beam radiation system component data, the data can optionally be corrected for any distance and / or angular offset between the one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof and one or more imaging system or external beam radiation system components. Alternatively and / or additionally, If one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof is used for generating intrinsic or internal imaging system or external beam radiation system component data, the data can optionally be corrected for any distance and / or angular offset between the one or more integrated or attached cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or a combination thereof and an anatomic structure, surface and / or landmark of a patient. Any combination of offset, e.g. distance and / or angle, correction is possible. In some embodiments, one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors external to one or more imaging system or external beam radiation system components (e.g. on a stand, in an OR light and / or one or more HMDs or other augmented reality display systems) can be used for determining the distance and / or angle offset. In some embodiments, coordinate information, tracking data or a combination thereof of one or more imaging system or external beam radiation system components can be obtained or generated with use of one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof extrinsic or external to the imaging system or external beam radiation system components and, for example, integrated or attached to one or more HMDs or other augmented reality display systems, separate from one or more HMDs or other augmented reality display systems (e.g. on a stand, tripod, attached to or integrated into OR lighting, OR fixtures, an imaging system (e.g. x-ray, cone beam CT, CT)), or a combination thereof. One or more computer processors can be configured, for example, using the one or more cameras, video systems, 3D scanners, LIDAR systems, depth sensors, or combination thereof extrinsic or external to the one or more imaging system or an external beam radiation system components, to determine the position, orientation, direction of movement, one or more coordinates, or combination thereof of at least a portion of the one or more imaging 92 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT system or an external beam radiation system components (e.g. using image processing and / or pattern recognition and / or an artificial neural network) or of one or more markers, e.g. active markers (e.g. RF markers), passive markers (e.g. infrared markers), optical markers (e.g. with geometric patterns, QR codes, bar codes, defined shapes, e.g. triangles, squares, rectangles etc.), LEDs or a combination thereof integrated or attached to the one or more imaging system or an external beam radiation system components (extrinsic or external data). In some embodiments, one or more displays by one or more computer monitors or by one or more HMDs or other augmented reality display systems can be generated, wherein the display can be non-stereoscopic (e.g. by the computer monitor, other augmented reality display device(s) and / or the HMD) or stereoscopic (e.g. by the HMD). In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide), one or more pre-operative or intra-operative imaging data and / or one or more patient surface(s) using intrinsic or internal imaging system or an external beam radiation system data, e.g. registration data, coordinate data, and / or tracking data of one or more imaging system or an external beam radiation system components. In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide) one or more pre-operative or intra-operative imaging data and / or one or more patient surface(s) using extrinsic or external tracking data, e.g. registration data, coordinate data, and / or tracking data of one or more HMDs or other augmented reality display systems, a patient, an anatomic structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more imaging system or an external beam radiation system components, or a combination thereof. In some embodiments, one or more computer processors can generate a display, e.g. by a computer monitor and / or one or more HMDs or other augmented reality display systems, of virtual data, e.g. a virtual surgical plan, one or more virtual surgical guides (e.g. a virtual axis, virtual plane, virtual gut guide) and / or one or more patient surface(s) using intrinsic or internal and extrinsic or external data, e.g. registration data, coordinate data, and / or tracking data of one or more HMDs or other augmented reality display systems, a patient, an anatomic 93 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT structure of a patient, one or more physical surgical tools, one or more physical surgical instruments, one or more imaging system or an external beam radiation system components, or a combination thereof. In this example, intrinsic and or internal imaging system or an external beam radiation system data can, optionally, be displayed using a different color or display pattern than extrinsic or external imaging system or an external beam radiation system data, thereby highlighting potential differences and / or deviations. In some embodiments, one or more computer processors can be used to compute any differences and / or deviations between intrinsic or internal and extrinsic or external imaging system or an external beam radiation system data. One or more computer processors can be configured to generate a difference display, for example by a computer monitor and / or one or more HMDs or other augmented reality display systems, e.g. using color coding, line or bar charts or any other chart known in the art, and / or alphanumeric display. Aspects of the disclosure relate to a system comprising at least one head mounted display or other augmented reality display device, at least one camera or scanning device, a first computing system comprising one or more computer processors and a second computing system comprising one or more computer processors, wherein the first computing system is configured to obtain real-time tracking information of the at least one head mounted display or other augmented reality display device, of at least one anatomic structure of a patient, and of at least one physical surgical tool or physical surgical instrument using the at least one camera or scanning device, wherein the first computing system is configured for wireless transmission of the real-time tracking information of the at least one head mounted display or other augmented reality display device, the at least one anatomic structure of the patient, and the at least one physical surgical tool or physical surgical instrument, wherein the second computing system is connected to or integrated into the at least one head mounted display or other augmented reality display device, wherein the second computing system is configured for wireless reception of the real-time tracking information of the at least one head mounted display or other augmented reality display device, the at least one anatomic structure of the patient, and the at least one physical surgical tool or physical surgical instrument, and 94 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT wherein the second computing system is configured to generate a 3D stereoscopic view, wherein the stereoscopic view comprises a 3D representation of the at least one physical surgical tool or physical surgical instrument. In some embodiments, the one or more computer processors of the second computing system generate the 3D stereoscopic view for the view angle of the head mounted display or other augmented reality display device relative to the at least one anatomic structure of the patient using the real-time tracking information of the at least one head mounted display or other augmented reality display device. In some embodiments, the real-time tracking information comprises tracking information of two or more head mounted display or other augmented reality display devices. In some embodiments, the real-time tracking information comprises a head mounted display or other augmented reality display device specific label for each head mounted display or other augmented reality display device. In some embodiments, the real-time tracking information is labeled for each tracked head mounted display or other augmented reality display device. In some embodiments, the real-time tracking information comprises tracking information of two or more head mounted display or other augmented reality display devices. In some embodiments, the two or more head mounted display or other augmented reality display devices are located in different locations. In some embodiments, the real-time tracking information comprises a head mounted display or other augmented reality display device specific label for each head mounted display or other augmented reality display device. In some embodiments, the real-time tracking information is labeled for each tracked head mounted display or other augmented reality display device. In some embodiments, the one or more computer processors of the second computing system generate the 3D stereoscopic view for an interpupillary distance adjusted for a person wearing the head mounted display or other augmented reality display device. In some embodiments, the second computing system is integrated with the at least one head mounted display or other augmented reality display device. In some embodiments, the second computing system is separate from the at least one head mounted display or other augmented reality display device and is connected to the display unit of the at least one head mounted display or other augmented reality display device using at least one cable. 95 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the wireless transmission or reception or transmission and reception comprises a WiFi signal, a LiFi signal, a Bluetooth signal or a combination thereof. In some embodiments, the camera or scanning device is separate from the at least one head mounted display or other augmented reality display device. In some embodiments, the camera or scanning device is integrated or attached to the at least one head mounted display or other augmented reality display device. In some embodiments, the wireless transmission comprises sending data packets comprising the real-time tracking information of the at least one head mounted display or other augmented reality display device, the at least one anatomic structure of a patient, and the at least one physical surgical tool or physical surgical instrument, at a rate of 20 Hz or greater. In some embodiments, the wireless reception comprises receiving data packets comprising the real-time tracking information of the at least one head mounted display or other augmented reality display device, the at least one anatomic structure of a patient, and the at least one physical surgical tool or physical surgical instrument, at a rate of 20 Hz or greater. In some embodiments, the system comprising a third computing system, wherein the third computing system is configured for wireless reception of the real-time tracking information from the first computing system and wherein the third computing system is configured for wireless transmission of the real-time tracking information to the second computing system. In some embodiments, the third computing system comprises a chain of computing systems configured for wireless reception and wireless transmission of the real-time tracking information. In some embodiments, the system comprises a third computing system, wherein the third computing system is connected to or integrated into a second head mounted display or other augmented reality display device, wherein the third computing system is configured for wireless reception of the real-time tracking information of the second head mounted display or other augmented reality display device, the at least one anatomic structure of a patient, and the at least one physical surgical tool or physical surgical instrument, wherein the third computing system is configured to generate a 3D stereoscopic view by the second head mounted display or other augmented reality display device using the tracking information of the second head mounted display or other augmented reality display device. In some embodiments, the tracking information of the second head mounted comprises a label specific to the second head mounted display or other augmented reality display device 96 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT for identifying the tracking information of the second head mounted display or other augmented reality display device by the third computing system. In some embodiments, the system comprising a fourth computing system, wherein the fourth computing system is connected to or integrated into a third head mounted display or other augmented reality display device, wherein the fourth computing system is configured for wireless reception of the real-time tracking information of the third head mounted display or other augmented reality display device, the at least one anatomic structure of a patient, and the at least one physical surgical tool or physical surgical instrument, and wherein the fourth computing system is configured to generate a 3D stereoscopic view by the third head mounted display or other augmented reality display device using the tracking information of the third head mounted display or other augmented reality display device. In some embodiments, the tracking information of the third head mounted comprises a label specific to the third head mounted display or other augmented reality display device for identifying the tracking information of the third head mounted display or other augmented reality display device by the fourth computing system. In some embodiments, the system comprises a fifth computing system, wherein the fifth computing system is connected to or integrated into a fourth head mounted display or other augmented reality display device, wherein the fifth computing system is configured for wireless reception of the real-time tracking information of the fourth head mounted display or other augmented reality display device, the at least one anatomic structure of a patient, and the at least one physical surgical tool or physical surgical instrument, and wherein the fifth computing system is configured to generate a 3D stereoscopic view by the fourth head mounted display or other augmented reality display device using the tracking information of the fourth head mounted display or other augmented reality display device. In some embodiments, the tracking information of the fourth head mounted comprises a label specific to the fourth head mounted display or other augmented reality display device for identifying the tracking information of the fourth head mounted display or other augmented reality display device by the fifth computing system. In some embodiments, the real-time tracking information comprises one or more coordinates. In some embodiments, the one or more coordinates comprise coordinates of the at least one anatomic structure of the patient. 97 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, the one or more coordinates comprise coordinates of the at least one physical surgical tool or physical surgical instrument. In some embodiments, the one or more coordinates comprise coordinates of the at least one head mounted display or other augmented reality display device. In some embodiments, the at least one head mounted display or other augmented reality display device comprises at least one optical see-through head mounted display or other augmented reality display device. In some embodiments, the at least one head mounted display or other augmented reality display device comprises at least one video see-through head mounted display or other augmented reality display device. In some embodiments, the at least one camera, the at least one scanning device or the at least one camera and the at least one scanning device comprises a laser scanner, a time-of- flight 3D laser scanner, a structured-light 3D scanner, a hand-held laser scanner, a LIDAR scanner, a time-of-flight camera, a depth camera , a video system, a stereoscopic camera system, a camera array, or a combination thereof. In some embodiments, the system comprises at least one inertial measurement unit. In some embodiments, the at least one inertial measurement unit is integrated or attached to the at least one physical surgical tool or physical surgical instrument. In some embodiments, the at least one inertial measurement unit is integrated or attached to the at least one anatomic structure of the patient. In some embodiments, the at least one inertial measurement unit is integrated or attached to the at least one head mounted display or other augmented reality display device. In some embodiments, the real-time tracking information of the at least one head mounted display or other augmented reality display device comprises information from the at least one inertial measurement unit. Aspects of the disclosure relate to a system comprising two or more head mounted display or other augmented reality display devices, at least one camera or scanning device, a first computing system comprising one or more computer processors, wherein the first computing system is configured to obtain real-time tracking information of at least one anatomic structure of a patient, of at least one physical surgical tool or physical surgical instrument, and of the two or more head mounted display or other augmented reality display devices, using the at least one camera or scanning device, 98 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT wherein the tracking information of the two or more head mounted display or other augmented reality display devices is labeled specific for each head mounted display or other augmented reality display device, wherein the first computing system is configured for wireless transmission of the real-time tracking information of the at least one anatomic structure of the patient, the tracking information of the at least one physical surgical tool or physical surgical instrument, and the labeled tracking information of the two or more head mounted display or other augmented reality display devices, a second computing system, wherein the second computing system is connected to or integrated into a first of the two or more head mounted display or other augmented reality display devices, wherein the second computing system is configured for wireless reception of the real-time tracking information of the at least one anatomic structure of the patient, the tracking information of the at least one physical surgical tool or physical surgical instrument, and the labeled tracking information of the first of the two or more head mounted display or other augmented reality display devices, wherein the second computing system is configured to generate a 3D stereoscopic display specific for the viewing perspective of the first head mounted display or other augmented reality display device using the labeled tracking information of the first head mounted display or other augmented reality display device, a third computing system, wherein the third computing system is connected to or integrated into a second of the two or more head mounted display or other augmented reality display devices, wherein the third computing system is configured for wireless reception of the real-time tracking information of the at least one anatomic structure of the patient, the tracking information of the at least one physical surgical tool or physical surgical instrument, and the labeled tracking information of the second of the two or more head mounted display or other augmented reality display devices, wherein the third computing system is configured to generate a 3D stereoscopic display specific for the viewing perspective of the second head mounted display or other augmented reality display device using the labeled tracking information of the second head mounted display or other augmented reality display device, 99 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT wherein the stereoscopic view comprises a 3D representation of the at least one physical surgical tool or physical surgical instrument. Virtual user interface In some embodiments, a physical tool or instrument (see Table 2), e.g. a tracked pointer, a tracked stylus, a tracked tool, a tracked instrument or a combination thereof, can be used for interacting with a virtual interface display by an HMD. Any tracking technique known in the art can be used, e.g. inside-out tracking, outside-in tracking or a combination thereof, as described, for example in PCT International Application Serial Nos. PCT / US2017 / 021859, PCT / US2018 / 013774, PCT / US2019 / 61698 and PCT / US2019 / 015522, which are hereby incorporated in their entirety. A tracked pointer, a tracked stylus, or another tracked tool or tracked instrument or a combination thereof can comprise one or more markers. In some embodiments, the marker can be configured to reflect or emit light with a wavelength between 380nm and 700nm or any value or range or subrange therebetween. In some embodiments, the marker can be configured to reflect or emit light with a wavelength greater than 700nm. For example, the marker can be configured to reflect or emit light with a wavelength between 700 nm and 1 mm or any value or range or subrange therebetween. In some embodiments, the marker can be configured to reflect or emit light with a wavelength less than 380nm. For example, the marker can be configured to reflect or emit light with a wavelength between 50 nm and 380 nm or any value or range or subrange therebetween. In some embodiments, the marker can be a radiofrequency marker, e.g. an active marker, an infrared marker, e.g. a retroreflective or passive marker. The marker can be an optical marker, e.g. an optical marker that comprises a geometric pattern. One, two or more markers can be attached to or integrated into a tracked pointer, a tracked stylus, other tracked tool, other tracked instrument or a combination thereof. A tracked pointer, a tracked stylus, other tracked tool, other tracked instrument or a combination thereof can also comprise one or more integrated or attached IMUs. In some embodiments, the system comprises at least one camera, scanner (e.g.3D scanner, laser scanner), LIDAR system, depth sensor, IMU or a combination thereof integrated into or attached to the head mounted display or other augmented reality display device. In some embodiments, at least one camera, scanner (e.g. 3D scanner, laser scanner), LIDAR system, depth sensor, IMU or a combination thereof can be separate from the head mounted display 100 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT or other augmented reality display device. The at least one camera, scanner (e.g.3D scanner, laser scanner), LIDAR system, depth sensor, IMU or a combination thereof integrated or attached to the one or more HMDs or other augmented reality display systems and / or separate from the one or more HMDs or other augmented reality display systems can be configured to scan and / or detect a pointer, stylus, tool, instrument or a combination thereof; the pointer, stylus, tool, instrument or a combination thereof can be tracked in 3D space, e.g. as they are being moved by a user. The tracking can be direct, e.g. by directly recognizing the instrument, for example utilizing a stored shape, surface, and / or 2D or 3D outline data of the pointer, stylus, tool, instrument or combination thereof or a library of shapes, surfaces, and / or 2D or 3D outline data of one or more pointer, stylus, tool, instrument or combination thereof, using one or more computer processors. Direct tracking of tool and / or instrument for interaction with virtual interface One or more computer processors can be configured to detect a physical tool or instrument, e.g. a tracked pointer, a tracked stylus, other tracked tool or tracked instrument, or a combination thereof, using a camera and / or scanner (e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system or an external beam radiation system etc.), e.g. in the image or scanner data, and, optionally, follow and / or track the pointer, stylus, tool, instrument, or combination thereof in real-time or near real-time, for example within the 3D space included in the image or scanner data. The one or more camera and / or scanner (e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system or an external beam radiation system etc.) can be integrated into or attached to one or more HMD units or can be separate from one or more HMD units or a combination thereof. Optionally, a pointer, stylus, tool, instrument, or combination thereof included in the image or scanner data can be compared against a database or library of stored shapes, surfaces, and / or 2D or 3D outline data of one or more (optionally different) pointer(s), stylus(s), other tool(s), other instrument(s) or combination thereof and can be identified using the database of stored shapes, surfaces, and / or 2D or 3D outline data of the one or more (optionally different) pointer(s), stylus(s), other tool(s), other instrument(s) or combination thereof. Identification of the pointer, stylus, tool, instrument, or combination thereof included in the image or scanner data can, optionally, facilitate tracking of the pointer, stylus, tool, instrument or combination thereof. The database can also comprise information about one or more optical markers, fiducials, fiducial arrays, and / or marker or array configurations. 101 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT In some embodiments, a pointer, a surgical tool or instrument can comprise a unique marker, fiducial array or marker / array configuration. In this manner, one or more computer processors can be configured to detect and / or identify the unique marker, fiducial array or marker / array configuration associated with that pointer, surgical tool or instrument. If a pointer, tool or instrument has been identified by at least one computer processor using any of the foregoing techniques, the at least one computer processor can associate and / or activate and / or display certain functions, e.g. display functions and / or system functions associated with that tool. For example, if a pointer has been identified by the at least one computer processor, e.g. based on identification of its unique shape (e.g. relative to a database of tool shapes) or based on identification of a unique marker, fiducial array or marker / array configuration, the identification by the at least one computer processor can trigger or initiate a specific function. For example, during set-up of an augmented reality system for a surgical procedure, a calibration procedure can be activated. When a pointer (or other tool or instrument) is identified the system can, for example, automatically display, by an HMD or other augmented reality device, a virtual object, e.g. one associated with the calibration procedure. In this example of an AR display calibration, the virtual object can be moved by moving the tracked physical pointer. The movement of the virtual object can be corresponding to the movement of the tracked physical pointer, or it can be at a different movement ratio between movement of the virtual object and movement of the tracked physical pointer, e.g. 1:1, 1.5:1, 2.0:1, 0.5:1.0, or any other ratio, for example expressed in mm, cm, and / or angular degrees. By moving the tracked physical pointer so that the virtual object, e.g. a virtual marker ball, is superimposed and / or aligned with a corresponding physical object, e.g. a physical marker ball, the system can determine the coordinate difference and / or coordinate transfer and / or distance, angular movement required to superimpose the virtual object onto the physical object; the information can be used to move a virtual display, facilitated by at least one computer processor, as a means of optimizing the superimposition and / or alignment for a user between virtual display of any virtual objects (e.g. a virtual spine and / or virtual instrument and / or virtual implant) and the corresponding physical objects and / or structures (e.g. a corresponding physical spine and / or a corresponding physical instrument and / or a corresponding physical implant). The data / information related to the coordinate difference and / or coordinate transfer and / or distance and / or angular movement required to 102 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT superimpose a virtual object onto a corresponding physical object can be used, by the at least one computer processor, as a means of AR system calibration to more closely match a virtual AR display, axis of an AR display, center of an AR display with the optical axis of the user’s eye(s). The data can optionally be wirelessly transmitted and / or received by a first computing system (e.g. communicably connected to a navigation system, a robot, and / or an imaging system or an external beam radiation system) and a second (or more) computing system(s) (communicably connected to one or more HMDs or other augmented reality display devices). In another example, a system can detect another unique marker, fiducial array or marker / array configuration associated, for example, with another instrument, e.g. an awl. The identification of the unique marker, fiducial array or marker / array configuration associated with the awl can trigger a display, by an HMD or other augmented reality display device, of a targeting tool for targeting the awl, e.g. superimposed onto a target anatomic structure of the patient. One or more computer processors can be configured to detect and / or identify the tip and / or axis and / or direction of movement of a pointer, stylus, tool, instrument or combination thereof, for example by detecting a shape, contour and / or outline, optional identification of the stylus, tool, instrument or combination thereof used, and optional use of known shape data and / or dimensions of the stylus, tool, instrument or combination thereof. The one or more computer processors configured to detect a pointer, stylus, other tool, other instrument, or combination thereof using a camera and / or scanner, e.g. in the image or scanner data, and, optionally, configured to follow and / or track the pointer, stylus, other tool, other instrument, or combination thereof in real-time or near real-time can be part of a first computing system, for example, a server or controller or computing unit as shown in FIG.1, 1180. The one or more computer processors configured to detect a pointer, stylus, other tool, other instrument, or combination thereof using a camera and / or scanner, e.g. in the image or scanner data, and, optionally, configured to follow and / or track the pointer, stylus, other tool, other instrument, or combination thereof in real-time or near real-time can be part of a second computing system, e.g. a client or mobile unit integrated into, attached to or connected via cable to an HMD. Inside-out and / or outside-in tracking techniques can be used by one or more computer processors for tracking a pointer, stylus, other tool, other instrument, or combination thereof using a camera and / or scanner. Tracking of tool and / or instrument using markers for interaction with virtual interface 103 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT One or more computer processors can be configured to detect one or more markers integrated or attached to one or more physical tool or instrument, e.g. a tracked pointer, a tracked stylus, other tracked tool or tracked instrument, or a combination thereof, using a camera and / or scanner, e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system or an external beam radiation system etc., and, optionally, follow and / or track the one or more pointer, stylus, tool, or instrument in real-time or near real- time, using the one or more markers. The one or more camera and / or scanner (e.g. a video camera, infrared camera, 3D scanner, laser scanner, LIDAR, imaging system or an external beam radiation system etc.) can be integrated into or attached to one or more HMD units or can be separate from one or more HMD units or a combination thereof. One or more computer processors can be configured to detect and / or identify the tip and / or axis and / or direction of movement of a pointer, stylus, other tool, other instrument or combination thereof, using one or more integrated or attached markers. The one or more computer processors configured to detect and / or track one or more markers integrated or attached to one or more pointer, stylus, other tool, other instrument, or combination thereof, using a camera and / or scanner in real-time or near real-time can be part of a first computing system, for example, a server or controller or computing unit as shown in FIG.1, 1180. The one or more computer processors configured to detect and / or track one or more markers integrated or attached to one or more pointer, stylus, other tool, other instrument, or combination thereof, using a camera and / or scanner in real-time or near real- time can be part of a second computing system, e.g. a client or mobile unit integrated into, attached to or connected via cable to an HMD. Inside-out and / or outside-in tracking techniques can be used by one or more computer processors for tracking one or more markers integrated into or attached to a pointer, stylus, tool, instrument, or combination thereof using a camera and / or scanner. The markers can be any of the markers described in the specification or known in the art, e.g. active markers, passive markers, infrared markers, retroreflective markers, radiofrequency markers, optical markers, e.g. with geometric patterns, bar codes, QR codes, Aruco codes etc. Virtual interface display One or more HMDs or other augmented reality display systems can optionally generate a 2D or 3D stereoscopic or non-stereoscopic virtual display or augmented view comprising a virtual interface, e.g. superimposed on a physical patient, physical anatomic structure, physical 104 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT anatomic landmark and / or physical anatomic surface and / or near or adjacent to a physical patient, physical anatomic structure, physical anatomic landmark and / or physical anatomic surface. One or more computer processors, e.g. in a first (e.g. a server) or second (e.g. a client) computing system can be configured to generate a 2D or 3D stereoscopic or non-stereoscopic virtual display comprising a virtual interface at a predetermined location and / or orientation relative to one or more anatomic structures and / or the patient. One or more computer processors, e.g. in a first (e.g. a server) or second (e.g. a client) computing system can be configured to generate a 2D or 3D stereoscopic or non-stereoscopic virtual display comprising a virtual interface, for example at a predetermined location and / or orientation relative to one or more markers (e.g. infrared markers, radiofrequency markers, active markers, passive markers, optical markers [e.g. with geometric patterns, bar codes, QR codes etc.], LED’s etc.) attached to one or more anatomic structures and / or the patient and / or a fixed structure in the operating room. The one or more markers can, for example, be a fiducial array attached to one or more bones. One or more computer processors, e.g. in a first (e.g. a server) or second (e.g. a client) computing system can be configured to generate a 2D or 3D stereoscopic or non-stereoscopic virtual display comprising a virtual interface at a predetermined location and / or orientation relative to one or more structures in the operating room, e.g. an OR table, an OR light, an external computer monitor etc.. One or more computer processors, e.g. in a first (e.g. a server) or second (e.g. a client) computing system can be configured to generate a 2D or 3D stereoscopic or non-stereoscopic virtual display comprising a virtual interface at a predetermined location and / or orientation relative to the user’s eyes and / or face and / or relative to the physical HMD or other augmented reality display unit, e.g. the housing of the HMD unit or the physical display (e.g. combiner, waveguide and / or mirror) of the HMD. A 2D or 3D stereoscopic or non-stereoscopic virtual display comprising a virtual interface displayed by one or more HMDs or other augmented reality display systems can comprise, for example, one or more virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof. The one or more one or more virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof can be displayed, by the one or more HMDs or other augmented reality display systems, using one or more computer processors, in 2D, in 3D, or a combination thereof. For example, a virtual slider can be in 2D 105 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT and / or in 3D. A 3D virtual slider can, for example, comprise an activation or sliding field oriented in x-direction, an activation or sliding field oriented in y-direction, and an activation or sliding field oriented in z-direction. The system can be configured for detecting various interactions by a user with the one or more virtual objects of a virtual interface, for example an interaction via gesture recognition, gaze recognition, gaze lock, eye tracking, hand tracking, pointer tracking, instrument tracking, tool tracking, or a combination thereof. For example, a tracked finger, tracked hand, tracked pointer, tracked instrument, tracked tool can interact with the virtual interface. The interaction can trigger an event message, optionally managed by an event handler, and / or a command. The interaction, event message, command or combination thereof can optionally be transmitted and / or received between a first and a second computing system, for example a first computing system (e.g. communicably connected to a navigation system, a robot, and / or an imaging system or an external beam radiation system) and a second (or more) computing system(s) (communicably connected to one or more HMDs or other augmented reality display devices. Collision detection In some embodiments, the system can comprise a collision detection module or other interaction module. The collision detection module or other interaction module can be a module separate from other modules, such as an AR visualization module 1150 or an AR display module 1160. The collision detection module or other interaction module can be part of another module, e.g. a submodule of another module, such as an AR visualization module 1150 or an AR display module 1160. One or more of the computer processors operating a collision detection module or other interaction module, one or more computer processors operating a tracking engine or tracking module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be the same. One or more of the computer processors operating a collision detection module or other interaction module, one or more computer processors operating a tracking engine or tracking 106 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT module 1100, one or more computer processors operating an instrument calibration module 1110, one or more of the computer processors operating a headset calibration module 1120, one or more of the computer processors operating an imaging and navigation module 1130, one or more of the computer processors operating an AR wireless networking module 1140, one or more of the computer processors operating an AR visualization module 1150, and / or one or more of the computer processors operating an AR display module 1160 can be different. In some embodiments, one or more HMDs or other augmented reality display systems and one or more physical tools or physical instruments, e.g. a pointer, a stylus, other tools, other instruments, can be tracked, e.g. using inside-out or outside-in tracking. The coordinates, position and / or orientation of a virtual display comprising a virtual interface displayed by one or more HMDs or other augmented reality display systems can also be tracked. One or more computer processors can be configured, using one or more collision detection modules, to detect collisions between a gaze (e.g. using gaze tracking, gaze lock), a finger (e.g. using finger / hand tracking), a hand (e.g. using hand tracking), an eye (e.g. using eye tracking), one or more tracked physical tools or physical instruments, e.g. a tracked pointer, a tracked stylus, other tracked physical tools, other tracked physical instruments, or a combination thereof and a virtual display comprising the virtual interface, e.g. one or more virtual objects such as virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof. One or more computer processors can use polygon-based collision detection or detection of other interactions. One or more computer processors can use volume-based collision detection or detection of other interactions. One or more computer processors can be configured with a predetermined tolerance for a collision detection or detection of other interactions, e.g. <0.1, <0.5, <1.0, <1.5, <2.0, <3.0, <4.0, <5.0, <10.0 mm, or any other value, and / or <0.1, <0.5, <1.0, <1.5, <2.0, <3.0, <4.0, <5.0, <10.0, <15.0, <20.0 degrees, or any other value. In some embodiments, the tolerance for a collision detection or detection of other interactions can be selected and / or predetermined, for example, to enable a particular application, e.g. activating or executing a command, moving a virtual slider, selecting a virtual button, etc. The tolerance for a collision detection or detection of other interactions can be the same or different for different applications, e.g. an HMD calibration, an instrument 107 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT calibration, an AR visualization module, e.g. comprising selection of a predetermined path for a physical tool or instrument. Different collision detection modules or packages known in the art include, for example I- collide [Cohen et al. “I- COLLIDE: An Interactive and Exact Collision Detection System for Large- Scale Environments,’’ in The 1995 ACM International 3D Graphics Conference], V-clip [Mirtich et al. “V-Clip: Fast and Robust Polyhedral Collision Detection,’’ ACM Trans. Graphics, 17, 3, pp. 177–208], SWIFT [Ehrmann et al. “SWIFT: Accelerated Proximity Queries Between Convex Polyhedra by Multi-Level Voronoi Marching,’’ Technical report, Computer Science Department, University of North Carolina at Chapel Hill], RAPID [Gottschalk et al. OBB-Tree: A Hierarchical Structure for Rapid Interference Detection,’’ Computer Graphics SIGGRAPH ’96 Proceedings 30, pp. 171–180], V-collide [Hudson et al. ‘‘V-COLLIDE: Accelerated Collision Detection for VRML’’, in Proceedings of the Second Symposium on Virtual Reality Modeling Language. California, United States, ACM Press], PQP [Larsen et al. “Fast Proximity Queries With Swept Sphere Volumes’’ Technical Report TR99-018, Department of Computer Science, University of North Carolina. SOLID [Bergen et al. “User’s Guide to the SOLID Interference Detection Library’’; SWIFT [Ehrmann et al. ‘‘Accurate and Fast Proximity Queries Between Polyhedra Using Surface Decomposition’’, Eurographics. Computer Graphics Forum, 20, 3, or VPS [McNeely et al. ‘‘Six Degree-of- Freedom Haptic Rendering Using Voxel Sampling’’, SIGGRAPH 99 Conference Proceedings, Annual Conference Series, pp.401–408]. In some embodiments, a collision detection module, e.g. I-collide, can utilize convex polyhedra for multi-body collision detection. In some embodiments, a collision detection module such as RAPID can utilize non-convex models, detecting, for example, detects pair- wise collisions. Some collision detection modules, e.g. V-collide, can be configured to detect multiple body collisions. Some collision detection modules, e.g. PQP, can support non-convex modes and / or can optionally perform distance computation and / or tolerance verification queries. Some collision detection modules, e.g. SWIFT, can comprise intersection detection, tolerance verification, exact and approximate distance computation, contact determination, or a combination thereof. Some collision detection methods, e.g. I-collide, RAPID, PQP and / or SWIFT, can be based on polygon intersection. Some collision detection packages, e.g. VPS, can utilize voxels and can, for example, detect collisions, perform tolerance verification, approximate distances, and determine contact normal, center of mass, or a combination thereof. 108 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT One or more computer processors can be configured to utilize sweep-based continuous collision detection. Sweep-based continuous collision detection can use a Time Of Impact (TOI) algorithm to compute potential collisions, e.g. for a gaze (e.g. using gaze tracking, gaze lock), a finger (e.g. using finger / hand tracking), a hand (e.g. using hand tracking), an eye (e.g. using eye tracking), for one or more tracked physical pointer, tracked physical tool, tracked physical instrument, or a combination thereof by sweeping its forward trajectory using its current velocity based on the tracking data. If there are contacts with the virtual display, comprising, for example a virtual interface, e.g. along the moving direction of the one or more tracked physical pointer, tracked physical tool, tracked physical instrument, or a combination thereof, one or more computer processors can be configured to detect the collision. In some embodiments, one or more computer processors can be configured to compute a time of impact, e.g. for a given moving direction and / or speed of a tracked physical pointer, physical tool, tracked physical instrument, or combination thereof. The one or more computer processors can perform sub steps from that time onwards, computing the velocity after TOI then re-sweep. One or more computer processors can be configured to utilize speculative continuous collision detection. Speculative continuous collision detection can operate by increasing a broad-phase axis-aligned minimum bounding box of a tracked physical surgical tool, tracked physical instrument or combination thereof, based on the linear and angular motion of the tracked physical surgical tool, tracked physical instrument or combination thereof. The algorithm can be speculative since it can pick all potential contacts during the next physical step. The contacts can then be fed into a solving program operated by one or more computer processors, which can ensure that applicable or predetermined contact constraints can be satisfied. One or more computer processors, e.g. on a first computing unit (e.g. a server) and / or a second computing unit (e.g. a client integrated or connected to an HMD or other augmented reality display device) can operate commercially available software with one or more integrated collision detection modules or programs, e.g. Unity software (Unity Software, Inc.). Commands and / or executable actions triggered using virtual interface In some embodiments, a first computing unit, e.g. a server or controller, can comprise a collision detection module or a module for detection of other interactions (e.g. software program). In some embodiments, a second computing unit, e.g. a mobile client (for example 109 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT communicably connected to or part of one or more HMD or other augmented reality display units) can comprise a collision detection module or a module for detection of other interactions, program or software. In some embodiments, for example when a system comprises multiple HMDs or other augmented reality display systems, a second, third, fourth, fifth, sixth, etc. computing unit, e.g. a second, third, fourth, fifth, sixth, etc. wireless, mobile client, can comprise a collision detection module or a module for detection of other interactions, program or software, for example a collision detection module or a module for detection of other interactions, program or software for each HMD unit and associated computing unit. In some embodiments, one or more computer processors of a first computing unit and a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. computing unit can operate the same collision detection module or module for detection of other interactions. In some embodiments, one or more computer processors of a first computing unit and a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. computing unit can operate different collision detection modules or modules for detection of other interactions. In some embodiments, one or more computer processors of a first computing unit and a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. computing unit can operate the same collision detection module or module for detection of other interactions, which can be used for the same functions and / or interactions and / or commands of / with a virtual object displayed as part of a virtual interface. In some embodiments, one or more computer processors of a first computing unit and a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. computing unit can operate the same collision detection module or module for detection of other interactions, which can be used for the different functions and / or interactions and / or commands of / with a virtual interface. In some embodiments, one or more data packets, for example as described in Table 2, e.g. tracking data of one or more HMDs or other augmented reality display systems, one or more virtual displays, one or more physical pointers, physical tools, or physical instruments, one or more physical implants, one or more robots or robotic arms, can be transmitted from a first computing system wirelessly to a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. computing system, e.g. a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. wireless, mobile client integrated into or connected to a first, and / or second, and / or third, and / or fourth, and / or fifth, etc. HMD or other augmented reality display unit. One or 110 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT more computer processors of the second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. wireless, mobile client can operate one or more collision detection modules, e.g. using Unity software (Unity Software, Inc., 303rdStreet, San Francisco, CA 94103), to detect collisions of one or more tracked physical tools or instruments, e.g. a physical pointer or a physical stylus or other physical tool or instrument, with a virtual interface displayed by the one or more HMDs or other augmented reality display systems; the collision(s) of the tracked physical tool or instrument, or a gaze (e.g. using gaze tracking, gaze lock), a finger (e.g. using finger / hand tracking), a hand (e.g. using hand tracking), an eye (e.g. using eye tracking) with different portions, aspects, fields or displays of the virtual interface, e.g. a virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof, can be used to trigger one or more actions and / or one or more commands, which can, optionally be transmitted from the second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. wireless, mobile client and be received by the first computing unit for further processing, e.g. execution of commands by one or more computer processors. In some embodiments, coordinate and / or tracking data of one or more HMDs or other augmented reality display systems and / or one or more virtual displays by one or more HMDs or other augmented reality display systems (see Table 2) can be received by a first computing unit, along with tracking data of one or more physical tools or physical instruments, one or more physical implants, one or more robots or robotic arms. The first computing unit or system can operate one or more collision detection modules to detect collisions of one or more tracked physical tools or instruments, e.g. a physical pointer or a physical stylus or other physical tool or instrument, with the virtual display, e.g. a virtual interface, displayed by the one or more HMDs or other augmented reality display systems. The collision(s) of the tracked physical tool or instrument with different portions, aspects, fields or displays of the virtual interface, e.g. a virtual object such as a virtual button, virtual field, virtual cursor, virtual pointer, virtual slider, virtual trackball, virtual node, virtual numeric display, virtual touchpad, virtual keyboard, or a combination thereof, can be used to trigger one or more actions and / or one or more commands, which can be processed by one or more computer processors of the first computing system and which can, optionally be transmitted to a second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. wireless, mobile client connected to or integrated into a first, second, third, fourth, and / or fifth etc. HMD or other augmented reality 111 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT display device, optionally triggering commands and / or actions by one or more computer processors of the second, and / or third, and / or fourth, and / or fifth, and / or sixth, etc. wireless, mobile client(s) and one or more connected HMDs or other augmented reality display systems. In some embodiments, a physical tool or instrument (see Table 2), e.g. a tracked pointer, a tracked stylus, a tracked tool, a tracked instrument or a combination thereof, can be used for interacting with a virtual interface display by an HMD or other augmented reality display device. In some embodiments, a gaze (e.g. using gaze tracking, gaze lock), a finger (e.g. using finger / hand tracking), a hand (e.g. using hand tracking), an eye (e.g. using eye tracking) or a combination thereof can be used for interacting with a virtual interface display by an HMD or other augmented reality display device. In some embodiments, a collision or other interaction, e.g. of a tracked physical tool or instrument, with a virtual display, e.g. a virtual object in a virtual user interface, displayed by a first HMD can be detected by one or more computer processors in a first computing system, e.g. a server, and / or a second computing system, e.g. a client integrated, attached to or connected to the first HMD (and / or optionally a second, third, fourth, fifth, sixth or more HMD). The collision and / or other interaction can optionally be used to execute a function and / or to change the appearance of the virtual display, e.g. virtual interface, e.g. with a color change, display of different buttons and / or functions, etc. Data and / or execution functions related to or triggered by a collision and / or other interaction of a tracked physical tool or instrument with a virtual display, e.g. a virtual interface, and / or changes in a virtual display, e.g. a virtual interface, triggered by the collision or other interaction with the tracked physical tool or instrument for display by one or more HMDs or other augmented reality display systems can be generated by one or more computer processors in a first computing unit, e.g. a server, and can be transmitted to one or more additional computing units, for example a second, third, fourth, fifth or more computing unit, e.g. a client integrated, attached to or connected to one or more HMDs or other augmented reality display systems. Data and / or execution functions related to or triggered by a collision and / or other interaction of a tracked physical tool or instrument with a virtual display, e.g. a virtual interface, and / or changes in a virtual display, e.g. a virtual interface, triggered by the collision or other interaction with the tracked physical tool or instrument for display by one or more HMDs or 112 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT other augmented reality display systems can be generated by one or more computer processors in a second (or first) computing unit, e.g. a client integrated, attached to or connected to a first HMD, and can be transmitted to a first (or second) computing unit, e.g. a server (e.g. separate from the one or more HMDs or other augmented reality display systems). One or more computer processors in the second (or first) computing unit, e.g. the server, can be configured to process and / or transmit the data and / or execution functions related to or triggered by the collision and / or other interaction of the tracked physical tool or instrument with the virtual display, e.g. a virtual interface, and / or changes in the virtual display, e.g. a virtual interface, triggered by the collision or other interaction with the tracked physical tool or instrument to one or more additional computing units, for example a second, third, fourth, fifth or more computing unit, e.g. one or more clients integrated, attached to or connected to one or more additional HMDs or other augmented reality display systems for display by the one or more additional HMDs or other augmented reality display systems. FIG. 3 is a representative, non-limiting example of a tracking system 1300, e.g. one or more cameras, including cameras using visible and / or infrared light, stereoscopic cameras, a Lidar system and / or camera(s), a scanner, for example a 3D scanner, one or more computer systems (CS) CS#11310, CS #21320, CS #31330, each with one or more computer processors, one or more robots 1340, e.g. handheld, attached to an OR table, and / or comprising a robotic arm, one or more imaging systems 1350, e.g. a C-arm, 3D C-arm, cone beam CT, spiral CT, MRI, and / or one or more head mounted displays HMD A 1360 HMD B 1370, e.g. a stereoscopic optical see-through head mounted display and / or a stereoscopic video see- through head mounted display. The one or more robots 1340 and / or one or more imaging systems 1350 can also comprise one or more computer systems (e.g. CS #4, CS #5), for example each with one or more computer processors. A first computer system CS #11310 can, for example, reside in a server or computer, for example located in the operating room. The one or more first computer systems CS#11310 can also be located in a remote location, e.g. outside the operating room, and / or can comprise a cloud computing system and / or communicate through a cloud computing system, e.g. through a wired or a wireless connection. One or more second CS #21320, third CS #3 1330, or more computer systems can be integrated into, connected to or attached to one or more head mounted displays HMD A 1360 and / or HMD B 1370 or other augmented reality display devices. The tracking system 1300 can be separate from the one or more head 113 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT mounted displays HMD A 1360 and / or HMD B 1370 or other augmented reality display devices. In some embodiments, the tracking system 1300 can be integrated or attached to the one or more head mounted displays HMD A 1360 and / or HMD B 1370 or other augmented reality display devices. The tracking system 1300 can be configured to track 1410 optionally a hand and / or finger 1380, a pointer, tool, instrument and / or implant 1390, optionally a first 1360, second 1370, third, fourth, fifth etc. head mounted display, a patient (not shown), and / or a robot 1340 and / or an imaging system 1350 or a combination thereof, for example with use of the first computer system CS#11310 and / or optionally with use of a second computer system CS #2 1320, a third computer CS #31330, and / or additional computer systems. The tracking system 1300 can be configured to track 1410 optionally a hand and / or finger 1380, a pointer, tool, instrument and / or implant 1390, optionally a first 1360, second 1370, third, fourth, fifth etc. head mounted display, a patient (not shown), and / or a robot 1340 and / or an imaging system 1350 or a combination thereof, and to transmit the tracking information 1415 to a first computer system CS#11310 and / or optionally a second computer system CS #21320, a third computer CS #31330, and / or additional computer systems. The second CS #2 1320, third CS #3 1330, and / or additional computer systems can be integrated into, connected to or attached to one or more HMDs 1360 1370 or other augmented reality display systems. The one or more additional computer systems can be attached to, connected to or located inside a robotic system 1340 and / or an imaging system 1350. The tracking 1410 can comprise recording one or more coordinates of and / or tracking a hand and / or finger 1380, a pointer, tool, instrument, and / or implant 1390, and / or a first 1360, second 1370, third, fourth, fifth etc. head mounted display or other augmented reality display device, and / or a patient (not shown) by the first computer system CS#11310 and / or the second computer system CS #21320, and / or the third computer CS #31330, and / or additional computer systems, e.g. in a robot 1340 or imaging system 1350, for example using the camera or scanner. The tracking 1410 can comprise recording one or more coordinates of a hand and / or finger 1380, a pointer, tool, instrument, and / or implant 1390, and / or a first 1360, second 1370, third, fourth, fifth etc. head mounted display, and / or the patient (not shown) by the first computer system CS#11310 and / or the second computer system CS #2 1320, and / or the third computer CS #31330, and / or additional computer systems, e.g. in a robot 1340 or imaging system 1350, for example using the camera or scanner. The system 114 ACTIVE 709039105v1 Patent Application Attorney Docket No.172048-014306 / PCT can track a hand and / or finger 1380, a pointer, tool, instrument, and / or implant 1390, and / or a first 1360, second 1370, third, fourth, fifth etc. head mounted display, and / or the patient (not shown) by the first computer system CS#11310 and / or the second computer system CS #21320, and / or the third computer CS #31330, and / or additional computer systems, e.g. in a robot 1340 or imaging system 1350, for example using the camera or scanner. One or more computer processors of the one or more first 1310, second 1320, third 1330 etc. computer systems, can be configured...

Claims

Patent Application Attorney Docket No.172048-014306 / PCT CLAIMS 1. A method for obtaining a portable x-ray image in a patient, the method comprising a. tracking a detector plate in real time in a coordinate system; b. tracking an augmented reality display device in real time in the coordinate system; c. generating, by at least one computer processor, a virtual 3D representation of at least a portion of the tracked detector plate; d. generating, by the at least one computer processor, an augmented view comprising the virtual 3D representation of the at least portion of the tracked detector plate; e. positioning the detector plate in relation to a surface of the patient or an anatomic structure of the patient; f. superimposing, by the at least one computer processor, the augmented view onto the at least portion of the tracked detector plate; g. updating in real time, by the at least one computer processor, the augmented view based on real time tracking information of the tracked detector plate so that the virtual 3D representation of the at least portion of the detector plate is maintained in relationship to the tracked detector plate as the detector plate moves; h. moving the detector plate to align the augmented view of the virtual 3D representation of the at least portion of the detector plate with the surface or anatomic structure of the patient; and i. acquiring the x-ray image of the patient, wherein steps a. through h. are before the step of acquiring the x-ray image of the patient.

2. The method of claim 1 wherein the step of superimposing is by the augmented reality device.

3. The method of claim 2, wherein the augmented reality device comprises a computer monitor, a tablet computer, a smart phone, or a head mounted display, wherein optionally the head mounted display is a video see through head mounted display or an optical see through head mounted display. 242 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT 4. The method of any one of claims 1-3, wherein the method ensures inclusion of a target anatomic region, target anatomic structure or target surface of the patient in the x-ray image.

5. The method of any one of claims 1-4, comprising: moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate with a light marker visible on the surface or anatomic structure of the patient, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam, prior to emission of the x-ray beam from an x-ray tube, for acquiring the x-ray image, or moving an x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam, prior to emission of the x-ray beam from the x-ray tube, to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate, or moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the detector plate with a light marker of an x-ray beam prior to emission of the x-ray beam from an x-ray tube visible on the surface or anatomic structure of the patient and moving the x-ray tube with the light marker indicative of a position, orientation, envelope, boundary, center or combination thereof of the x-ray beam prior to emission of the x-ray beam from the x-ray tube to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the detector plate.

6. The method of any one of claims 1-5, comprising: generating, by the at least one computer processor, a virtual 3D representation of at least a portion of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring the x-ray image, the virtual 3D representation being a 3D surface, 3D volume or combination thereof of an envelope, a boundary, a center, or combination thereof of the x- ray beam to be emitted from the x-ray tube; generating, by the at least one computer processor, an augmented view comprising the virtual 3D representation of the at least portion of the x-ray beam; 243 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT superimposing, by the at least one computer processor, the augmented view onto the patient; and positioning the augmented view comprising the virtual 3D representation of the at least portion of the x-ray beam in relation to the patient by moving the x-ray tube, the patient, or a combination thereof.

7. The method of claim 6, comprising: moving the detector plate to align the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view with the virtual 3D representation of the at least portion of the x-ray beam in the augmented view, or moving the x-ray tube to align the virtual 3D representation of the at least portion of the x-ray beam in the augmented view with the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view, or moving the detector plate and moving the x-ray tube to align the virtual 3D representation of the at least portion of the x-ray beam and the virtual 3D representation of the at least portion of the tracked detector plate in the augmented view.

8. The method of claim 1, comprising moving the tracked detector plate to align the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate with a light marker visible on the surface or anatomic structure of the patient, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring the x-ray image, or moving an x-ray tube with a light marker indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray tube for acquiring the x-ray image to align the light marker with the augmented view of the virtual 3D representation of the at least portion of the tracked detector plate.

9. The method of any preceding claims, comprising tracking the detector plate, the augmented reality display device, an x-ray system, an x-ray tube, an x-ray detector, a 244 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT component of an imaging system, the patient, the anatomic structure of the patient, a patient table, or a combination thereof using a radiofrequency tracking system, an optical tracking system, a camera, a 3D scanner, a scanner, a depth sensor, an inside out tracking system integrated or attached to the augmented reality display device, an outside in tracking system, an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof.

10. The method of claim 1, the method comprising moving the tracked detector plate to align the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of the x-ray beam by an x-ray tube for acquiring the portable x-ray image of the patient.

11. The method of claim 1, wherein the virtual 3D representation of the at least portion of the detector plate comprises a 3D surface, a 3D volume or combination thereof.

12. The method of claim 1, wherein the virtual 3D representation of at the least portion of the detector plate comprises a graphical representation of the at least a portion of the detector plate.

13. A system for acquiring an x-ray of a patient, the system comprising: a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and a detector plate, wherein: the at least one computer processor is configured to track the detector plate in real time in a coordinate system, the at least one computer processor is configured to generate a virtual 3D representation of at least a portion of the tracked detector plate, 245 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT the at least one computer processor is configured to generate an augmented view comprising the virtual 3D representation of the at least portion of the tracked detector plate, the at least one computer processor is configured to superimpose the augmented view onto the at least portion of the tracked detector plate, the augmented reality device is configured to display the augmented view onto the patient at a position and orientation in relation to the tracked detector plate and superimposed onto the tracked detector plate, the at least one computer processor is configured to update in real time the position and orientation of the augmented view based on real time tracking information of the tracked detector plate so that the virtual 3D representation of the at least portion of the detector plate is maintained in relationship to the tracked detector plate as the tracked detector plate is moved to align the virtual 3D representation of the at least portion of the detector plate with a surface or anatomic structure of the patient, and wherein the portable x-ray apparatus is configured to acquire the x-ray image of the patient.

14. The system of claim 13, further comprising a tracking device attached to the detector plate.

15. The system of claim 13, wherein the tracking device is an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof.

16. The system of claim 13 further comprising a light marker configured to be visible on the surface or anatomic structure of the patient, wherein the light marker is configured to be indicative of a position, orientation, an envelope, a boundary, a center or combination thereof of an x-ray beam prior to emission of an x-ray beam from an x-ray tube for acquiring the x-ray image.

17. The system of claim 16, wherein the light marker comprises a light source, wherein the light source optionally comprises a laser. 246 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT 18. The system of any one of claims 13-17, wherein the augmented reality device comprises a computer monitor, a tablet computer, a smart phone, a head mounted display, optionally wherein the head mounted display is a video see through head mounted display or an optical see through head mounted display.

19. The system of any one of claims 13-18, wherein the at least one computer processor is configured to track the detector plate, the augmented reality display device, an x-ray system, an x-ray tube, an x-ray detector, a component of an imaging system, the patient, the anatomic structure of the patient, a patient table, or a combination thereof using a radiofrequency tracking system, an optical tracking system, a camera, a 3D scanner, a scanner, a depth sensor, an inside out tracking system integrated or attached to the augmented reality display device, an outside in tracking system, an optical marker, a radiofrequency marker, an inertial measurement unit, or a combination thereof.

20. A method for obtaining a portable x-ray in a patient, the method comprising: a. tracking an augmented reality display device in real time in a coordinate system; b. generating, by at least one computer processor, a virtual 3D representation of at least a portion of a physical detector plate; c. generating, by the at least one computer processor, an augmented view comprising the virtual 3D representation; d. aligning and superimposing, by the at least one computer processor, the augmented view with a surface or anatomic structure of the patient; e. aligning the physical detector plate with the virtual 3D representation of at least the portion of the physical detector plate in the augmented view; f. acquiring the x-ray image of the patient, wherein steps a. through e. are before the step of acquiring the x-ray image of the patient.

21. A system for acquiring an x-ray of a patient, the system comprising: a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and 247 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT a detector plate, wherein: the at least one computer processor is configured to track the augmented reality display device in real time in a coordinate system, the at least one computer processor is configured to obtain information about a shape of the detector plate, the at least one computer processor is configured to generate a virtual 3D representation of at least a portion of the detector plate, the at least one computer processor is configured to generate an augmented view comprising the virtual 3D representation, the at least one computer processor is configured to align and superimpose the augmented view with a surface or anatomic structure of the patient, and the portable x-ray apparatus is a configured to acquire the x-ray image of the patient.

22. The system of claim 21, further comprising a user interface.

23. The system of claim 22, wherein the user interface is configured to move the augmented view to so that augmented view is aligned and superimposed with a surface or anatomic structure of a patient.

24. The system of claim 22 or claim 23, wherein the user interface is configured to receive input from a gaze tracking, a gesture tracking, a finger and / or hand tracking, an eye tracking, a tracking of a physical tool or physical instrument, a virtual user interface, a keyboard, a mouse, a trackpad.

25. The system of any one or claims 22-24, wherein the user interface comprises a virtual object, a virtual button, a virtual field, a virtual cursor, a virtual pointer, a virtual slider, a virtual trackball, a virtual node, a virtual alphanumeric display, a virtual touchpad, a virtual keyboard, or a combination thereof. 248 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT 26. The system of any one of claims 21-25, wherein the portable x-ray apparatus is a configured to acquire the x-ray image of the patient after the detector plate is aligned with the augmented view comprising the virtual 3D representation.

27. A method for obtaining a portable x-ray image in a patient, the method comprising a. tracking a detector plate in real time in a coordinate system; b. tracking an augmented reality display device in real time in the coordinate system; c. obtaining, by at least one computer processor, information about a geometry of the detector plate; d. generating, by the at least one computer processor, a 3D representation of a surface, a volume or combination thereof, wherein the 3D representation is a virtual 3D representation of at least a portion of the detector plate; e. generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation of the surface, volume or combination thereof; f. displaying, by an augmented reality display device, the augmented view of the 3D representation superimposed and aligned with the tracked detector plate; g. updating in real time, by the at least one computer processor, the augmented view based on real time tracking information of the tracked detector plate so that the 3D representation is maintained in relationship to the tracked detector plate as the detector plate moves; h. moving the detector plate to align the augmented view of the 3D representation with a surface or an anatomic structure of the patient; and i. acquiring the portable x-ray image of the patient, wherein steps a. through h. are before the step of acquiring the portable x-ray image of the patient.

28. The method of claim 27, the method comprising moving the tracked detector plate to align the virtual 3D representation of the at least portion of the detector plate with a light marker visible on the surface or anatomic structure of the patient, wherein the light marker is indicative of a position, orientation, an envelope, a boundary, a center or combination 249 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT thereof of an x-ray beam prior to emission of the x-ray beam from an x-ray source for acquiring portable x-ray image of the patient.

29. A system for obtaining a portable x-ray image in a patient comprising a portable x-ray apparatus; an augmented reality display device; at least one computer processor; and a detector plate, wherein: the at least one computer processor is configured to track the detector plate in real time in a coordinate system, the at least one computer processor is configured to track the augmented reality display device in real time in the coordinate system, the at least one computer processor is configured to obtain information about a geometry of the detector plate, the at least one computer processor is configured to generate a 3D representation of a surface, a volume or combination thereof, wherein the 3D representation is a virtual 3D representation of at least a portion of the detector plate, the at least one computer processor is configured to an augmented view comprising the 3D representation of the surface, volume or combination thereof, the augmented reality display device is configured to display the augmented view superimposed and aligned with the tracked detector plate, the at least one computer processor is configured to update in real time a position and orientation of the augmented view based on real time tracking information of the tracked detector plate so that the 3D representation is maintained in relationship to the tracked detector plate as the detector plate is moved to align the augmented view with a surface or an anatomic structure of the patient, and the portable x-ray apparatus is configured to acquire the x-ray image of the patient.

30. A method of positioning an imaging system to avoid a collision with a patient and / or a patient table comprising: a. tracking one or more components of the imaging system in real time; 250 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT b. tracking an augmented reality display device in real time; c. obtaining, by at least one computer processor, information about a geometry, a shape, a dimension, a travel path or a combination thereof of the one or more components of the imaging system; d. generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system at a first position along the travel path of the one or more components of the imaging system; e. generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system at a second position along the travel path of the one or more components of the imaging system, wherein the first and second position of the one or more components of the imaging system along the travel path are different; f. generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation of the one or more components of the imaging system at the first position and the 3D representation of the one or more components of the imaging system at the second position; g. displaying, by the augmented reality display device, the augmented view onto the imaging system, a clearance or opening of the imaging system, or a combination thereof at a predetermined position and orientation relative to the one or more components of the imaging system; h. updating in real time the augmented view based on real time tracking information of the one or more components of the imaging system so that the 3D representation of the one or more components of the imaging system at the first position and the 3D representation of the one or more components of the imaging system at the second position are maintained as the imaging system moves; i. moving the imaging system so that the augmented view is not intersecting or colliding with at least a portion of the patient, the patient table, or a combination thereof; and j. acquiring the image of the patient, wherein steps a. through i. are before the step of acquiring the image of the patient. 251 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT 31. A method of positioning an imaging system to avoid a collision with a patient and / or a patient table comprising: a. tracking one or more components of the imaging system in real time; b. tracking an augmented reality display device in real time; c. obtaining, by at least one computer processor, information about a geometry, a shape, a dimension, a travel path or a combination thereof of the one or more components of the imaging system; d. generating, by the at least one computer processor, a 3D representation of the one or more components of the imaging system, wherein the 3D representation is a graphical representation of the one or more components of the imaging system moving along the travel path, a graphical representation of the travel path or a combination thereof; e. generating, by the at least one computer processor, an augmented view, the augmented view comprising the 3D representation; f. displaying, by an augmented reality display device, the augmented view onto the imaging system, a clearance or opening of the imaging system, or a combination thereof at a predetermined position and orientation relative to the one or more components of the imaging system; g. updating in real time the position and orientation of the augmented view based on real time tracking information of the one or more components of the imaging system so that the 3D representation is maintained in relationship to the imaging system, the clearance of opening of the imaging system, or combination thereof as the imaging system moves; h. moving the imaging system so that the augmented view is not intersecting or colliding with at least a portion of the patient, the patient table, or a combination thereof; and i. acquiring the image of the patient, wherein steps a. through i. are before the step of acquiring the image of the patient.

32. The method of claim 30 or claim 31, wherein the travel path is a travel path of the one or more components of the imaging system during the step of acquiring the image of the patient. 252 ACTIVE 709039105v1Patent Application Attorney Docket No.172048-014306 / PCT 33. The method of claim 32, wherein the image of the patient is an image volume.

34. The method of claim 33, wherein the image volume is generated using a cone beam computer tomography (CT).

35. The method of claim 30, wherein comprising acquiring a first image at the first position of the one or more components of the imaging system, and / or acquiring a second image at the second position of the one or more components of the imaging system.

36. The method of claim 30 or claim 31, wherein the imaging system is a C-arm or an angiography system.

37. The method of claim 36, wherein the travel path is C-shaped.

38. The method of any one of claims 30-37, comprising updating in real time the augmented view based on real time tracking information of the augmented reality display device.

39. The method of any one of claims 30-38, wherein the one or more components is an X- ray source, X-ray detector or combination thereof. 253 ACTIVE 709039105v1

Images