Medical Device Projection System

Abstract

Disclosed herein is a medical device projection system comprising a first medical device outside of a sterile field, the first medical device having a user control interface including a plurality of parameters, and further comprising a projector within the sterile field, the projector configured to communicate with the first medical device and to project a mixed reality visual representation of the user control interface onto a surface.

Description

[Technical Field]

[0001] The present disclosure relates to medical device projection systems. [Background technology]

[0002] When a sterile field is present during a medical procedure, it can be difficult for a clinician to interact with, provide input to, or change parameters on a medical device used in the procedure when the medical device is located outside the sterile field. The clinician must exit the sterile field or have the clinician's input relayed to someone outside the sterile field. This process takes up time during the procedure and may require reagents to sterilize the clinician each time the clinician exits the sterile field. It would be beneficial for the clinician to be able to interact with, provide input to, or change parameters on a medical device while remaining sterile within the sterile field. Disclosed herein are medical device projection systems and methods that address the above. Summary of the Invention

[0003] Disclosed herein is a medical device projection system including a first medical device and a projector, the first medical device configured to be outside a sterile field and including a user control interface including a plurality of parameters, and the projector configured to be within the sterile field and in communication with the first medical device and configured to project a mixed reality visual representation of the user control interface onto a surface.

[0004] In some embodiments, the surface is visible to the user and is inside the sterile field or outside the sterile field. In some embodiments, the surface comprises a floor, a ceiling, a surface of a second medical device, or a sterile drape.

[0005] In some embodiments, the projector includes one or more buttons configured to control multiple parameters, the one or more buttons coupled to the left, right, or rear side of the projector body.

[0006] In some embodiments, one or more of the buttons comprises a clickable scroll wheel. In some embodiments, the projector includes a projector body coupled to a projector stand, the projector stand being coupled to the right or left side of the projector body.

[0007] In some embodiments, the projector stand includes a projector stand base or two or more projector stand legs. In some embodiments, the projector is configured to rotate in an orbit about the projector stand axis.

[0008] In some embodiments, the projector includes an energy source, one or more processors, a non-transitory computer-readable medium, and a console having a plurality of logic modules. In some embodiments, the plurality of logic modules, when executed by the processor, are configured to perform operations including receiving a representation of a user control interface from the first medical device, correlating the state of one or more buttons with one or more parameter changes on the user control interface, projecting a mixed reality visual representation of the user control interface including any parameter changes onto a surface, and transmitting the one or more parameter changes from the projector to the first medical device.

[0009] In some embodiments, the first medical device includes a laser and the plurality of parameters includes laser pulse energy, laser frequency, and laser pulse duration. In some embodiments, the projector is sterile or configured to be placed in a sterile bag.

[0010] Also disclosed is a medical device projection system including a first medical device, a projector, and a display screen. The first medical device is configured to be outside the sterile field and includes a user control interface including a plurality of parameters. The projector is configured to communicate with the first medical device and is configured to project a mixed reality visual representation of the user control interface including the plurality of parameters of the first medical device onto a display screen visible to a user and located within the sterile field.

[0011] In some embodiments, the display screen includes a heads-up display screen in communication with the projector. In some embodiments, the display screen includes one or more buttons configured to control multiple parameters, and the one or more buttons are configured to be coupled to the left or right side of the display screen.

[0012] In some embodiments, one or more of the buttons comprises a clickable scroll wheel. In some embodiments, the display screen is sterile or configured to be placed in a sterile bag.

[0013] In some embodiments, the projector is outside the sterile field. In some embodiments, the projector is configured to be inside the sterile field, is sterile, or is placed in a sterile bag.

[0014] In some embodiments, the projector is coupled to the first medical device or the second medical device, and the second medical device is inside the sterile field or outside the sterile field. In some embodiments, the display screen includes a display screen console having an energy source, one or more processors, a non-transitory computer-readable medium, and two or more logic modules.

[0015] In some embodiments, the two or more logic modules, when executed by the processor, are configured to perform operations including correlating one or more button statues with one or more parameter changes on the user control interface and transmitting the one or more parameter changes to the projector.

[0016] In some embodiments, the projector includes a projector console having an energy source, one or more processors, a non-transitory computer-readable medium, and a number of logic modules.

[0017] In some embodiments, the plurality of logical modules, when executed by the processor, are configured to perform operations including receiving a representation of a user control interface from the first medical device, projecting a mixed reality visual representation of the user control interface including any parameter changes onto a display screen, receiving one or more parameter changes from the display screen, and transmitting the one or more parameter changes from the projector to the first medical device.

[0018] In some embodiments, the display screen is curved. In some embodiments, the first medical device includes a laser and the plurality of parameters includes laser pulse energy, laser frequency, or laser pulse duration.

[0019] Also disclosed is a method for controlling multiple parameter changes of a medical device from within a sterile field. The method includes positioning a projector having one or more buttons and in communication with a first medical device, the first medical device having a user control interface with multiple parameters and located outside the sterile field. The method further includes positioning the projector within the sterile field, projecting a mixed reality visual representation of the user control interface onto a surface, and providing the one or more parameter changes to the first medical device.

[0020] In some embodiments, disposing the projector having one or more buttons and in communication with the first medical device includes disposing the projector having one or more buttons configured to control a plurality of parameters and in communication with the first medical device.

[0021] In some embodiments, placing the projector in the sterile field includes placing the projector in a sterile bag. In some embodiments, projecting the mixed reality visual representation of the user control interface onto a surface includes projecting the mixed reality visual representation of the user control interface onto a surface, the surface being visible to the user and including a floor, a ceiling, the surface of a second medical device, or a sterile drape.

[0022] In some embodiments, providing one or more parameter changes to the first medical device includes providing one or more parameter changes to the first medical device, where the first medical device includes a laser, and the one or more parameter changes include laser pulse energy, laser frequency, or laser pulse duration.

[0023] Also disclosed is a method of controlling multiple parameter changes of a medical device from within a sterile field, including positioning a projector in communication with a first medical device, the first medical device having a user control interface with the multiple parameters and located outside the sterile field, the method further including positioning a display screen in communication with the projector and having one or more buttons, positioning the display screen within the sterile field, projecting a mixed reality visual representation of the user control interface onto the display screen, and providing the one or more parameter changes to the first medical device.

[0024] In some embodiments, the method includes: positioning a projector in communication with a first medical device, the first medical device having a user control interface with a plurality of parameters; and positioning a projector in communication with a first medical device, the first medical device being a laser, the plurality of parameters including laser pulse energy, laser frequency, or laser pulse duration.

[0025] In some embodiments, placing the display screen within the sterile field includes placing the display screen within a sterile bag. In some embodiments, providing one or more parameter changes to the first medical device includes one or more buttons on a display screen being operated by a user to provide one or more parameter changes to the first medical device.

[0026] These and other features of the concepts presented herein will become more apparent to those skilled in the art in light of the accompanying drawings and the following description, which describe in more detail certain embodiments of such concepts. A more particular description of the present disclosure will be made by reference to specific embodiments thereof which are illustrated in the accompanying drawings. It will be understood that these drawings depict only typical embodiments of the invention and therefore should not be construed as limiting the scope of the invention. Example embodiments of the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings. [Brief explanation of the drawings]

[0027] [Figure 1] 1 shows an overview of a medical device projection system, according to some embodiments. [Figure 2A] 1 shows a cross-sectional side view of a projector of a medical device projection system, according to some embodiments. [Figure 2B] 1 illustrates a plan view of a projector according to some embodiments. [Figure 2C] 1A-1C illustrate cross-sectional side views of an exemplary method for adjusting a projector to project onto various surfaces, according to some embodiments. [Figure 2D] 1A-1C illustrate cross-sectional side views of an exemplary method for adjusting a projector to project onto various surfaces, according to some embodiments. [Figure 3] 1 shows a block diagram of some components of a medical device projection system including a projector and a projector console, according to some embodiments. [Figure 4] 1 shows an overall view of a medical device projector system including a projector and a display screen, according to some embodiments. [Figure 5] 1 illustrates a block diagram of some components of a medical device projection system including a projector console, a display screen, and a display screen console, according to some embodiments. [Figure 6] 1 illustrates a flow chart of an exemplary method for controlling multiple parameter changes of a medical device from within a sterile field, according to some embodiments. [Figure 7] 1 illustrates a flow chart of an exemplary method for controlling multiple parameter changes of a medical device from within a sterile field, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0028] Before disclosing some specific embodiments in more detail, it should be understood that the specific embodiments disclosed herein do not limit the scope of the concepts provided herein. It should also be understood that certain embodiments disclosed herein may have features that can be readily separated from the specific embodiment and optionally combined with or substituted for features of any of the other several embodiments disclosed herein.

[0029] With regard to the terms used herein, it should also be understood that the terms are for the purpose of describing certain specific embodiments and do not limit the scope of the concepts provided herein. Ordinal numbers (e.g., first, second, third, etc.) are generally used to distinguish or identify various features or steps within a group of features or steps and do not imply sequential or numerical limitations. For example, "first," "second," and "third" features or steps do not necessarily have to appear in that order, and a particular embodiment including such features or steps is not necessarily limited to three features or steps. Labels such as "left," "right," "top," "bottom," "front," and "back" are used for convenience and are not intended to imply, for example, any particular fixed position, orientation, or direction. Indeed, such labels are used, for example, to reflect relative position, orientation, or direction. The singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise.

[0030] The term "logic" may refer to hardware, firmware, or software configured to perform one or more functions. As hardware, the term logic may refer to or include circuitry having data processing and / or storage capabilities. Examples of such circuitry may include, but are not limited to, a hardware processor (e.g., a microprocessor, one or more processor cores, a digital signal processor, a programmable gate array, a microcontroller, an application-specific integrated circuit "ASIC," etc.), semiconductor memory, or a combination of elements.

[0031] Additionally or alternatively, the term logic can refer to or include software such as one or more processes, one or more instances, application programming interfaces (APIs), subroutines, functions, applets, servlets, routines, source code, object code, shared libraries / dynamic link libraries (dlls), or even one or more instructions. This software can be stored in any type of suitable non-transitory or transitory storage medium (e.g., electrical, optical, acoustic, or other form of propagated signal such as carrier wave, infrared signal, or digital signal). Examples of non-transitory storage media can include, but are not limited to, programmable circuits, non-persistent storage such as volatile memory (e.g., any type of random access memory "RAM"), or persistent storage such as non-volatile memory (e.g., read-only memory "ROM," power-backed RAM, flash memory, phase-change memory, etc.), solid-state drives, hard disk drives, optical disk drives, or portable memory devices. As firmware, logic can be stored in persistent storage.

[0032] Regarding "alternate reality," unless the context suggests otherwise, the term alternative reality can relate to virtual reality, augmented reality, and mixed reality. "Virtual reality" includes virtual content within a virtual environment, which can be a fantasy or a simulation of the real world. "Augmented reality" and "mixed reality" include virtual content in a real-world environment, such as a realistic depiction of a part of a patient's body, including anatomical units. While augmented reality includes virtual content in a real-world environment, the virtual content is not necessarily fixed within the real-world environment. For example, the virtual content can be information overlaid on top of the real-world environment. The information can change as the real-world environment changes due to time or ambient conditions in the real-world environment, or can change as a result of the augmented reality consumer navigating the real-world environment, but the information remains overlaid on top of the real-world environment. Mixed reality includes virtual content that is fixed in all dimensions of the real-world environment. For example, the virtual content can be virtual objects fixed in the real-world environment. Virtual objects can change as the real-world environment changes due to time or ambient conditions in the real-world environment, or can change to correspond to the mixed reality consumer's view as the consumer navigates the real-world environment. Virtual objects can also change in response to any interaction with the consumer or another real-world or virtual agent. Virtual objects remain fixed within the real-world environment unless the virtual object is moved to another location within the real-world environment by the mixed reality consumer or some other real-world or virtual agent. Mixed reality does not preclude the overlay of information above on the real-world environment as described with respect to augmented reality.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. FIG. 1 shows an overall view of a medical device projection system 100 according to some embodiments. In some embodiments, the medical device projection system 100 includes a first medical device 110 outside of a sterile field 102. In some embodiments, the first medical device 110 includes a screen 112 depicting a user control interface 114 including parameters of the first medical device 110. In some embodiments, the first medical device 110 includes a laser that may be configured to dissolve kidney stones. In some embodiments, the parameters may include laser pulse energy, laser frequency, laser pulse duration, average power, pulse width, or a state of the medical device (e.g., standby mode, active mode, etc.). The medical device projection system 100 further includes a projector 120 within the sterile field 102 in communication with the first medical device 110. In some embodiments, the projector 120 may be sterile, may be configured to be sterilized, or may be placed in a sterile bag. In some embodiments, projector 120 may be constructed of materials (e.g., hardened plastics, polymers, etc.) that are robust enough to remain functional after a sterilization cycle or that can withstand typical sterilization techniques.

[0034] In some embodiments, the projector 120 may be hardwired to the first medical device 110 or may communicate wirelessly with the first medical device 110. Exemplary wireless communication modalities may include WiFi, Bluetooth, Near Field Communication (NFC), Cellular Global System for Mobile Communications ("GSM"), Electromagnetic (EM), Radio Frequency (RF), combinations thereof, and the like. In some embodiments, the projector 120 may be configured to project a mixed reality visual representation of the user control interface 114 onto a surface 160 visible to the user. Depicting the user control interface 114 on a surface 160 visible to the user allows the user to visualize the user control interface 114, including multiple parameters, confirming desired parameters, or confirming the need to change existing parameters, all in real time. In some embodiments, the surface 160 may be within the sterile field 102 or outside the sterile field 102. In some embodiments, the surface 160 may include a ceiling, floor, wall, the surface of a second medical device, a sterile drape, and the like.

[0035] In some embodiments, the projector 120 may be configured not only to project a mixed reality representation of the user control interface 114 but also to control one or more of the parameters. In some embodiments, the projector 120 may be configured to include one or more buttons 124 configured to control multiple parameters of the first medical device 110. In some embodiments, the one or more buttons 124 may be configured to be operated by a user. In some embodiments, the one or more buttons 124 may include a directional pad or a clickable scroll wheel configured to allow a user to select a parameter using a click function and then change the parameter using a scroll function. Advantageously, the medical device projection system 100 enables the projector 120 to be within the sterile field 102 while projecting a mixed reality visual representation of the user control interface 114 of the first medical device 110 onto a surface 160 visible to the user, and to provide parameter changes to the first medical device 110 from within the sterile field 102.

[0036] 2A shows a cross-sectional side view of projector 120 according to some embodiments. In some embodiments, projector 120 includes a projector body 122 having a front side and a back side. In some embodiments, projector body 122 may include one or more buttons 124 thereon. In some embodiments, projector body 122 may be coupled to a projector stand 142 configured to stabilize projector 120 when projector 120 is within sterile field 102. In some embodiments, projector stand 142 may include a projector stand base 144 or two or more projector stand legs. As described in more detail herein, projector stand 142 may be configured to allow projector 120 to rotate orbitally about projector stand axis 148.

[0037] 2B shows a top view of projector 120 according to some embodiments. Projector body 122 may have a left side and a right side. In some embodiments, one or more buttons 124 may be coupled to the left side, right side, back side, or a combination thereof. In some embodiments, projector stand 142 may be coupled to the left or right side. In some embodiments, one or more buttons 124 may be coupled to one side and projector stand 142 may be coupled to the other side, allowing a user to adjust the projection using projector stand 142 and adjust one or more parameters using one or more buttons 124. In some embodiments, the location where projector stand 142 couples to projector 120 defines projector stand axis 148.

[0038] 2C-2D show cross-sectional side views of an exemplary method for adjusting projector 120 to project onto various surfaces 160, according to some embodiments. Projector 120 can be rotated about projector stand axis 148 (see FIG. 2B) to configure projector 120 to project mixed reality visual representations of user control interface 114 onto various surfaces 160 (see FIG. 1). In some embodiments, projector 120 can be rotated upward so that it is perpendicular to projector stand base 144. In some embodiments, projector 120 can be rotated upward at an angle between 0° and 110° relative to projector stand base 144, as shown in FIG. 2C, and can be rotated downward at an angle between 0° and -60° relative to projector stand base 144, as shown in FIG. 2D. Rotating projector 120 upward at an angle between 0° and 110° allows projector 120 to project onto a wall or ceiling surface. Rotating projector 120 downward at an angle between 0° and −60° allows the projector to project onto the surface of a sterile drape or second medical device. Configuring projector 120 to rotate upward or downward to advantageously project onto surface 160 allows a user to operate within sterile field 102 while visualizing or controlling user control interface 114 from within sterile field 102.

[0039] 3 shows a block diagram of some components of the medical device projection system 100, including a projector console 126, according to some embodiments. In some embodiments, the projector 120 may be configured to include a projector console 126 that includes one or more processors 128, an energy source 130, a non-transitory computer-readable medium (“memory”) 132, and multiple logic modules. In some embodiments, the projector console 126 may be coupled to the projector 120, may be located within the projector 120, or may be located within a projector stand 142. In some embodiments, the multiple logic modules may be configured to include one or more of medical device communication receiving logic 134, parameter determination logic 136, projector display logic 138, and medical device communication logic 140. In some embodiments, the medical device communication receiving logic 134 may be configured to receive a communication from the first medical device 110 that includes a depiction of the user control interface 114. In some embodiments, the parameter determination logic 136 may be configured to correlate the state (e.g., physical position, orientation, etc.) of one or more buttons 124 with one or more parameter changes on the user control interface 114. In some embodiments, the projector display logic 138 may be configured to project a mixed reality representation of the user control interface 114, including any parameter changes, onto the surface 160. In some embodiments, the medical device communication logic 140 may be configured to transmit the one or more parameter changes from the projector 120 to the first medical device 110.

[0040] 4 shows an overall view of a medical device projection system 100 according to some embodiments. In some embodiments, the medical device projection system 100 includes the first medical device 110 described above. In some embodiments, the medical device projection system 100 includes the projector 120 described above configured to project a mixed reality visual representation of the user control interface 114 onto a display screen 170 visible to a user. In some embodiments, the projector 120 can be outside the sterile field 102, and the display screen 170 can be within the sterile field 102. In some embodiments, the projector 120 can be within the sterile field 102. In some embodiments, the display screen 170 can be sterile, configured to be sterilized, or placed in a sterile bag. In some embodiments, the display screen 170 can be constructed of a material (e.g., a hardened plastic, polymer, etc.) that is robust enough to remain functional after a sterilization cycle or that can withstand typical sterilization techniques.

[0041] In some embodiments, projector 120 can wirelessly communicate with display screen 170. Exemplary wireless communication modalities can include WiFi, Bluetooth, near field communication (NFC), cellular Global System for Mobile Communications ("GSM"), electromagnetic (EM), radio frequency (RF), combinations thereof, and the like. In some embodiments, projector 120 can be configured to display a mixed reality visual representation of user control interface 114 on display screen 170. In some embodiments, display screen 170 can include a heads-up display, allowing a user to not only view the mixed reality visual representation of user control interface 114 on display screen 170, but also to view real-world objects, including the patient, through display screen 170. In some embodiments, display screen 170 can be curved to allow optimal user viewing from any angle. In some embodiments, display screen 170 can include one or more buttons 124 configured to control parameters on user control interface 114. In some embodiments, one or more buttons 124 can be operated by a user. In some embodiments, one or more buttons 124 may be coupled to the right or left side of display screen 170 .

[0042] In some embodiments, the display screen 170 may include a display screen base 172 having two or more display screen legs 174 configured to stabilize the display screen 170 within the sterile field 102. In some embodiments, the projector 120 may be configured to couple to the first medical device 110 or may be coupled to the second medical device 190. In some embodiments, the second medical device 190 may be outside the sterile field 102 or may be within the sterile field 102. In one embodiment, the projector 120 may be included in a computing device or a dongle configured to plug into the first medical device 110 or the second medical device. In this embodiment, the computing device, the first medical device 110, or the second medical device 190 may be configured to provide an energy source for the projector 120.

[0043] 5 shows a block diagram of some components of medical device projection system 100, including projector 120, projector console 126, and display screen console 176, according to some embodiments. In some embodiments, projector 120 can include projector console 126, and display screen 170 can include display screen console 176. In some embodiments, projector console 126 includes one or more processors 128, a first energy source 130, a non-transitory computer-readable medium (“memory”) 132, and a first plurality of logic modules. In some embodiments, the plurality of logic modules can include one or more of medical device communication receiving logic 134, projector display logic 138, and medical device communication logic 140, as described above.

[0044] In some embodiments, the plurality of logic modules may include display screen receiving logic 180. In some embodiments, display screen receiving logic 180 may be configured to receive one or more parameter changes from display screen 170. In some embodiments, display screen console 176 may include one or more processors 128, second energy source 130, and non-transitory computer-readable medium (“memory”) 132 having two or more logic modules. In some embodiments, the two or more logic modules may include parameter determination logic 136 or projector communication logic 178. In some embodiments, parameter determination logic 136 may be configured to correlate the state of one or more buttons 124 with one or more parameter changes on user control interface 114. In some embodiments, projector communication logic 178 may be configured to transmit the one or more parameter changes to projector 120.

[0045] 6 shows a flow diagram of an exemplary method 200 for controlling multiple parameter changes of a first medical device 110 from within a sterile field 102, according to some embodiments. In some embodiments, the method 200 includes positioning a projector 120 in communication with the first medical device 110 (block 202). In some embodiments, the first medical device 110 is outside the sterile field 102 and includes a user control interface 114 having multiple parameters. In some embodiments, the projector 120 includes one or more buttons 124 configured to control the multiple parameters. In some embodiments, the one or more buttons 124 may include a clickable scroll wheel. In some embodiments, positioning the projector 120 in communication with the first medical device 110 includes positioning the projector 120 in wireless communication with the first medical device 110.

[0046] Method 200 further includes placing projector 120 within sterile field 102 (block 204). In some embodiments, projector 120 is sterile. In some embodiments, placing projector 120 within sterile field 102 includes placing projector 120 within a sterile bag. In some embodiments, the sterile bag is transparent. Method 200 further includes projecting a mixed reality visual representation of user control interface 114 onto surface 160 (block 206). In some embodiments, projecting the mixed reality visual representation of user control interface 114 includes projecting the mixed reality visual representation of user control interface 114 in real time as the user provides parameter changes. In some embodiments, surface 160 is visible to the user. In some embodiments, surface 160 includes a floor, a ceiling, a surface of a second medical device, a sterile drape, etc.

[0047] The method 200 further includes providing one or more parameter changes to the first medical device 110 (block 208). In some embodiments, providing the one or more parameter changes to the first medical device 110 includes one or more buttons 124 being operated by a user to provide the one or more parameter changes to the first medical device 110. For example, if the one or more buttons 124 include a clickable scroll wheel, a user can turn the clickable scroll wheel to increase or decrease the one or more parameters. In some embodiments, providing the one or more parameter changes includes the projector 120 transmitting the one or more parameter changes to the first medical device 110. In some embodiments, the first medical device 110 may include a laser. In some embodiments, the multiple parameters may include laser pulse energy, laser frequency, and laser pulse duration.

[0048] 7 shows a flow chart of an exemplary method 300 for controlling multiple parameter changes of a first medical device 110 from within a sterile field 102, according to some embodiments. The method 300 includes disposing a projector 120 in communication with the first medical device 110 in the medical device projection system 100 (block 302). In some embodiments, disposing the projector 120 in communication with the first medical device 110 includes disposing the projector 120 in wireless communication with the first medical device 110. In some embodiments, disposing the projector 120 in communication with the first medical device 110 includes disposing the projector 120 in communication with the first medical device 110, the first medical device 110 having a user control interface 114 with multiple parameters. In some embodiments, disposing the projector 120 in communication with the first medical device 110 includes disposing the projector 120 in communication with the first medical device 110, where the first medical device 110 may be outside the sterile field 102.

[0049] Method 300 includes disposing display screen 170 in communication with projector 120 (block 304). In some embodiments, disposing display screen 170 in communication with projector 120 includes disposing display screen 170 in wireless communication with projector 120. In some embodiments, display screen 170 includes one or more buttons 124 configured to control multiple parameters. In some embodiments, one or more buttons 124 include a clickable scroll wheel. Method 300 further includes disposing display screen 170 within sterile field 102 (block 306). In some embodiments, display screen 170 is visible to a user. In some embodiments, display screen 170 is sterile. In some embodiments, display screen 170 may be disposed within a sterile bag. In some embodiments, the sterile bag is transparent. Method 300 further includes projecting a mixed reality visual representation of user control interface 114 onto display screen 170 (block 308). In some embodiments, projecting the mixed reality visual representation of the user control interface 114 includes projecting the mixed reality visual representation of the user control interface 114 in real time as the user provides parameter changes.

[0050] The method 300 further includes providing one or more parameter changes to the first medical device 110 (block 310). In some embodiments, providing the one or more parameter changes includes a user operating one or more buttons 124 on the display screen 170 to provide the changes. For example, if the one or more buttons 124 include a clickable scroll wheel, the user can turn the clickable scroll wheel to increase or decrease the one or more parameters. In some embodiments, providing the one or more changes includes the display screen 170 transmitting the one or more parameter changes to the projector 120, and the projector 120 transmitting the one or more parameter changes to the first medical device 110. In some embodiments, the first medical device 110 may include a laser. In some embodiments, the multiple parameters may include laser pulse energy, laser frequency, and laser pulse duration.

[0051] Although some specific embodiments have been disclosed herein and the specific embodiments have been disclosed in some detail, it is not intended that the specific embodiments limit the scope of the concepts provided herein. Additional adaptations and / or modifications may become apparent to those skilled in the art, and the broader aspects encompass those adaptations and / or modifications as well. Thus, departures may be made from the specific embodiments disclosed herein without departing from the scope of the concepts provided herein. The technical ideas included in the present disclosure are described below. (Appendix 1) a first medical device outside the sterile field, the first medical device having a user control interface including a plurality of parameters; a projector in the sterile field, the projector in communication with the first medical device and configured to project a mixed reality visual representation of the user control interface onto a surface; A medical device projection system comprising: (Appendix 2) 2. The medical device projection system of claim 1, wherein the surface is visible to a user and is inside the sterile field or outside the sterile field. (Appendix 3) 3. The medical device projection system of claim 2, wherein the surface comprises a floor, a ceiling, the surface of a second medical device, or a sterile drape. (Appendix 4) 4. The medical device projection system of any one of claims 1 to 3, wherein the projector includes one or more buttons configured to control the plurality of parameters, the one or more buttons being coupled to the left side, right side, or rear side of the projector body. (Appendix 5) 5. The medical device projection system of claim 4, wherein the one or more buttons include a clickable scroll wheel. (Appendix 6) 6. The medical device projection system of any one of claims 1 to 5, wherein the projector includes a projector body coupled to a projector stand, the projector stand being coupled to the right or left side of the projector body. (Appendix 7) 7. The medical device projection system of claim 6, wherein the projector stand includes a projector stand base or two or more projector stand legs. (Appendix 8) 7. The medical device projection system of claim 6, wherein the projector is configured to rotate circularly about a projector stand axis. (Appendix 9) 9. The medical device projection system of any one of claims 1 to 8, wherein the projector includes a console having an energy source, one or more processors, a non-transitory computer-readable medium, and a plurality of logic modules. (Appendix 10) The plurality of logic modules, when executed by the processor, receiving a representation of the user control interface from the first medical device; correlating the state of the one or more buttons with one or more parameter changes on the user control interface; projecting a mixed reality visual representation of the user control interface, including any parameter changes, onto a surface; and transmitting the one or more parameter changes from the projector to the first medical device. 10. The medical device projection system of claim 9, configured to perform operations including: (Appendix 11) 11. The medical device projection system of any one of claims 1 to 10, wherein the first medical device includes a laser, and the plurality of parameters include laser pulse energy, laser frequency, and laser pulse duration. (Appendix 12) 12. The medical device projection system of any one of claims 1 to 11, wherein the projector is sterile or configured to be placed in a sterile bag. (Appendix 13) a first medical device outside the sterile field having a user control interface including a plurality of parameters; a projector in communication with the first medical device, the projector configured to project a mixed reality visual representation of the user control interface including the plurality of parameters of the first medical device onto a display screen; the display screen visible to a user and located within the sterile field; A medical device projection system comprising: (Appendix 14) 14. The medical device projection system of claim 13, wherein the display screen includes a head-up display screen in communication with the projector. (Appendix 15) 15. The medical device projection system of claim 13 or 14, wherein the display screen includes one or more buttons configured to control the plurality of parameters, the one or more buttons configured to be coupled to a left or right side of the display screen. (Appendix 16) 16. The medical device projection system of claim 15, wherein the one or more buttons include a clickable scroll wheel. (Appendix 17) 17. The medical device projection system of any one of claims 13 to 16, wherein the display screen is sterile or configured to be placed in a sterile bag. (Appendix 18) 18. The medical device projection system of any one of claims 13 to 17, wherein the projector is outside the sterile field. (Appendix 19) 19. The medical device projection system of any one of claims 13 to 18, wherein the projector is configured to be within the sterile field, is sterile, or is placed in a sterile bag. (Appendix 20) 20. The medical device projection system of any one of claims 13 to 19, wherein the projector is coupled to the first medical device or a second medical device, and the second medical device is inside the sterile field or outside the sterile field. (Appendix 21) 21. The medical device projection system of any one of appendixes 13-20, wherein the display screen includes a display screen console having an energy source, one or more processors, a non-transitory computer-readable medium, and two or more logic modules. (Appendix 22) The two or more logic modules, when executed by the processor, correlating the state of the one or more buttons with one or more parameter changes on the user control interface; and transmitting the one or more parameter changes to the projector. 22. The medical device projection system of claim 21, configured to perform operations including: (Appendix 23) 23. The medical device projection system of any one of claims 13 to 22, wherein the projector includes a projector console having an energy source, one or more processors, a non-transitory computer-readable medium, and a plurality of logic modules. (Appendix 24) The plurality of logic modules, when executed by the processor, receiving a representation of the user control interface from the first medical device; projecting the mixed reality visual representation of the user control interface, including any parameter changes, onto the display screen; receiving the one or more parameter changes from the display screen; and transmitting the one or more parameter changes from the projector to the first medical device. 24. The medical device projection system of claim 23, configured to perform operations including: (Appendix 25) 25. The medical device projection system of any one of claims 13 to 24, wherein the display screen is curved. (Appendix 26) 26. The medical device projection system of any one of claims 13 to 25, wherein the first medical device includes a laser, and the plurality of parameters include laser pulse energy, laser frequency, or laser pulse duration. (Appendix 27) 1. A method for controlling multiple parameter changes in a medical device from within a sterile field, comprising: positioning a projector having one or more buttons and in communication with a first medical device, the first medical device having a user control interface with a plurality of parameters and located outside a sterile field; placing the projector within the sterile field; projecting a mixed reality visual representation of the user control interface onto a surface; and Providing one or more parameter changes to the first medical device. A method comprising: (Appendix 28) 28. The method of claim 27, wherein disposing the projector having the one or more buttons and in communication with the first medical device includes disposing the projector having the one or more buttons configured to control the plurality of parameters and in communication with the first medical device. (Appendix 29) 29. The method of claim 27 or 28, wherein placing the projector in the sterile field comprises placing the projector in a sterile bag. (Appendix 30) 30. The method of any one of claims 27 to 29, wherein projecting the mixed reality visual representation of the user control interface onto the surface includes projecting the mixed reality visual representation of the user control interface onto the surface, the surface being visible to the user and including a floor, a ceiling, the surface of a second medical device, or a sterile drape. (Appendix 31) 30. The method of any one of appendixes 27-29, wherein providing one or more parameter changes to the first medical device includes providing one or more parameter changes to the first medical device, the first medical device including a laser, and the one or more parameter changes including laser pulse energy, laser frequency, or laser pulse duration. (Appendix 32) 1. A method for controlling multiple parameter changes in a medical device from within a sterile field, comprising: positioning a projector in communication with a first medical device, the first medical device having a user control interface with a plurality of parameters, the first medical device being outside of a sterile field; providing a display screen in communication with said projector and having one or more buttons; placing the display screen within the sterile field; projecting a mixed reality visual representation of the user control interface onto the display screen; and Providing one or more parameter changes to the first medical device. A method comprising: (Appendix 33) 33. The method of claim 32, further comprising: positioning the projector in communication with the first medical device, the first medical device having the user control interface with the plurality of parameters; and positioning the projector in communication with the first medical device, the first medical device being a laser, and the plurality of parameters including laser pulse energy, laser frequency, or laser pulse duration. (Appendix 34) 34. The method of claim 32 or 33, wherein placing the display screen in a sterile field comprises placing the display screen in a sterile bag. (Appendix 35) 34. The method of claim 33, wherein providing one or more parameter changes to the first medical device includes a user operating the one or more buttons on the display screen to provide the one or more parameter changes to the first medical device.

Claims

1. a first medical device outside the sterile field, the first medical device having a user control interface including a plurality of parameters; a projector in the sterile field, the projector in communication with the first medical device and configured to project a mixed reality visual representation of the user control interface onto a surface; Equipped with The medical device projection system, wherein the projector includes one or more buttons configured to control the plurality of parameters, the one or more buttons being coupled to a left side, a right side, or a rear side of a projector body.

2. The medical device projection system of claim 1 , wherein the surface is visible to a user and is inside the sterile field or outside the sterile field.

3. The medical device projection system of claim 2 , wherein the surface comprises a floor, a ceiling, a surface of a second medical device, or a sterile drape.

4. The medical device projection system of claim 1 , wherein the one or more buttons include a clickable scroll wheel.

5. The medical device projection system of claim 1 , wherein the projector includes a projector body coupled to a projector stand, and the projector stand is coupled to the right or left side of the projector body.

6. The medical device projection system of claim 5 , wherein the projector stand includes a projector stand base or two or more projector stand legs.

7. The medical device projection system of claim 5 , wherein the projector is configured to rotate in an orbit about a projector stand axis.

8. The medical device projection system of claim 1 , wherein the projector includes a console having an energy source, one or more processors, a non-transitory computer-readable medium, and a plurality of logic modules.

9. The plurality of logic modules, when executed by the processor, receiving a representation of the user control interface from the first medical device; correlating the state of the one or more buttons with one or more parameter changes on the user control interface; projecting a mixed reality visual representation of the user control interface, including any parameter changes, onto a surface; and transmitting the one or more parameter changes from the projector to the first medical device. The medical device projection system of claim 8 configured to perform operations including:

10. 10. The medical device projection system of claim 1, wherein the first medical device comprises a laser, and the plurality of parameters comprises laser pulse energy, laser frequency, and laser pulse duration.

11. 11. The medical device projection system of claim 1, wherein the projector is sterile or configured to be placed in a sterile bag.

12. 1. A method for controlling multiple parameter changes in a medical device from within a sterile field, comprising: positioning a projector having one or more buttons and in communication with a first medical device, the first medical device having a user control interface with a plurality of parameters and located outside a sterile field, the one or more buttons configured to control the plurality of parameters; placing the projector within the sterile field; projecting a mixed reality visual representation of the user control interface onto a surface; and Providing one or more parameter changes to the first medical device A method comprising:

13. 13. The method of claim 12, wherein disposing the projector having the one or more buttons and in communication with the first medical device comprises disposing the projector having the one or more buttons configured to control the plurality of parameters and in communication with the first medical device.

14. 14. The method of claim 12 or claim 13, wherein placing the projector in the sterile field comprises placing the projector in a sterile bag.

15. 15. The method of claim 12, wherein projecting the mixed reality visual representation of the user control interface onto the surface comprises projecting the mixed reality visual representation of the user control interface onto the surface, the surface being visible to the user and comprising a floor, a ceiling, the surface of a second medical device, or a sterile drape.

16. 15. The method of any one of claims 12 to 14, wherein providing one or more parameter changes to the first medical device comprises providing one or more parameter changes to the first medical device, wherein the first medical device comprises a laser, and the one or more parameter changes comprise laser pulse energy, laser frequency, or laser pulse duration.

Images