Foot-controlled cursor

A hands-free system for medical device control using foot movement tracking simplifies surgical device operation, reducing errors and enhancing precision by allowing cursor-based selection on a display screen.

JP7608165B2Active Publication Date: 2025-01-06ALCON INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020563958
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2018-05-16
Filing Date
2019-05-10
Publication Date
2025-01-06
Estimated Expiration
2039-05-10

AI Technical Summary

Technical Problem

Current medical device control methods during surgical procedures are cumbersome and prone to errors due to the limitations of foot pedals and touch screens, which can lead to accidental use and inefficient operation of multiple devices.

Method used

A hands-free system that tracks foot movements to control medical devices using a sensitive surface pad or virtual foot pedal, allowing for the use of a cursor to select icons on a display screen, thereby simplifying device operation and reducing accidental use.

Benefits of technology

The hands-free system enables efficient control of multiple medical devices, reducing the risk of accidental operation and enhancing surgical precision by allowing hands-free movement tracking and device control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007608165000001
    Figure 0007608165000001
  • Figure 0007608165000002
    Figure 0007608165000002
  • Figure 0007608165000003
    Figure 0007608165000003
Patent Text Reader

Abstract

The present disclosure generally relates to a method for controlling a medical device. The method may include tracking foot movement with a hands-free device and processing the foot movement to move a cursor, the cursor being positioned on a display screen of the medical device. The method further includes receiving a selection of at least one icon with the cursor via the hands-free device. A system for controlling a medical device may include a console and a display screen coupled to the console and configured to display the cursor. The system may further include a hands-free device. The hands-free device may be communicatively coupled to the console and may be operable to track movement within a tracking region and generate an output. The system may further include a medical device connected to the console and a processor configured to execute instructions.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a foot controlled cursor. [Background technology]

[0002] Surgical procedures often require many different specialized tools. The specialized tools may include complex machinery designed to function and / or operate in a particular way. Furthermore, the tools may have individual control devices that do not communicate and / or interface with other control devices. In particular, the control devices may be in the form of foot pedals that may allow the surgeon to operate and control the tools with his or her feet. This presents many challenges in the operating room during a surgical procedure.

[0003] For example, a medical device controlled by a foot pedal may include more functions and / or actions than switches and / or buttons on the foot pedal. Medical devices that are not attached to a foot pedal in order to operate and / or function are performed by an operator utilizing a touch screen to select such operations and / or functions. This may not be possible since the operator may have both hands operating other medical devices that may be placed within the patient. Current techniques for controlling the functions and / or actions of medical devices during a surgical procedure are rudimentary and cumbersome, leading to costly mistakes that may be borne by the patient. Summary of the Invention [Means for solving the problem]

[0004] In an exemplary aspect, the disclosure is directed to a method. The method of controlling a medical device may include tracking foot motion with a hands-free device and processing the foot motion to move a cursor. The cursor may be positioned on a display screen of the medical device. The method may further include receiving a selection of at least one icon with the cursor via the hands-free device.

[0005] In another exemplary aspect, the present disclosure is directed to a system for controlling a medical device. The system may include a console and a display screen coupled to the console and configured to display a cursor. The system may further include a hands-free device. The hands-free device may be communicatively coupled to the console and may be operable to track movement within a tracking region and generate an output. The system may further include a medical device connected to the console and a processor configured to execute instructions. The processor may control a cursor according to an output of the hands-free device and receive a selection of at least one icon by the cursor by clicking via the hands-free device according to the output of the hands-free device.

[0006] Various aspects may include one or more of the following features: The method of controlling the medical device may further include attaching the medical device to a console, and the hands-free device may be communicatively coupled to the console. The method of controlling the medical device may further include sending an instruction to the medical device based on the selection. The hands-free device may be wirelessly attached to the console of the medical device. The selection may control a function of the medical device. Without limitation, receiving the selection includes receiving a double click with a foot movement. The hands-free device may include a virtual foot pedal that captures the foot movement. The hands-free device may include a sensitive surface pad for receiving input from an operator. The hands-free device may include a sensitive surface pad, and the operator moves the foot across a surface of the sensitive surface pad. The sensitive surface pad may detect the position of the foot from a change in electrical resistance, a change in capacitance, or a change in inductance. The hands-free device may include motion hardware, and the motion hardware may be disposed on the foot of the operator. It should be noted that without limitation, the hands-free device is a joystick.

[0007] Various aspects may include one or more of the following features: A system for controlling a medical device, the hands-free device may include a virtual foot pedal. The hands-free device may include a sensitive surface pad, where an operator moves a foot across a surface of the sensitive surface pad. Without limitation, the sensitive surface pad is operable to detect position from a change in electrical resistance, a change in capacitance, or a change in inductance. The hands-free device may include motion hardware, where the motion hardware is disposed on the operator's foot. The motion hardware may include an acceleration sensor, an electronic compass, a gyro sensor, or a position encoder. The display screen may be a touch screen and / or a head-up display. Without limitation, the at least one icon may be operable to control an operation of the medical device. The at least one icon may be operable to access a minor mode, where the minor mode is operable to control a function of the medical device.

[0008] It should be understood that both the foregoing general description and the following accompanying drawings and detailed description are exemplary and explanatory in nature and are intended to provide an understanding of the present disclosure without limiting the scope of the disclosure. In this regard, additional aspects, features and advantages of the present disclosure will become apparent to those skilled in the art from the following.

[0009] These drawings illustrate examples of some aspects of embodiments of the present disclosure and therefore should not be used to limit or define the present disclosure. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 shows an example of a console and a hands-free device. [Diagram 2] FIG. 2 shows an example of an optical tracking device. [Diagram 3] FIG. 3 shows another example of an optical tracking device. [Figure 4] FIG. 4 shows an example of an acoustic tracking device. [Diagram 5]FIG. 5 shows an example of a magnetic tracking device. [Figure 6] FIG. 6 shows an example of an infrared tracking device. [Figure 7] FIG. 7 shows an example of a sensitive surface pad. [Figure 8] FIG. 8 shows an example of exercise hardware. [Figure 9] FIG. 9 shows a schematic layout of the console and the hands-free device. [Figure 10] FIG. 10 shows an example of a display screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] For purposes of facilitating an understanding of the principles of the present disclosure, reference will now be made to the embodiments shown in the accompanying drawings, and specific language will be used to describe these embodiments. It will nevertheless be understood that no limitation of the scope of the present disclosure is intended. Any changes and further modifications to the described devices, apparatus, and methods, and any further applications of the principles of the present disclosure, as would normally occur to one skilled in the art, are fully contemplated. In particular, it is fully contemplated that features, parts, and / or steps described with reference to one or more embodiments may be combined with features, parts, and / or steps described with reference to other embodiments of the present disclosure. For simplicity, in some instances, the same reference numerals are used throughout the accompanying drawings to refer to the same or similar parts.

[0012] The present disclosure generally relates to medical device control used in operating rooms for the treatment (e.g., surgery) or diagnosis of patients. It should be noted that the system disclosed below may be utilized in any type of operating room for any type of medical procedure (including ophthalmic surgery). Due to the nature of the complex workflow during surgery, hands-free control may be desirable. In some embodiments, the surgery may include a variety of hands-free input devices, such as physical foot pedals, virtual foot pedals, sensitive surfaces, and hardware that may detect motion. Each hands-free device may control any number of surgical devices in the operating room. Hands-free devices may be limited by the number of buttons, joysticks, and / or rockers that may control an identified function on a particular device. Currently, control options may be limited by the number of available buttons and actions that may be assigned to each button located on the hands-free device. For example, a button may perform only a single action or at most a few context-dependent selections. Thus, complex sequences may be difficult to implement.

[0013] FIG. 1 illustrates a medical device 100 according to an exemplary embodiment. However, without limitation, any type of medical device may be used in some embodiments disclosed below. In some embodiments, the medical device 100 may include a console 102 and an instrument 112. The instrument 112 may be any of a variety of medical instruments that may be used in medical applications such as ophthalmic surgical procedures, including, without limitation, an ophthalmic microscope, an ultrasound handpiece, a surgical guidance system, an intraoperative diagnostic unit, a vitrectomy instrument, an injection cannula, an intraocular lens (IOL) inserter, a trocar cannula, a laser instrument, suitable lighting (including, for example, a chandelier lighting system, an intraocular illuminator, etc.). In the illustrated embodiment, the instrument 112 may be in the form of a hydraulically powered IOL inserter. As illustrated, the console 102 may include a display screen 104, an irrigation port 106, an aspiration port 108, and a hands-free device 114. The hands-free device 114 may be used in place of foot pedals and may allow an operator to control functions of an attached device without physical switches, buttons, triggers, touch screen elements, keyboards, mice, etc. In some embodiments, the console 102 may be designed to be mobile and may be used by a user, such as a healthcare provider, to perform an ophthalmic surgical procedure. The console 102 may also include a control system 110, which may be configured to process, receive, and store data to perform various functions associated with the instrument 112.

[0014] The display screen 104 may communicate information to a user and, in some embodiments, may show data related to system operation and performance during a surgical procedure, hi some embodiments, the display screen 104 may be a touch screen that allows an operator to interact with the console 102 via a graphic user interface.

[0015] In some embodiments, the console 102 may include various fluid handling systems for use during various ophthalmic surgical procedures. In the embodiment shown, the console 102 may provide irrigation fluid via the irrigation port 106. The console 102 may include a pump that may generate a vacuum or suction force that may draw fluid and tissue via the aspiration port 108. In some embodiments, the instrument 112 may use these or other fluid handling systems to drive the instrument 112. Specifically, the instrument 112 may be connected to the irrigation port 106 via an irrigation line and to the aspiration port 108 via an aspiration line. While the above description is directed to a console 102 configured for use with an instrument 112 in the form of an IOL inserter, it should be understood that the present disclosure should encompass other configurations of the console 102 depending, for example, on the particular application.

[0016] The hands-free device 114 may be described as a device for capturing foot motion. The hands-free device 114 may enable control of a cursor (e.g., cursor 1002 in FIG. 10) that may be displayed on the display screen 104, for example. It should be noted that the display screen 104 may include a head-up display. The head-up display may be a transparent display that may present data to the operator without requiring the operator to look away from the operator's viewing area. Currently, foot pedals may perform mechanical motions via physical switches, buttons, triggers, touch screen elements, keyboards, mice, etc. Each of these mechanical motions may control the function and / or operation of a device attached to the foot pedal. Foot pedals may be limited by the number of mechanical motions that may be placed on the foot pedal. Thus, during surgery, any number of foot pedals may be utilized to control any number of specific and individual devices. A large number of foot pedals in surgery may be cumbersome and may lead to accidental use of foot pedals that may be in close proximity to each other. Due to space limitations, a large number of foot pedals may not be feasible. Additionally, foot pedals may be limited by the number of functions they can perform. Thus, performing more functions may require more foot pedals. A single device such as the hands-free device 114 may clear the operating room and prevent unintended function and operation of the device.

[0017] In some embodiments, the hands-free device 114 may track the movement of at least a portion of the operator's foot 116. It should be noted that the hands-free device 114 may track the movement of at least a portion of any part of the body designed to work with the hands-free device 114. Without limitation, the hands-free device 114 may register the position and / or movement of the foot 116 through recognition of the rotation (pitch, yaw and roll) of the operator's foot 116. Measuring the position and / or movement of the foot 116 may enable the medical device 100 to identify and determine the operation and function of the device. For example, a position of the foot 116 and a predetermined movement of the foot 116 in this position may operate and function as a first device. A second position of the foot 116 and a second predetermined movement of the foot 116 may operate and function as a second device.

[0018] This may allow the hands-free device 114 to control any number of devices and perform any number of functions and / or operations on those devices. Utilizing the hands-free device 114 to control any number of devices and perform any number of functions and / or operations may clear an operating room and prevent accidental use of the device during a surgical procedure. The hands-free device 114 may be able to control the functions and / or operations of other devices through position tracking. Position tracking may be performed by any number of sensors. Without limitation, position tracking sensors may include optical sensors, acoustic sensors, magnetic sensors, and / or thermal sensors. It should be noted that various types of sensors may work together in a system to form the hands-free device 114. The position tracking sensors may also include many different individual devices that may work together to track the movement of the foot 116.

[0019] 2 and 3 show two different devices for optical tracking according to embodiments of the present disclosure. In FIG. 2, the hands-free device 114 may include a camera 200 to track the position and movement of the foot 116. Disposed within the camera 200 may be a sensor 202. The sensor 202 may be sensitive to the intensity of light sensed across the face of the sensor 202. In addition, the camera 200 may include a mask 204. The mask 204 may be disposed within the camera 200, along with the sensor 202 and / or along with the lens 206, as shown in FIG. 2. During surgery, the camera 200 may be exposed to light 208 reflected from the foot 116. As the foot 116 moves along any axis 210, the light 208 reflected from the foot 116 may pass through the lens 206 and enter the camera 200. It should be noted that the light 208 may also pass through the mask 204, which may be disposed at any suitable position within the camera 200 as disclosed above. Light 208 passing through lens 206 is polarized and located at a focal point 212 on sensor 202. During the movement of foot 116, light 208 may be reflected to camera 200 at various angles. As the angle changes, focal point 212 may move along the face of sensor 202. As focal point 212 moves, the movement of foot 116 may be tracked and / or recorded on medical device 100 (see, for example, FIG. 1). In addition, camera 200 and / or multiple cameras may capture images at various times and measure the movement of objects in the images. For example, camera 200 or multiple cameras may capture an object in a first image and capture the objection in a second image within seconds of the first image. Camera 200 may be able to determine the movement of objects in the images. This may allow the camera to operate without continuously capturing images, which may save computing power, reduce data, and save energy. This type of optical tracking may be defined as markerless tracking and / or passive tracking.

[0020] FIG. 3 illustrates optical tracking, which may be defined as marker tracking and / or active tracking, according to embodiments of the present disclosure. In some embodiments, the hands-free device 114 may include a camera 300, which may be designed to record the position and / or movement of a marker 302. The marker 302 may include any material suitable for reflecting visible and / or infrared light that may be recorded and / or captured by the camera 300. In some embodiments, the marker 302 may emit visible and / or infrared light that may also be captured and / or recorded by the camera 300. In some examples, there may be at least one marker 302 disposed on the foot 116. Without limitation, the marker 302 may be disposed on the foot 116 in any suitable location and / or attached to the foot 116 via any suitable connector 304. During surgery, the camera 300 may be disposed in any suitable location to view, capture, and / or record the marker 302. Before surgery may begin, the camera 300 may be calibrated relative to the foot 116 to determine a starting position. During surgery, as the foot 116 moves, the camera 300 captures, records, and / or tracks the movement of the markers 302 from a first position to a second position. The captured movement of the markers 302 (and thus the foot 116) may be tracked and / or recorded on the medical device 100 (see, e.g., FIG. 1 ).

[0021] FIG. 4 illustrates an acoustic tracking device 400 according to an embodiment of the present disclosure. In some embodiments, the hands-free device 114 may include the acoustic tracking device 400. There may be any number of suitable acoustic tracking devices 400 that operate and / or function together to determine the movement and / or position of the foot 116. The acoustic tracking device 400 may operate by emitting low and / or high frequency sound waves 402 that are nearly inaudible to humans. In some embodiments, various types of sound waves 402 may be emitted by the acoustic tracking device 400 simultaneously and / or within a given structure. The sound waves 402 may be emitted by a speaker 406 located at any suitable location on the acoustic tracking device 400. When the sound waves 402 strike the foot 116, a reflected wave 404 may be sent back towards the acoustic tracking device 400 and recorded. As shown, the acoustic tracking device 400 may include one or more sensors 408 for recording the reflected wave 404. The reflected wave 404 may be considered an echo. As the foot 116 moves, the reflected waves 404 may be altered by the distance and position of the foot 116 relative to the acoustic tracking device 400. This may allow the acoustic tracking device 400 to determine the location and position of the foot 116. The movement of the foot 116 may be tracked and / or recorded on the medical device 100 (see, for example, FIG. 1 ).

[0022] FIG. 5 illustrates a magnetic tracking device 500 according to an embodiment of the present disclosure. In some embodiments, the hands-free device 114 may include the magnetic tracking device 500. There may be any number of suitable magnetic tracking devices 500 that operate and / or function together to determine the movement and / or position of the foot 116. The magnetic tracking device 500 may operate by emitting an electromagnetic field 502 from a transmitter 508 that may be disposed on or within the magnetic tracking device 500. Prior to surgery, the magnetic tracking device 500 may be calibrated to determine a baseline of the electromagnetic field 502. A receiver 510 disposed on or within the magnetic tracking device 500 may be capable of sensing the electromagnetic field 502 and sensing changes in the electromagnetic field 502. In some embodiments, a magnet 504 may be disposed on the foot 116. The magnet 504 may alter the electromagnetic field 502. The magnet 504 may be attached to the foot 116 in any suitable manner, without limitation, and may be disposed individually on the foot 116 and / or on a separate holding device 506. In the embodiment shown, the holding device 506 is in the form of a band. By altering the electromagnetic field 502 with the magnet 504, the receiver 510 may be able to determine the location and / or position of the foot 116. As the foot 116 moves, the electromagnetic field 502 may be altered by the distance and position of the foot 116 relative to the magnetic tracking device 500. It should be noted that magnets do not have to be used to alter the electromagnetic field 502. The foot 116 may individually alter the electromagnetic field 502, for example, by iron placed in the blood, or any other type of metallic object, device, material, etc. placed on the foot 116 may alter the electromagnetic field 502 without the use of a magnet 504. This may enable the magnetic tracking device 500 to determine the location and / or position of the foot 116. The movement of the foot 116 may be tracked and / or recorded on the medical device 100 (see, for example, FIG. 1).

[0023] FIG. 6 illustrates an infrared tracking device 600 according to an embodiment of the present disclosure. In some embodiments, the hands-free device 114 may include the infrared tracking device 600. In some embodiments, the infrared tracking device 600 may include a light source 602 and a camera 604. The infrared tracking device 600 may function by emitting invisible light 606 from the light source 602. The invisible light 606 may include infrared wavelengths on the light spectrum. This may allow the infrared tracking device 600 to operate in dark rooms and / or bright rooms. During surgery, the light source 602 may emit invisible light 606 to a designated area. The foot 116 may be placed in the path of the invisible light 606 which may generate reflected light 608. The reflected light 608 may be recorded by the camera 604. As the foot 116 moves from a first position to a second position, the reflected light 608 may be altered and recorded by the camera 604. This may allow the infrared tracking device 600 to determine the location and position of the foot 116. The movement of the foot 116 may be tracked and / or recorded on the console 102 (see, for example, FIG. 1).

[0024] It should be noted that in some embodiments, the tracking device may track light over the visible spectrum. This operation may be described as motion tracking, time of flight, or video tracking. Without limitation, motion tracking or video tracking may utilize a single camera and / or multiple cameras working together by sensing the movement of light across the lens of the camera and / or multiple cameras. Tracking the movement of the operator's foot 116 may be translated into user input that may be sent into the console 102.

[0025] FIG. 7 illustrates an embodiment in which a sensitive surface pad 700 may control user input into the console 102 (see, e.g., FIG. 1). The sensitive surface pad 700 may be placed under an operator during a surgical procedure. Without limitation, the sensitive surface pad 700 may be capable of detecting changes in pressure, resistance, capacitance, and / or induction. For example, the operator may contact the sensitive surface pad 700 with the foot 116. The sensitive surface pad 700 may detect pressure exerted on the sensitive surface pad 700 by the foot 116 via a pressure sensor. In other embodiments, electrical means may be utilized to detect pressure changes and / or movement across the sensitive surface pad 700. For example, changes in electrical resistance, capacitance, and / or inductance across the sensitive surface pad 700 may be measured to track the movement of the foot 116 across the sensitive surface pad 700. It should be noted that the sensitive surface pad 700 may function and / or operate without pressure being applied as it may only sense changes in electrical potential moving across its surface. This may enable the sensitive surface pad 700 to determine position and movement of position across the sensitive surface pad 700 .

[0026] It should be noted that other physical and mechanical devices may be used to control user input into the console 102 (see, e.g., FIG. 1). For example, a mechanical embodiment such as a joystick controller may be a mechanical device that controls user input. In some embodiments, the joystick controller may include a base, a shaft, and a handle. The base may be positioned on a surface to hold the joystick controller in place. The shaft may be attached to the base for movement in any direction within a 360 degree radius. The handle may be positioned at the top of the shaft opposite the base. Without limitation, the handle may allow an operator to move the shaft in any suitable direction. Movement of the shaft may be monitored and transmitted to the console 102 as user input. In particular, movement of the shaft may move a cursor (discussed below) positioned on the display screen 104 (see, e.g., FIG. 1).

[0027] FIG. 8 illustrates an embodiment in which motion hardware 800 may control user input into the console 102 (see, e.g., FIG. 1). In some embodiments, the motion hardware 800 may include a motion detector 802 that may be affixed directly to the foot 116 and / or carrier 804. Without limitation, the motion detector 802 may include an acceleration sensor, an electronic compass, a gyro sensor, a position encoder, and / or the like. In some embodiments, the motion detector 802 may transmit communications 806 to the console 102 wirelessly. Although not shown, the motion detector 802 may alternatively transmit communications 806 to the console 102 via a wired connection. Information received by the console 102 from the motion detector 802 may enable the console 102 to track the motion of the foot 116. Tracking the motion of the foot 116 may enable the operator to communicate with a surgical device (e.g., instrument 112 on FIG. 1) attached to the console 102. It should be noted that this may also enable the foot 116 to communicate with the console 102.

[0028] FIG. 9 illustrates an example of a medical device 100 for recording and / or tracking the movement and / or position of a foot 116 by a hands-free device 114 according to an embodiment of the present disclosure. As discussed above, the hands-free device 114 may include any suitable device capable of finding and tracking the foot 116 by any suitable technique. It should be noted that the hands-free device 114 may be calibrated to operate and / or function within a tracking region 900. The tracking region 900 may be a designated region in which the hands-free device 114 may operate. For example, if the foot 116 is outside of the tracking region 900, the hands-free device 114 may not record and / or track the foot 116. It should be noted that the hands-free device 114 may record and / or track the foot 116 outside of the tracking region 900, but this movement may be ignored by the medical device 100. This may allow an operator to move the foot 116 outside of the tracking region 900, which may prevent the medical device 100 from operating a surgical device.

[0029] The console 102 may include a processor 908. The processor 908 may include any suitable device for processing instructions, including but not limited to a microprocessor, a microcontroller, an embedded microcontroller, a programmable digital signal processor, or other programmable device. The processor 908 may also, or instead, be embodied in an application specific integrated circuit, a programmable gate array, a programmable array logic, or any other device or combination of devices operable to process electrical signals. The processor 908 may also, or instead, be embodied in an application specific integrated circuit, a programmable gate array, a programmable array logic, or any other device or combination thereof operable to process electrical signals. The processor 908 may be communicatively coupled to the console 102. The connection between the processor 908 and the console 102 may be a wired or wireless connection as desired for a particular application. The processor 908 may be configured to receive user input 916, for example, to start and / or stop operations and / or functions of the instrument 112.

[0030] The console 102 may also include, for example, memory 910, which may be internal or external. The memory 910 may include any suitable form of data storage, including but not limited to electronic, magnetic, or optical memory (whether volatile or non-volatile). The memory 910 may include code 912, which includes instructions that may be executable by the processor 908. The code 912 may be generated using any suitable programming language, including, for example, but not limited to, C++ or any other programming language (including assembly language, hardware description language, and database programming language) that may be stored, compiled, or interpreted to be executable by the processor 908.

[0031] During surgery, the console 102 may receive information regarding the movement and / or position of the foot 116 from the hands-free device 114. For example, the movement of the foot 116 may be recorded and / or tracked by the hands-free device 114, and this information may be transmitted to the console 102. The foot position from the hands-free device 114 may be visualized on the display screen 104 (which may be a head-up display or a monitor). The display screen 104 may also provide the operator with feedback needed to track current conditions and control options. The console 102 may receive input information from the hands-free device 114, which may then be processed by the processor 908. Although not shown, the processor 908 (or a different processor) may alternatively be incorporated within the hands-free device 114 such that processed data may be provided to the console 102. The processor 908 may also receive information from a user input 916. The information from the user input 916 may be in addition to or instead of information from the hands-free device 114. The processor 908 may then process information from the hands-free device 114 , the user input 916 , or both the hands-free device 114 and the user input 916 to generate an output 914 .

[0032] The output 914 may be defined as a set of instructions that can be sent to the instrument 112. The instructions in the output 914 may instruct the instrument 112 to perform some function related to the surgical procedure that is occurring. The instructions may be as simple as turning a light on and / or off or as complex as using the instrument 112 on a patient. The instructions in the output 914 may result from the movement of the foot 116 or from a user input 916. The movement of the foot 116 may be captured, for example, and used to control a cursor (e.g., cursor 1002 shown on FIG. 10) on the display screen 104. As used herein, the term "cursor" refers to a movable indicator on a display, such as the display screen 104, that identifies a current location for user interaction with the display. The cursor may be used to make a selection for control of the instrument 112. The selection may be a set of instructions that is sent as the output 914 to the instrument 112. The user input 916 may be a function and / or an instruction selected by an operator via the display screen 104, for example, by touch.

[0033] As shown in FIG. 10, the display screen 104 may display patient information and / or instrument status (see, e.g., FIG. 7). The display screen 104 may include a Graphical User Interface (GUI) that may be displayed on the display screen 104 so that the operator may interact with the console 102 (see, e.g., FIGS. 1, 7). In one embodiment, the GUI of the medical device 100 may allow the operator to modally interact with the console 102. In other words, the GUI may present the operator of the console 102 with a set of icons 1000 or buttons that correspond to the full range of functions of the console 102 or the functions of the instrument 112 connected to the console 102. The display screen 104 may allow the operator to select from these functional icons 1000 to utilize a particular function of the console 102 or the instrument 112. For example, the operator may use the foot 116 to select a surgical device via a cursor 1002 (see, e.g., FIG. 9). A cursor 1002 may move as indicated by an operator's foot 116 when the foot 116 is tracked within the tracking region 900 (see, for example, FIG. 9 ). A foot 116 positioned within the tracking region 900 associated with the cursor 1002 may enable the operator to move the cursor 1002, which may enable the operator to select different functions on the display screen 104.

[0034] For example, the cursor 1002 may traverse across the display screen 104 as controlled by the operator's foot 116 (see, e.g., FIG. 1 ), which may correspond to the output of the hands-free device 114. Although the cursor 1002 is shown in FIG. 10 as an arrow, the cursor 10012 may have any suitable shape, including, but not limited to, an arrow, a pointing finger, or a circle, among others. In some embodiments, the cursor 1002 may trigger an action and / or function of the instrument 112, which may be represented by a graphic element (e.g., an icon 1000) on the display screen 104. The cursor 1002 may "click" the icon 1000 to trigger an action and / or function of the instrument 112. The term "click" may be defined as placing the cursor 1002 over the icon 1000 and commanding the cursor 1002 from the hands-free device 114 to select the icon 1000 (where the cursor 1002 may be positioned). Without limitation, different types of clicks may trigger different actions, for example, a single click may click one function, two consecutive clicks may perform a different function, and this may be repeated for any number of clicks.

[0035] Without limitation, the icon 1000 may be associated with an instrument 112. To access the icon 1000, an operator may place the foot 116 within the first area 902, the second area 904, or the third area 906, which may be associated with the icon 1000. The icon 1000 may further be associated with an instrument 112. This may allow the operator to place the foot 116 within a designated area and issue commands to control the instrument 112 via the output 914 (see, for example, FIG. 7). Selecting the icon 1000 may alter the display screen 104 by displaying sub-commands, which may be specific to the selected instrument 112.

[0036] The operator may then configure any parameters or sub-modes of the desired function and utilize that function on the instrument 112. Thus, during a surgical procedure, for each instrument 112 utilized in the surgical procedure, the operator may interact with the console 102 via the hands-free device 114 or user input 916 to select the function desired for the surgical procedure and configure any parameters or sub-modes of the instrument 112. For example, the console 102 and / or the instrument 112 may include the functions of vitreous cutting, vacuum (extraction), scissors, viscous fluid control (VFC) and ultrasound lens removal, an ophthalmic microscope, an ultrasound handpiece, a surgical guidance system, and / or an intra-operative diagnostic unit. To perform a surgical procedure via the console 102 and / or the instrument 112, the icon 1000 may represent the desired function of the console 102 and / or the instrument 112 and any parameters or sub-modes for that functional configuration.

[0037] Specifically, embodiments of modes of interaction with the console 102 may be provided such that these modes of interaction limit or reduce the range of functions that may be adjusted. In particular, some embodiments may present one or more interfaces for operator interaction that may allow the operator to select from a set of preprogrammed options. Here, the interface or set of preprogrammed options, icon 1000, may correspond to a mode in which the operator may interact with the console 102. Each of these preprogrammed options may correspond to the setting of one or more parameters. By allowing the operator to select from a variety of preprogrammed options, the possibility of error and injury is reduced. This is because the setting of each option in the set of preprogrammed options may ensure that the setting of each parameter in the set of parameters is appropriate relative to the settings of the other parameters, as well as ensure that the values ​​of some parameters do not have to be set outside of certain ranges. In addition, because the set of parameters are adjusted in parallel according to the preprogrammed settings, the interface for a particular operating mode may be dramatically simplified compared to an interface that forces the physician to adjust each parameter individually.

[0038] In some embodiments, the display screen 104 may be a touch screen that may enable the operator to select the icon 1000 as the user input 916 (see, e.g., FIG. 9). In particular, the operator may select an operational mode and / or an instrument 112 by touching the display screen 104. Based on the selected operational mode and / or instrument 112, the GUI may present an interface that presents the values ​​of the current settings of a set of parameters to the operator. The interface may enable the operator to easily cycle through a set of pre-programmed options, for example, by using a touch screen, a hands-free device 114, and / or the like, to reflect changes to the settings of the displayed parameters that correspond to the currently selected pre-programmed option.

[0039] It is believed that the operation and construction of the present disclosure will be apparent from the foregoing description. Although the apparatus and methods shown and described above have been characterized according to preference, various modifications and substitutions may be made therein without departing from the spirit and scope of the present disclosure as defined in the following claims.

Claims

1. 1. A method for controlling at least two surgical instruments coupled to a surgical console, the surgical console including a display screen and communicatively coupled to a hands-free device including a camera; presenting to the user a cursor and a set of icons on the display screen, the cursor being a movable indicator on the display screen to identify a current location for user interaction with the display screen and to enable selection of an icon, the set of icons corresponding to a range of functionality of the surgical console or the surgical instrument coupled to the surgical console; tracking foot movement in a tracking area with the hands-free device, the tracking area including at least two zones, each of the zones being associated with an icon, each of the icons being further associated with the surgical instrument; controlling the cursor on the display screen to select the icon associated with a designated area and processing movement of the foot in the designated area to control the surgical instrument associated with the selected icon; receiving a selection of at least one icon of a first plurality of icons for controlling the surgical instrument based on movement of the cursor, the movement of the cursor to select a particular icon being indicated by movement of the user's foot in a first area of ​​the tracking region; configuring the associated surgical instrument in accordance with the setting of one or more parameters associated with a preprogrammed selection represented by the selected icon; and presenting to the user on the display screen a second plurality of icons upon tracking of the foot movement in a second area, the second plurality of icons representing different pre-programmed options corresponding to different settings of one or more parameters of the surgical instrument associated with the second area; The display screen is configured to enable an operator, using the hands-free device and the display screen, to cycle through a set of the preprogrammed options to reflect changes to settings of one or more parameters corresponding to a currently selected preprogrammed option.

2. The method of claim 1 , wherein the hands-free device is wirelessly attached to a console of the surgical instrument.

3. The method of claim 1 , wherein the selection controls a function of the associated surgical instrument.

4. The method of claim 1 , wherein receiving the selection comprises receiving a double click by the foot movement.

5. Tracking the foot movement includes: detecting a focus of light received by the camera from the foot; and The method of claim 1 , further comprising detecting movement of the focal point along a sensor in the camera.

6. The method of claim 5 , wherein the light from the foot received by the camera is light reflected by the foot.

7. The method of claim 5 , wherein the light from the foot received by the camera is light from markers placed on the foot.

8. The method of claim 5 , wherein the light received by the camera is infrared light.

9. 1. A system for controlling at least two surgical instruments, comprising: Surgical console; at least two surgical instruments coupled to the surgical console; a display screen coupled to the surgical console, the display screen configured to display a cursor and a plurality of icons, the cursor being movable to select at least one of the plurality of icons corresponding to a range of functions of the surgical instrument; a hands-free device comprising a camera communicatively coupled to the surgical console and operable to track movement of the foot within a tracking area and generate an output; and A system comprising a processor configured to execute instructions for carrying out the method of any one of claims 1 to 8.

Citation Information

Patent Citations

  • Coordinate input system and display device

    JP1999224160A

  • Gesture interface system, wand for gesture input, application control method, camera calibration method, and control program

    JP2009134677A

  • Switching device for medical or surgical equipment

    US20080140058A1

  • Pre-processing systems and method for MIMO antenna systems

    WO2008071102A1

  • Information input device

    WO2014041938A1