Surgical Instrument Tip Gestures for In-View Medical Menu Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems require surgeons to divert their attention from the surgical site to operate graphical user interfaces, complicating the control of medical apparatuses during procedures.
Innovation Solution
A system that allows control of graphical user interfaces using an instrument tip within the field of view, where movements of the instrument tip are translated into pointer movements on a menu displayed outside the surgical site, enabling control without diverting attention from the operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the graphical user interface is displayed at the image border outside the operation region, then the menu does not cover the surgical site, but the surgeon must move the instrument tip to the border area to control the interface, diverting attention from the surgical site
Solution Approach 1:
A pointer symbol is introduced as an intermediary element that is controlled by the instrument tip but displayed separately from it. The pointer symbol moves in correspondence with the instrument tip position and allows menu selection without requiring the instrument tip to leave the surgical site area. This mediator enables interface control while maintaining focus on the operation region.
Solution Approach 2:
The control function is segmented from the instrument tip itself. Instead of the instrument tip directly interacting with menu elements, it controls a separate pointer symbol that performs the selection function. This segmentation allows the instrument tip to remain in the surgical site while the pointer handles interface navigation.
2Ease of operation
If the instrument tip is moved to the graphical user interface area for control operations, then the menu can be operated, but the instrument tip must leave the center area of the surgical site
Solution Approach 1:
The pointer symbol serves as a mediator that absorbs the movement required for interface control. When the surgeon moves the instrument tip within the surgical site area, the pointer symbol translates this movement to control the menu, eliminating the need for the instrument tip to travel to the interface area at the image border.
3Ease of operation
If the graphical user interface is displayed in the center of the image, then it is easily accessible, but it covers the surgical site and region of interest
Solution Approach 1:
The pointer symbol acts as a mediator that enables interface interaction without occupying the surgical site. It allows the menu to be displayed in a location that does not interfere with the operation region while maintaining ease of control through the pointer's movement in correspondence with the instrument tip.
Data Source
AI summary
The device includes an image capturing device to which an image processing device and via the latter an image display device is connected. The image processing device is configured to show a menu in the image of image display device. Showing the menu can be triggered by a suitable movement of instrument. For example, an activation range can be provided for this purpose at the image border that is monitored by the image processing device for determining whether the instrument tip touches this region. If so, a respective activation signal characterizing this gesture can be created and can be used for showing menu in the image. Additional gestures of the instrument tip, particularly in a defined detection region, allow the control of a pointer in the menu and the selection of functions for control of apparatus.