System for visual support of the hand-eye coordination of an operator at surgical consoles

Abstract

(Main claim) System for supporting the hand-eye coordination of an operator at a surgical console, comprising: - at least one camera module (2, 3) arranged in the area of ​​input devices (4) of the console and capturing the operator's hands during operation, - a display unit (5) for displaying an operating image (5a), - and an image processing unit (17), wherein the image processing unit (17) combines a hand image (5b, 5c) captured by the camera module with the operating image (5a) and displays it simultaneously in the operator's field of vision, so that the hand movements are visually correlated with the operating image.

Description

Technical field

[0001] The invention relates to the field of surgical consoles, telemanipulation systems, and ergonomic human-machine interfaces. In particular, it relates to systems for the visual coupling of an operator's hand movements with a surgical image. State of the art

[0002] With conventional surgical consoles, operation is performed via input devices, the hand movements of which are executed outside the operator's direct field of vision. The operator perceives only a camera image of the surgical field, while their own hands are not visible.

[0003] This leads to a decoupling between visual perception and motor action, which can result in increased cognitive load, reduced hand-eye coordination, and reduced precision in operation.

[0004] No known systems provide a solution where the operator's hands are displayed simultaneously with the surgical image in the field of view during operation. Object of the invention

[0005] The object of the invention is to provide a system that improves the natural hand-eye coordination of an operator at a surgical console by making the operator's hand movements visually coupled with the surgical image perceptible. Solution to the task

[0006] The problem is solved by a system with the features of the main claim. Advantageous further developments result from the dependent claims.

[0007] The system according to the invention comprises at least one camera module for capturing the operator's hands and an image processing unit that combines the captured hand image with an operating image and displays it simultaneously in the operator's field of vision.

[0008] This creates an immediate visual feedback between hand movement and the surgical display. Brief description of the drawings Fig. Figure 1: Front view of a surgical console with retrofittable camera modules and split-view display. The figure shows a console (1) with laterally arranged camera modules (2, 3) positioned via articulated arms (7) in the area of ​​the input devices (4). The display unit (5) simultaneously shows the surgical image (5a) and the hand images (5b, 5c). Fig. 2: Perspective view of the surgical console with split monitor (5a-5c), aligned camera modules (2, 3) and viewing axis (19). The camera modules are each directed at the input devices (4) and can be positioned via articulated arms (7). The segment boundaries (10) of the display unit are visible. Detailed description of the invention: System structure

[0009] The system comprises a surgical console (1) with input devices (4) for manual operation. At least one camera module (2, 3) is arranged in the area of ​​the input devices, which captures the operator's hands during operation.

[0010] The camera modules can be attached to the console as retrofit modules or integrated into its design. Attachment can be achieved using clip adapters (8), articulated arms (7), or similar mechanical fixing devices. Image processing and display

[0011] The hand images captured by the camera modules are fed to an image processing unit (17). This combines the hand image with a surgical image provided by a surgical camera (14).

[0012] The combined display is output via a display unit (5) and simultaneously made available to the operator in their field of vision. The display can be as a split view with separate image segments (10) or as a superimposition of the hand image onto the surgical image. Extended design

[0013] In an extended embodiment, the system can include a transmission unit (21) through which detected hand movements are transmitted to an external, remotely operated device.

[0014] The external device can be configured as a two-axis manipulator (24) with end effectors (27) that synchronously executes the operator's hand movements. The manipulator operates purely passively without autonomous decision logic. Reference symbol list 1 console 2 right camera module 3 left camera module 4 Input devices 5 Display unit 5a Surgical image 5b left hand picture 5c right hand image 7. Articulated arm of the camera module 8 Fastening element / clip adapter 9 Camera detection range 10 Display Segment Boundaries 14 operating room cameras 17 Image processing unit 19 Operator's line of sight 21 transmission unit 24 Manipulator 27 end effectors

Images