Device for displaying surgical images

Abstract

The present invention provides devices, systems, methods, and computer programs for displaying surgical images. [Solution] A device for displaying surgical images, comprising: - via a content function, identifying a first camera image and a second camera image based on the camera image of the surgical device; - via a control function, identifying one or more graphical user interfaces, GUIs, to control the surgical device and / or content functions; - simultaneously assigning the first camera image and GUI to a first display, particularly a touchscreen display; and - assigning the second camera image and / or GUI to a second display.

Description

Technical Field

[0001] The present disclosure relates to a device and a system for displaying surgical images and a method therefor.

[0002] Background Art In a surgical setting, the control interface of a microscope is often provided on a small touch screen monitor at the rear of the operating room or near another system where space is limited. This results in several problems such as access being inhibited by the cramped layout, making it difficult for the operator to adjust the settings. Training is hindered because multiple users cannot view the small display simultaneously. In addition, media review is restricted by the limited screen space and the number of accessible people. Improvement is desired. <C

[0003] [[ID=J4]] Summary of the Invention One problem of the present disclosure is to improve the work using a microscope in a surgical environment.

[0004] This problem is solved by the disclosed embodiments, particularly as defined by the subject matter of the independent claims. The dependent claims provide information about other embodiments. Various aspects and embodiments of these aspects are also disclosed in the following summary and description, which provide additional features and advantages.

[0005] A first aspect of the present disclosure is a device for displaying surgical images, - identifying a first camera image and a second camera image based on a camera image of a surgical device via a content function, - identifying one or more graphical user interfaces, GUIs, for controlling the surgical device and / or the content function via a control function, - Simultaneously assign the first camera image and GUI to the first display, especially the touchscreen display. - Regarding devices configured to assign a second camera image and / or GUI to a second display.

[0006] A device for displaying surgical images may be a hardware device or a software device. Such a device may be a computer-based controller. Such a device may be a surgical microscope or a rack for a surgical microscope. In addition or alternatively, such a device may include one or more displays and / or interfaces for one or more displays. In addition or alternatively, such a device may include its own housing, and such a device may be integrated into a surgical workstation and / or rack. Such a device may include a first display, such as a touchscreen and / or a second display.

[0007] Imaging devices capable of generating surgical images may be integrated into microscopes, laparoscopes, endoscopes, arthroscopes, exoscopies, and / or other specialized surgical devices. Alternatively, imaging components may be mountable on overhead surgical lights or robotic surgical arms, thereby providing surgeons with enhanced optical clarity and precision during minimally invasive or open-view procedures. The imaging device may include multiple imaging devices. In particular, each imaging device may observe the surgery and / or sample with different functions; for example, one camera may provide visual images and / or another camera may provide fluorescence images, and several other cameras may provide stereo images, ultrasound images, intraoperative X-ray images, and / or CT images. The imaging device, such as a microscope, may be stand-tower type or ceiling-mounted type.

[0008] The content function may be configured to generate a first camera image and a second camera image based on camera images from an imaging device. The content function may be implemented in hardware and / or software.

[0009] The control function can generate a graphical user interface (GUI) for one or more users. The control function can be used to configure and / or control content functions, i.e., multiple functions of the content function. One or more users can control the device, the first image, the second image, the supply of these images, and / or the imaging device via the GUI. The GUI may be configured to receive and / or process text commands and / or haptic (e.g., by touch), visual and / or gesture-supplied commands.

[0010] The first display may be a 2D or 3D display. The first display may be a touchscreen display, i.e., an interactive electronic device that responds to finger or stylus input. The touchscreen display can integrate visual output and haptic input, thereby enabling a more direct and intuitive user experience. The touchscreen display may use capacitive and / or resistive techniques to measure haptic input. The second display may be a 2D or 3D display. In addition to or instead of this, the second display may also be a touchscreen display. Both displays may be configured for image streams, i.e., video displays.

[0011] Based on content and control functions, image content and control functions can be flexibly assigned across different devices, such as different displays, according to the user's needs, i.e., the needs of surgeons and other staff.

[0012] One embodiment of the first aspect is a device for displaying surgical images, - Regarding devices configured to use content features to assign camera images and / or GUIs to each display from one display to another.

[0013] Operating rooms may house multiple displays, each used to show different data, such as microscopic / endoscopic images, vital signs, or specialized imaging like MRI or CT scans. By exchanging surgical images between these displays, the visualization of important information can be adapted for the viewer / user. One advantage is that it ensures a clearer and / or larger view for the surgeon. Instead of crowding around a single monitor, the surgical team can place important feeds at the center of attention, thereby improving visibility and concentration. In addition to or instead of this, the surgeon can observe the range of imaging modalities, such as ultrasound, intraoperative X-ray, or CT. This may be done particularly at different stages of the procedure. By exchanging relevant images on the most convenient monitor, the surgeon can move fluidly between tasks while maintaining a consistent workflow. Thus, different monitors can display different content information observed by imaging devices and / or from other sources (i.e., other imaging devices, stored images, etc.).

[0014] This approach is not limited to monitors within the operating room. The camera feed can be transmitted to displays visible to residents, students, or remote experts outside the operating room, in which case the experts can follow and guide the procedure without physically obstructing the surgeon's workspace.

[0015] Image exchange can sometimes reflect the realities of equipment limitations. A display may malfunction or fail to provide the resolution required for a particular procedure, prompting a quick switch to another monitor to maintain continuity. In addition to or instead of this, the ability to shift imaging feeds and / or GUI functions to a recording or archiving station can assist with legal, research, or quality improvement documentation. By ensuring that the appropriate images are displayed on the screen in a timely manner, the operating room can maximize both surgical precision and overall procedure effectiveness. Images and / or GUIs can also be swapped with another display, such as a headset display and / or handheld display, separate from the first or second display.

[0016] Assigning a GUI from one display to another means that the functionality of the GUI is assigned from one display to another, but not necessarily the visual appearance of the GUI. The latter may vary depending on the display format, which could lead to a different resolution, a different form of GUI elements, a different arrangement of GUI elements, and / or a selection of GUI elements.

[0017] One embodiment of the first aspect is a device for displaying surgical images, -The content function identifies the first camera image at the first resolution, -The content functionality relates to a device configured to identify a second camera image at a second resolution.

[0018] For example, the content function can configure a first camera image as a smaller, lower-resolution image displayed on a small touchscreen display, for example, for interactive use by a surgeon. In addition, the content function can configure a second image as an image with a higher resolution than the first camera image, displayed on a larger screen, for example, for staff observing surgical procedures. This may also be done in reverse, so that the content function supplies one image to a particularly larger touchscreen for assistant staff or observing viewers, and a second image to a 2D screen for the surgeon.

[0019] One embodiment of the first aspect is a device for displaying surgical images, -The content function supplies a first camera image to a first display within an image stream having a first refresh rate. -The present invention relates to a device that, through a content function, supplies a second camera image to a second display in an image stream having a second refresh rate, and is configured such that the first refresh rate and the second refresh rate are different.

[0020] The refresh rate may be tailored to ensure real-time functionality. In particular, the refresh rate of monitors for assistants and / or viewers may be lower than that of the surgeon's display. By tailoring the refresh rates for two monitors (one dedicated to the surgeon and another for viewers), both real-time functionality for the surgeon and / or overall viewing quality for observers can be improved. For the surgeon's display, the primary goal may be minimum latency and / or maximum responsiveness. Therefore, it is best to set a higher refresh rate (e.g., 60Hz or 120Hz) so that the live video feed updates as smoothly and quickly as possible. This can help reduce input-to-display lag, which is important when the surgeon is interpreting visual cues in real time to perform precise operations.

[0021] In addition to or instead of this, viewer monitors can operate at lower or different refresh rates. This may reflect the fact that instructional observers / informational observers do not require the same ultra-low latency feedback. For general viewing or educational demonstration purposes, refresh rates between 30Hz and 60Hz may suffice. By enabling viewer feeds to refresh at rates that conform to typical presentation standards, it also helps ensure compatibility with common video broadcasting equipment (e.g., projectors, recording devices, and streaming encoders) and reduces the load on the system's video distribution hardware.

[0022] In another embodiment, the refresh rate of the camera image stream for the surgeon may be lower than that for the viewer. This may reflect the fact that the surgeon is provided with modalities captured by a camera with a low refresh rate, such as ultrasound images. In addition or alternatively, since the surgeon can mainly directly observe the surgical procedure, they rely on the display only for specific additional information. Also in this case, a lower refresh rate may be sufficient for the surgeon's images.

[0023] If both feeds originate from the same source, the device according to the first aspect may output signals simultaneously at different resolutions and / or different refresh rates. What this means is that a tactile display (e.g., the surgeon's monitor) can receive a high-refresh, low-latency signal, while a second display (e.g., for the viewer) can receive a second signal that may include buffering and / or compression.

[0024] One embodiment of the first aspect is a device for displaying surgical images, Next, that is, - configured to perform one or more of: supplying one or more camera images to storage for later use by a content function, - obtaining one or more camera images from storage for current use by a content function, - supplying one or more GUI user interactions to storage for later use by a content function, - obtaining one or more GUI user interactions from storage for current use by a content function.

[0025] The image can be stored as a RAW image, i.e., before being processed for the first camera image and / or for the second camera image. This enables the RAW image to be adjusted later if it is actually used for display. In addition to or instead of this, the image can be stored simultaneously with the supply of the first camera image and / or the second camera image. For example, the first camera image and the second camera image can be supplied, and the RAW image based on the first camera image and the second camera image can be stored simultaneously. Instead of this, the first camera image and / or the second camera image can be stored at the same time and supplied to one display. In this case, the actually displayed camera image can be supplied again.

[0026] The stored image can be retrieved and supplied to one or more displays. In particular, the stored image can be provided to, for example, a surgeon to give the user information regarding the state before the sample to be observed (e.g., patient, organ, etc.). Thus, the display can switch the current camera image to the stored camera image. In addition to or instead of this, the current camera image and the stored camera image may be displayed together on one display (on the surgeon's display and / or on the viewer's display). This can be done, for example, by placing both images side by side and / or overlaying both images. In particular, a GUI function for retrieving and displaying the stored image as needed can be provided by a control function.

[0027] In addition to or instead of this, the GUI user interaction may be stored for later use and / or retrieved from storage for current use. This can particularly facilitate the training of surgeons or surgical staff. The GUI user interaction may be an image sequence showing the impact of the user interaction on the GUI. For example, the GUI is shown by various input elements that change due to the user interaction.

[0028] One embodiment of the first aspect is a device for displaying surgical images, -This relates to a device configured to assign a second camera image to a second display using a content function, and to assign a GUI having the functions of the GUI assigned to the first display to the second display using a control function.

[0029] In this embodiment, the same GUI functionality is displayed on both displays. This may relate to the functionality itself and not to the graphical representation of the functionality. Therefore, especially if the first display is a touchscreen display, the GUI may be displayed graphically differently from the GUI on the second display, but with the same functionality. Alternatively, the GUI displayed on the touchscreen display and the second display may be exactly the same, i.e., they have the same functionality and the same graphical structure, and are adapted only for the remaining differences between the two displays, such as different refresh rates and / or different resolutions.

[0030] One embodiment of the first aspect is a device for displaying surgical images, -Regarding a device configured, via a control function, to assign a GUI to a second display that is different from the GUI assigned to the first display.

[0031] A multi-screen surgical system can be beneficial when each display is tailored to a specific purpose or workflow. For example, the first screen could display critical real-time imaging and / or surgical controls for the lead surgeon, allowing them to remain focused on the procedure at hand. In addition, a second screen may be dedicated to tasks such as monitoring the patient's vital signs, reviewing medication logs, or displaying a procedure checklist for the anesthesiologist, nurse, or surgical assistant. Different GUIs displayed on the two screens can reflect different purposes and functions.

[0032] In addition to or instead of this, this approach helps separate tasks and reduces cognitive load. It allows users to input data and / or adjust system settings on a second display without interfering with the primary surgical view on the first display for the surgeon. By separating less urgent information, the team can remain continuously aware of critical data while still having access to necessary details. From a workflow perspective, having separate GUIs also facilitates parallel processing. For example, real-time anatomical tracking can be performed on one display while patient metrics and imaging device control functions are displayed on the other. Therefore, GUIs for different screens may be different.

[0033] One embodiment of the first aspect is a device for displaying surgical images, -Regarding a device configured, via a control function, to assign the GUI and / or GUI user interaction images from the first display to the second display.

[0034] This could be particularly useful in training scenarios, where viewers observing the surgery on a second display can see the same GUI inputs that the surgeon or someone close to the surgeon makes on a touchscreen display. Viewers can see on the second screen different images than those the surgeon sees on the first display, for example, larger images and / or images augmented with additional information. Viewers see on the second display the GUI and input / output information provided by the surgeon to the first display.

[0035] One embodiment of the first aspect is a device for displaying surgical images, -The present invention relates to a device configured to supply a first camera image directly from the camera to a first display and / or a second display.

[0036] By directly supplying the first camera image from the camera to one or both of the displays, latency can be reduced and real-time functionality can be guaranteed. Since the image is not transferred via other nodes, communication time can be reduced.

[0037] One embodiment of the first aspect is a device for displaying surgical images, -The control function receives selection information for objects and / or regions shown on one of the first and second displays. -The device is configured, through its content functionality, to supply selected objects and / or areas for display to the other of the first and / or second displays.

[0038] Concentration can be improved by limiting the second display to show only selected portions (selected objects and / or regions) of the surgical image. The format / size of the first or second camera image may be set according to the selected information selected on the other of the first or second image (on the respective first or second display). Surgeons may need to concentrate on a specific surgical area, and by cropping out irrelevant content, distractions can be reduced and details can be clarified. At the same time, the cropped image can also be displayed to the viewer on the second screen. In an educational setting, a partial field of view can help instructors guide trainees by demonstrating important procedures on a screen for the viewer. Therefore, the selected information can be provided on a screen for the audience rather than on a screen for the surgeon.

[0039] The selected object and / or region can be selected, for example, via a GUI provided by a control function. In this case, information about the selection can be transmitted to the content function, which can then supply the image with the desired settings (format, resolution, refresh rate, etc.) so that this information is suitable for the intended display. The desired settings can also be provided by the control function and can be collected, in particular, from user input. By transmitting only the selection information, bandwidth can be saved, especially in telemedicine.

[0040] Selection information may be displayed on other screens, and users who receive a larger image will know that other users have seen their selection information.

[0041] One embodiment of the first aspect is a device for displaying surgical images, -Receive selection information for an object and / or region shown on one of the first and second displays, - Relating to a device configured to display a selected object and / or area on the other of a first display and / or a second display.

[0042] Similar to the previously described embodiment, the second image can be displayed on the second display in a format independent of selection information, but can be displayed with the selected object / region shown in the second image. For example, a surgeon can focus on a specific selection on their own display, while a viewer on the second display can see the full-scale image, but in the selected view indicated by the surgeon. This embodiment also facilitates multitasking; that is, one screen provides an overall view of the entire surgery, while the other screen highlights instruments and / or anatomical areas requiring precision.

[0043] One embodiment of the first aspect is a device for displaying surgical images, -Displays the structure on the second display shown on the first display, - Display the region of interest in the second image, - Regarding devices configured to display past surgical procedures for replay purposes.

[0044] Displaying the selected and / or area of ​​interest during surgery can enhance communication between the surgeon and other staff members.

[0045] A second aspect of this disclosure is a system for displaying surgical images, -A device described in any one of the multiple embodiments mentioned above, - The first display, especially a touchscreen display, - A second display, - Input means, -Including input means configured to assign results of content functions and / or control functions of the device described in any one embodiment based on information provided by the input means, The input means are as follows: -Haptic input means, especially foot switches, - Remote control and, - Microphone and, - relating to a system that includes one or more cameras.

[0046] A system relating to a second aspect of this disclosure may equip an operating room with flexible display capabilities for surgeons, surgical staff, and / or third parties performing or monitoring surgical procedures.

[0047] A third aspect of this disclosure is a method for displaying surgical images, The next step, namely, - A step of identifying a first camera image and a second camera image based on the camera image of the surgical device, - The steps of identifying one or more graphical user interfaces, GUIs, in order to control a surgical device and / or to identify a first camera image and / or a second camera image, - The steps of simultaneously assigning a first camera image and a GUI to a first display, particularly a touchscreen display, - A method including the step of assigning a second camera image and / or GUI to a second display.

[0048] A method according to a third aspect of the Disclosure may include one or more steps that perform one or more functions of a device according to a first aspect of the Disclosure and / or a system according to a second aspect of the Disclosure. The steps of a method according to a third aspect of the Disclosure can be configured such that these steps include features of a device according to a first aspect of the Disclosure. In particular, a method according to a third aspect of the Disclosure may include steps for operating a device according to a first aspect of the Disclosure and / or a system according to a second aspect of the Disclosure.

[0049] A fourth aspect of this disclosure relates to a computer program having program code for operating and / or performing a method of operating a device, system, as described in any one of the preceding aspects, when the computer program is executed on a processor.

[0050] The computer program may include program code for providing one or more functions of a device relating to a first aspect of the disclosure and / or a system relating to a second aspect. In addition to or instead of this, the computer program may provide program code for performing one or more steps of a method relating to a third aspect of the disclosure.

[0051] Another aspect of this disclosure relates to a computing device including a processor configured to perform a method according to any one of the preceding aspects / embodiments.

[0052] Another aspect of the present disclosure relates to a computer program product that includes instructions causing a computer system to perform the method described in any one of the preceding aspects / embodiments when the program is executed by the computer system.

[0053] Another aspect of this disclosure relates to a computer-readable medium containing instructions that cause a computer system to perform the method described in any one of the preceding aspects / embodiments when executed by the computer system.

[0054] Other advantages and features are derived from the following embodiments, some of which refer to the drawings. The drawings do not necessarily show embodiments to scale. Dimensions of various features may be enlarged or reduced, particularly for clarity of explanation. For this purpose, the drawings are at least partially schematic. [Brief explanation of the drawing]

[0055] [Figure 1] This figure shows a microscope system according to one embodiment of the present disclosure. [Figure 2] This figure shows a first camera image for a first display, which includes content and a GUI, according to one embodiment of the present disclosure. [Figure 3] This figure shows a GUI for a second display according to one embodiment of the present disclosure. [Figure 4] This figure shows one display of a first camera image on a first display and a second camera image on a second display in an operating room during surgery, according to one embodiment of the present disclosure. [Figure 5] This figure shows another display of a first camera image on a first display and a second camera image on a second display in an operating room during surgery, according to one embodiment of the present disclosure. [Figure 6] This figure shows yet another display of a first camera image on a first display and a second camera image on a second display in an operating room during surgery, according to one embodiment of the present disclosure. [Figure 7] This figure shows a microscope system according to one embodiment of the present disclosure and / or for one embodiment of the present disclosure.

[0056] While several embodiments have been described in the context of apparatus (or systems) in this disclosure, these descriptions also represent descriptions of corresponding methods, where blocks or apparatus correspond to steps or features of steps.

[0057] Similarly, the aspects described in the context of the steps also represent a description of the corresponding device, or in particular a corresponding block, item, or feature of a system which may be distributed across different locations and which are configured to exchange information between these different locations by their respective means of communication.

[0058] Generally, the disclosure of the described method also applies to corresponding devices (or apparatus) for carrying out the method, or corresponding systems comprising one or more devices, and vice versa. For example, if a particular step is described, the corresponding device may include the features necessary to perform the described step, even if the features are not explicitly described or shown in the figures. On the other hand, if a particular device is described based on a functional unit, the corresponding method may include one or more steps for performing the described function, even if these steps are not explicitly described or shown in the figures. Similarly, a system may be provided with the features of the corresponding device or features for performing a particular step. The various exemplary aspects and features of embodiments described above or below are combinable unless otherwise specified.

[0059] As used herein, the terms “and / or” include all possible combinations of one or more of the items relating to the description and may be abbreviated as “ / ”. Expressions such as “exemplary,” “for example,” or “especially” indicate conditional or optional features that can be combined with all other (essential, conditional, or optional) features of the aspects or embodiments of the present disclosure, unless otherwise expressly stated.

[0060] The following description refers to accompanying drawings that illustrate certain aspects that form part of the disclosure and that enable understanding of the disclosure. The same reference numerals refer to the same or at least functionally or structurally similar features.

[0061] Detailed explanation Figure 1 shows a microscope system for an operating room 100 according to one embodiment of the present disclosure. A patient 102 lies on an operating table 104, and a surgeon 106 examines a region of the patient 102 (e.g., the eyes) through an articulated microscope 110. The articulated microscope 110 is mounted on the operating table 104 and is movable by an arm 112. The articulated microscope's optical system 114 is located at the tip of the arm 112, allowing the optical system 114 to be moved flexibly to observe the patient 102.

[0062] The microscope system 100 is equipped with two displays for images from the microscope 114. The first screen 120, which is a touchscreen, is positioned so that the surgeon and their assistant can view the first image 122 observed by the microscope 114. Thus, the content function of the system configures the image information observed by the microscope 114, allowing the information to be displayed on the touchscreen 120 in real time. Therefore, the resolution is adapted to minimize processing delay, and the image information is transmitted directly to the touchscreen 120.

[0063] The control function provides a graphical user interface on the touchscreen. The GUI allows the surgeon or their assistant to select specific information in the first camera image 122 on the touchscreen 120. The selected information 124 is transmitted from the control function to the content function, which then generates an image based on the selected information 124. This image is then generated, transmitted, and displayed on the second display 130 as a second camera image 132. The second display is provided for a viewer 134, for example, another surgical staff member or student. Based on the information from the surgeon, the viewer can focus on a specific part of the surgery.

[0064] In addition to or instead of this, the content function may transmit the same image information to the second display 130 as the image information transmitted to the first display 120 (in the first step). The display 130 may have a GUI that allows the user 134 to select a specific part 132 of the second image to be displayed. Information regarding the viewer's selection is then displayed on the first display 120 as selection information 124. In this case, the surgeon can track which part the viewer is focusing on. The viewer may be a lead surgeon who does not perform the surgery themselves but uses selection 132 / 124 to show the surgeon specific important information.

[0065] Figure 2 shows a first camera image 200 for a first display having image information and GUI information, according to one embodiment of the present disclosure. The first camera image is based on a microscope image 202 (showing a patient's eye), which is adapted by a content function to be displayed on the first screen. In addition, other information, such as ultrasound information, is provided as a partial image 230. In addition, a GUI is provided which is overlaid on the first camera image 202. The GUI includes two graphical main elements. Part of the GUI is provided as a sidebar 220. Another part of the GUI is provided as a bottom bar 210. The bottom bar has several other GUI elements for operating the microscope and / or selecting / configuring image information displayed in the first image and / or second image.

[0066] GUI element 211 provides a function for configuring a foot switch overlay. GUI element 212 allows selection of various visual enhancements (e.g., low-pass filter, high-pass filter, AI-based object detection). GUI element 213 is a toggle switch that allows the user to select between 2D and 3D display. Optical coherence tomography (OCT) for microscopy can be configured via GUI element 214. Through GUI element 215, the user can switch the GUI from a touchscreen display to a stand monitor. Thus, the control function can be adapted so that the GUI elements are distributed for larger stand screens. Furthermore, the GUI can be modified so that it can be operated by a mouse or other pointing device if the stand screen does not have touch functionality. The first camera image may be supplied to another screen connected via an HDMI port via GUI element 216.

[0067] Figure 3 shows a GUI 300 for a second display according to one embodiment of the present disclosure. The GUI 300 includes GUI elements for setting up a surgical microscope in the "Main" menu 302. In the "Scene Pro" menu 304, extensions can be set for the first camera image and / or the second camera image (and other camera images) displayed on another screen. Furthermore, GUI element 310 allows the GUI to be swapped with the first display. The first display may have a different hardware configuration, e.g., a different size, resolution, refresh rate, and / or input capabilities. Thus, a control function that controls the swapping function reconfigures the GUI to fit the different hardware. In addition, the control function can notify the content function to reconfigure the camera image to fit the different hardware. The adaptation may relate to the parameters listed above.

[0068] Figure 4 shows, according to one embodiment of the present disclosure, the display of a first camera image on a first display and a GUI on a second display in an operating room 400 during surgery. The first camera image 200 originates from a microscope 114 and is similar to the image 200 in Figure 2. The image 200 is displayed on a touch-sensitive display screen 120 configured to display the image to the surgeon and the assisting surgical staff. In addition, a GUI 300 similar to the GUI 300 described in relation to Figure 3 is displayed on the second display 130. The GUI 300 includes graphical elements for setting and controlling the microscope and the information displayed on the first display 120 and the second display 130. The GUI 300 includes an interchangeable screen element to replace the GUI on the first display 120. The second display may be a touch display in a microscope operating console. Alternatively, the second display may be a 2D display configured for viewers not directly involved in the surgery.

[0069] Figure 5 shows the display of a first camera image on a first display and a second camera image on a second display in an operating room 500 during surgery, according to one embodiment of the present disclosure. In this embodiment, the first display 130 may be a viewer display or a display for the operator 134 of a microscope 114, supporting the surgeon 106. The first display 130 displays a first image 520 for the first display, which is generated by the content function from the microscope image. In addition, the image 520 includes a GUI for operating the microscope. This GUI is generated for the first display by the control function. The content function further generates a second image 510 for the second display 120. The second display is intended to be used by the surgeon as a visual display for the microscope 114 (which does not have a display itself). The content function is further configured such that two images, namely the first image and the second image, contain additional view information 512, 522 which contains additional information about the patient.

[0070] Figure 6 shows the display of a first camera image on a first display and a second camera image on a second display in an operating room 600 during surgery, according to one embodiment of the present disclosure. In this embodiment, the content function supplies the first display 130 with an image 622 of the microscope 114. This image is displayed in the graphical user interface, mixed with other images showing the organ operated on in a previous state (previously captured, stored in memory, and retrieved from there by the content function) and / or other information. The displayed information can then be reviewed by the surgical team. In addition, the content function also supplies the second display 120 with an image 610 of the microscope 114, configured to be displayed at the full size of the second display 120. The content function then further supplies the first display with additional information, shown as an overlay partial image 612 of the second microscope image 610.

[0071] This embodiment of the Disclosure enables dynamic control and flexible content sharing across multiple displays mounted on a surgical microscope. For example, content on a smaller control touchscreen and content on a larger monitor (mounted on a flexible arm) can be swapped and controlled on either screen, allowing the surgical team to select the optimal display for viewing the surgical field, adjust microscope settings, adjust camera and scene file settings, review, select, or export media content, and conduct training sessions with enhanced visibility for all participants.

[0072] By enabling the movement of content and control interfaces between displays without interrupting the workflow, this solution improves accessibility, visibility, and usability in the surgical environment. The key principle is the seamless transfer and control of content across multiple displays without disrupting the workflow.

[0073] Multiple embodiments of this disclosure integrate software and hardware interfaces that enable the exchange and sharing of content and control functions across multiple touchscreens. The system ensures that all functions are accessible from any of the displays, thereby improving user experience, ergonomic comfort, training efficiency, and collaborative work. Accordingly, multiple embodiments include an interchangeable content control interface with software that facilitates real-time exchange of displayed content between monitors. In addition to or instead of this, multiple embodiments include a simple and intuitive GUI that enables users to switch content with minimal effort. The microscope interface is accessible on either a small touchscreen or a larger monitor by dynamically transferring content and control functions between two displays. This feature allows the operator to control microscope settings, adjust system parameters, and view or export media content on the most accessible and appropriate display for the task.

[0074] Several embodiments of this disclosure include flexible display options for multi-user scenarios. Therefore, larger monitors, mounted on flexible arms and positionable for optimal group viewing during training sessions, allow control interface functions or media review functions to be displayed in a more visually appealing manner. A control touchscreen can also display the live surgical field, providing a solution that can accommodate various user needs, for example, when space is limited near the primary surgical area.

[0075] Multiple embodiments of this disclosure include seamless workflow integration. Both display monitors may have touch capabilities, enabling seamless control regardless of which display is active. Content transfer between monitors is implemented to be fast and uninterrupted, ensuring seamless switching between displays without interrupting the workflow. Control options are available on either display, allowing users to adjust settings or manage media on the fly, regardless of which display is in use.

[0076] Multiple embodiments of this disclosure include real-time content exchange, allowing users to instantly switch content between the two displays so that the necessary information is always presented on the most convenient screen. In addition to or instead of this, multiple embodiments may include enhanced viewing and control. Both displays can be used interchangeably for any function, such as surgical field viewing, system setting adjustments, or media file management. Multiple embodiments are configurable for enhanced collaboration. The larger monitor can be used for group viewing and training while still maintaining control over microscope settings and other functions.

[0077] Multiple embodiments of this disclosure include wireless portable interface controls. A wireless version of the control interface can be operated from a tablet device, allowing for more flexible control by enabling setting adjustments from anywhere in the room. In addition to or instead of this, multiple embodiments include voice-activated display switching. Voice commands can be incorporated to facilitate hands-free content exchange, thereby further improving usability in scenarios where the operator's hands are occupied. In addition to or instead of this, multiple embodiments may be configured for foot-switch / handle-activated display switching. Foot-switch / handle commands can be incorporated to facilitate content exchange, thereby further improving usability in scenarios where the operator is performing surgery.

[0078] Multiple embodiments of this disclosure include workflow integration. Through preoperative setup, the displays are configurable based on user preferences and surgical requirements. In addition, embodiments are configurable during surgery. Users can dynamically switch content between displays to meet real-time needs, for example, by adjusting settings on a smaller touchscreen while switching to a live surgical view on a larger monitor for team observation. In addition to or instead of this, multiple embodiments are configurable for postoperative use. This facilitates media review and export on larger displays, thereby enabling easier collaboration and documentation.

[0079] Multiple embodiments of this disclosure can improve the ergonomics, usability, and efficiency of surgical microscope systems by enabling flexible display control, thereby enhancing the user experience in surgical training and media review workflows.

[0080] Some embodiments relate to microscopes that include systems such as those described in relation to one or more of Figures 1 to 6. Alternatively, the microscope may be part of a system such as those described in relation to one or more of Figures 1 to 6, or may be connected to a system such as those described in relation to one or more of Figures 1 to 6.

[0081] Figure 7 shows a schematic diagram of a system 700 configured to carry out the methods described herein. The system 700 includes a microscope 710 and a computer system 720. The microscope 710 is configured to take images and is connected to the computer system 720. The computer system 720 is configured to carry out at least part of the methods described herein. The computer system 720 may be configured to run machine learning algorithms. The computer system 720 and the microscope 710 may be separate entities or may be integrated within a single common housing. The computer system 720 may be part of the central processing system of the microscope 710, and / or the computer system 720 may be part of a dependent component of the microscope 710, such as a sensor, actor, camera, or illumination unit of the microscope 710.

[0082] The computer system 720 may be a local computer device (e.g., a personal computer, laptop, tablet computer, or mobile phone) comprising one or more processors and one or more storage devices, or it may be a distributed computer system (e.g., a cloud computing system comprising one or more processors and one or more storage devices distributed to various locations such as local clients and / or one or more remote server farms and / or data centers). The computer system 720 may include any circuit or combination of circuits. In one embodiment, the computer system 720 may include one or more processors, which may be of any kind. As used herein, the processor may be intended to be any kind of computing circuit, such as a microprocessor for a microscope or microscopic component (e.g., a camera), a microcontroller, a composite instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multicore processor, a field-programmable gate array (FPGA), or any other kind of processor or processing circuit. Other types of circuits that may be included in the computer system 720 may be custom circuits, application-specific integrated circuits (ASICs), etc., such as one or more circuits (communication circuits, etc.) used in wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. The computer system 720 may also include one or more storage devices that may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives that handle removable media such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.The computer system 720 may also include a display device, one or more speakers and a controller which may include a keyboard and / or mouse, trackball, touchscreen, voice recognition device, or any other device which enables a user of the system to input information into and receive information from the computer system 720.

[0083] Some or all of the steps may be performed by a hardware device (or by using a hardware device), such as a processor, microprocessor, programmable computer, or electronic circuit. In some embodiments, one or more of the most critical steps may be performed by such a device.

[0084] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation is feasible using a non-transient recording medium, which is a digital recording medium, etc., that stores electronically readable control signals and cooperates (or can cooperate) with a programmable computer system to carry out each method. Examples include floppy disks, DVDs, Blu-rays, CDs, ROMs, PROMs and EPROMs, EEPROMs, or FLASH memory. Thus, the digital recording medium may be computer-readable.

[0085] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system so as to carry out any of the methods described herein.

[0086] Generally, embodiments of the present invention can be implemented as a computer program product comprising program code, which operates to perform one of the methods when the computer program product is executed on a computer. This program code may be stored, for example, on a machine-readable carrier.

[0087] Another embodiment includes a computer program stored in a machine-readable carrier for carrying out any of the methods described herein.

[0088] Therefore, in other words, embodiments of the present invention are computer programs having program code for carrying out any of the methods described herein when the computer program is executed on a computer.

[0089] Accordingly, another embodiment of the present invention is a recording medium (or data carrier or computer-readable medium) containing a stored computer program for carrying out any of the methods described herein when executed by a processor. The data carrier, digital recording medium, or recording medium is typically tangible and / or non-transient. Another embodiment of the present invention is an apparatus, such as those described herein, comprising a processor and a recording medium.

[0090] Therefore, another embodiment of the present invention is a data stream or signal sequence representing a computer program for carrying out any of the methods described herein. The data stream or signal sequence may be configured to be transmitted, for example, over a data communication connection, such as the Internet.

[0091] Another embodiment includes processing means, for example, a computer or programmable logic device configured or adapted to carry out any of the methods described herein.

[0092] Another embodiment includes a computer having an installed computer program for carrying out any of the methods described herein.

[0093] Another embodiment of the present invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for carrying out any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.

[0094] In some embodiments, a programmable logic device (e.g., a field-programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, the field-programmable gate array may cooperate with a microprocessor to carry out any of the methods described herein. Generally, the methods are advantageously carried out by any hardware device. [Explanation of Symbols]

[0095] 100 Operating Room Microscope System 104 Operating table 106 Surgeon 110 Articular Microscope 112 Microscope Arm 114 Microscope Optical Systems 120 Touchscreen Display 122 First camera image 124 Selection information on the first display 130 Second display 132 Second camera image 134 viewers 200 First camera image 202 Microscope Images 210 GUI Bottom Bar 211 Footswitch Overlay Settings 212 Image Extension Settings 213 2D / 3D selection 214 OCT Selection 215 Replacement Screen 216 HDMI Switch 220 GUI sidebars 230 Partial image relative to the first camera image 300 GUI for the second display 302 Main Menu 304 Scene Menu 310 Replacement Screen Elements 400 Operating room 500 Operating room 510 Second image 512 Additional Information 520 Image and GUI 522 Additional Information 600 Operating room 610 Microscope Images 612 Partial Images 622 Microscope Images 700 System 710 Microscope 720 Computer Systems

Claims

1. A device for displaying surgical images, Through the content function, a first camera image (122) and a second camera image (132) are identified based on the camera image of the surgical device (114). To control the surgical device and / or the content function via a control function, one or more graphical user interfaces, GUI(124), are identified, The first camera image (122) and GUI (124) are simultaneously assigned to a first display (120), particularly a touchscreen display. A device configured to assign the second camera image (132) and / or GUI to a second display (130).

2. The device according to claim 1, wherein the content function is configured to assign the respective camera images (130, 132) and / or the respective GUIs from one display to the other.

3. The content function identifies the first camera image (122) at a first resolution, The device according to claim 1 or 2, wherein the content function is configured to identify the second camera image (132) at a second resolution.

4. The content function provides the first camera image to the first display within an image stream (122) having a first refresh rate. The device according to any one of claims 1 to 3, wherein the content function supplies the second camera image to the second display in an image stream (132) having a second refresh rate, and the first refresh rate and the second refresh rate are configured to be different.

5. The aforementioned content function provides one or more camera images (122, 132) to storage for later use. The aforementioned content function retrieves one or more camera images from storage for current use. The aforementioned content function provides one or more GUI user interactions to storage for later use. The device according to any one of claims 1 to 4, wherein the content function is configured to perform one or more of the following: retrieve one or more GUI user interactions from storage for use at present.

6. The device according to any one of claims 1 to 5, wherein the content function is configured to assign the second camera image (132) to the second display (130), and the control function is configured to assign the GUI having the functions of the GUI assigned to the first display (120) to the second display (130).

7. The device according to any one of claims 1 to 6, wherein the control function is configured to assign to the second display (130) a GUI different from the GUI assigned to the first display (120).

8. The device according to any one of claims 1 to 7, wherein the control function is configured to assign the GUI and / or GUI user interaction images of the first display (120) to the second display (130).

9. The device according to any one of claims 1 to 8, configured to supply the first camera image (122) directly from the camera (114) to the first display (120) and / or the second display (130).

10. The control function receives selection information (124) of an object and / or region shown on one of the first display (120) and the second display (130), The device according to any one of claims 1 to 9, wherein the content function is configured to supply the object and / or the region (124) selected for display to the other of the first display and / or the second display.

11. The system receives selection information for an object and / or region indicated by the user in one of the first display (120) and the second display. The device according to any one of claims 1 to 10, wherein the other of the first display and / or the second display is configured to show the selected object and / or region (124).

12. The structure on the second display shown on the first display is displayed, The region of interest is displayed in the second image. The device according to any one of claims 1 to 11, configured to display portions of past surgery for replay.

13. A system (100) for displaying surgical images, A device according to any one of claims 1 to 12, The first display, in particular a touchscreen display (120), The second display (130), Input means, The input means includes an input means configured to assign the results of the content function and / or control function of the device according to any one of claims 1 to 12 based on the information provided by the input means, The input means includes the following, namely, Tactile input means, especially foot switches, Remote control and Microphone and, A system (100) that includes one or more cameras.

14. A method for displaying surgical images, Step, that is, A step of identifying a first camera image (122) and a second camera image (132) based on the camera image of the surgical device (114), A step of identifying one or more graphical user interfaces, GUI(124), in order to control the surgical device and / or to identify the first camera image and / or the second camera image, The steps include simultaneously assigning the first camera image (122) and GUI (124) to a first display (120), particularly a touchscreen display, A method comprising the step of assigning the second camera image (132) and / or GUI to a second display (130).

15. A computer program comprising program code for operating the device according to any one of claims 1 to 12, the system according to claim 13, and / or for carrying out the method according to claim 14, when the computer program is executed on a processor.

Images