Medical visualization system, medical operation system and method for visualizing a video image data stream

The medical visualization system addresses adaptability and integration challenges by using a central control module to manage camera control units and an advanced video processing module for extended image processing, resulting in a flexible and efficient visualization system.

DE102024103538B3Active Publication Date: 2025-05-22SCHOLLY FIBEROPTIC GMBH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102024103538
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-02-08
Publication Date
2025-05-22
Estimated Expiration
2044-02-08

AI Technical Summary

Technical Problem

Existing medical visualization systems face challenges in adaptability to customer requirements and efficient integration of existing components with new modular additions, often due to complex bidirectional communication requirements between control modules and input modules.

Method used

A medical visualization system architecture that includes a central control module capable of instructing camera control units to transmit processed image data to monitors, allowing for modular extension and adaptation without the need for complex bidirectional communication, and utilizing an advanced video processing module for extended image processing.

Benefits of technology

The system enables easy adaptation and extension of medical visualization systems to meet customer needs, simplifies communication by limiting bidirectional data exchange to network data, and enhances visualization capabilities through advanced image processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

In summary, a new system architecture for a medical visualization system 1 is proposed, which provides a central control module 4 (CCM) with which numerous components 3, 2, 6, and optionally 23, in particular a camera control unit 3 and optionally peripheral devices 6, can be accessed in a controlling manner in order to thus exercise a central control function in the sense of a "surgical cockpit." With the help of the CCM 4, the user can control and regulate all important functions of the visualization system 1, for example, using a touchscreen 15. The visualization system 1 can also be modularly expanded with additional components, which can then be newly connected to the CCM 4.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a medical visualization system comprising at least one camera control unit and a central control module. The camera control unit is configured to read image signals or image data from at least one associated / assigned image recording device (e.g., one or more video cameras) and to generate respective processed image data from the respective (received) image signals / image data. A user can access the at least one camera control unit via the central control module to display the respective (processed) image data generated by the respective camera control unit on at least one monitor.In other words, the central control module then instructs the respective camera control unit via a control connection (which can be implemented wirelessly or via a cable) to output the respective processed image data to an associated monitor. However, the central control module does not need to receive the actual image data for this purpose, as will be explained in more detail below; i.e., the central control module itself does not transmit any image data. Furthermore, this system can also comprise at least one such associated image recording device, for example in the form of an endoscope, an exoscope, or a microscope, and / or an associated monitor.

[0002] Furthermore, the invention relates to an associated medical surgical system which, in addition to such a visualization system, comprises at least one peripheral device (for example a light source and / or an anesthesia device and / or an insufflator and / or a pump and / or a surgical instrument).

[0003] Finally, the invention also relates to a method for visualizing at least one video image data stream recorded with at least one image recording device (for example, an endoscope / exoscope / microscope as described above), wherein this image recording device can be part of a visualization system according to the invention. In this method, processed image data can be generated from image signals or image data of the at least one image recording device with the aid of at least one camera control unit as part of a pre-processing process. This processed image data, or advanced image data generated therefrom, can then be displayed on a monitor in the form of the video image data stream.

[0004] Visualization systems such as those described above are already in use in surgical procedures, for example, based on a video endoscope as an image recording device. Such a system is typically equipped with a higher-level control system, often in the form of a separate camera control module (often referred to as a "camera control unit" = CCU), allowing the user to use this camera control module to influence the imaging and thus ultimately the visualization of the recorded image data according to their preferences.

[0005] DE 10 2007 031 719 A1 discloses a medical visualization system with a separately designed communication device configured for displaying and inputting information and operating parameters and having a user interface for this purpose. This communication device makes it possible to control a video recording.

[0006] DE 103 49 649 B3 describes a medical visualization system for generating image data that can be annotated with processing notes. The annotated image data is then transmitted to an external image processing unit.

[0007] EP 2 749 201 B1 and EP 3 335 619 B1 each describe a modular endoscopic video system with one or more cameras that are read out by respective "input modules" to generate image data. The video system also comprises a higher-level control module that can access the respective "input module" for control purposes. This higher-level control module receives image data, further processes the received image data, and finally passes it on to a monitor for display. The main disadvantage of this system is the complex bidirectional communication between the control module and the respective "input module", since these two communication partners must first agree on a common standard for transmitting the image data. In particular, so-called "module identifiers" must be transmitted to the "control module" for this purpose.

[0008] Based on this, the object of the invention is to propose a system architecture that enables easy adaptation of the visualization system to customer requirements while overcoming known disadvantages of previous systems. In particular, the system architecture should make it possible to continue using existing components as part of the visualization system, while simultaneously allowing the visualization system to be modularly expanded at any time with new parts or peripherals, if required by the application.

[0009] To achieve this object, the features according to claim 1 are provided.

[0010] In particular, to achieve the aforementioned object, a visualization system as described above is proposed, which is characterized in that, as part of a central control function, the central control module can instruct the at least one camera control unit to transmit the image data to a monitor via a respective control connection. In other words, the central control module is configured to instruct the respective camera control unit via the respective control connection so that it transmits image data, which the respective camera control unit has received from the image recording device assigned to it and subsequently processed, to a monitor.

[0011] As will be explained in more detail, during this transmission, another module can receive the already processed image data from the camera control unit and process it further (for example to “advanced image data”) before this further processed image data is finally output to the monitor in the form of a video image data stream.

[0012] In contrast to previously known approaches, such as those described in EP 2 749 201 B1 and EP 3 335 619 B1, in the solution according to the invention the respective video image data stream is not output by a higher-level control module, but by the respective camera control unit / CCU itself to the respective display / monitor for visualization, whereby this can be done via another (non-central) module, such as a module for extended video image processing (AVM). However, the central control module according to the invention still exercises central control within the visualization system and thus acts as the master of the system, instructing other components as slaves. However, the central control module according to the invention does not output any image data to a monitor.

[0013] The central control module and the respective camera control unit are preferably designed as separate structural units. This allows the overall system to be easily adapted, and especially scaled, to customer requirements.

[0014] A visualization system according to the invention is therefore characterized by a specific system architecture, which in turn is characterized in that a central control module (here also referred to as “central control module = CCM”) is provided as a separate structural unit, which exercises the central control and thereby has a controlling effect on at least one camera control unit (CCU).

[0015] The respective CCU can be designed as a structural unit separate from the CCM, for example, if a CCU is already present. The respective CCU reads image signals or image data already supplied by the camera from at least one associated camera and processes them accordingly to produce processed image data. The at least one image recording device mentioned above as part of the visualization system can thus be implemented as a camera, in particular a video camera.

[0016] A visualization system according to the invention can, for example, offer the user network-based functions such as DICOM ("digital imaging and communications in medicine") and / or a central control function and / or functions such as the automatic creation of worklists ("automated worklists"). With the help of a CCM according to the invention, the benefit of the overall system for the user can thus be significantly increased. This is particularly valuable for medical applications because the documentation requirements there are becoming increasingly stringent, resulting in a need to archive video image data recorded with the visualization system in the form of so-called DICOM database objects. DICOM standardizes both the format for storing the data and the communication protocol for exchanging it, for example within a hospital's computer network.The DICOM standard is already used in products for imaging or image processing systems such as digital X-ray, MRI, CT, or sonography. DICOM also often forms the basis for digital image archiving in hospitals using PACS (picture archiving and communication systems).

[0017] Therefore, the central control module can be designed in such a way that it can implement access to an external server, at least indirectly (i.e., in particular, mediated via another component of the visualization system), in order to archive DICOM objects and the video image data recorded therewith on the server. However, the central control module itself does not necessarily have to receive or process the image data; rather, the central control module (CCM) can, for example, instruct a CCU of the system or another system component subordinate to the central control module to create and transmit DICOM objects to an external instance (or be configured to do so).

[0018] With such a configuration, communication between the CCM and the respective CCU can thus be bidirectional. In such a case, however, network data rather than image data is exchanged between the CCM and the respective CCU, while image and / or video files can be transmitted via the network to the CCM, in particular via a separate transmission path (in which the CCU is not involved). With this approach, in particular, no real-time data needs to be exchanged between the CCM and the respective CCU, as is the case with previously known approaches, which greatly simplifies the system architecture. Unlike previously known approaches, bidirectional communication between the CCM and CCU is thus limited to network data, but does not extend to real-time capable video or image data.

[0019] A visualization system according to the invention can also comprise a module for advanced video processing, in particular in the form of an "advanced video processing module" (AVM). This AVM can receive pre-processed image data from the respective CCU and feed it to downstream video processing or implement such downstream video processing. The downstream video processing performed by the AVM can generate advanced image data. This advanced image data can then be output by the AVM to a corresponding display unit / monitor, thus enabling advanced visualization.

[0020] As explained below, “advanced image data” can be understood in particular as image data that should / must be visualized using the following means: geometric scaling of video images and user-specific spatial arrangement / visualization of the image data, for example as “side-by-side”, PiP (“picture in picture”), PoP (picture out of picture), or by “throwing windows” (this means manually moving the respective window back and forth as in conventional office software applications). Such “advanced visualization” can also be understood as the combination of different video signals or video channels, for example to achieve a specific desired representation (e.g. in “hyperspectral imaging” applications).

[0021] Overlay techniques are also important: For example, an IR signal in fluorescence imaging as an overlay on a video image.

[0022] Such downstream video processing can therefore include, for example, scaling and / or spatial arrangement of at least two video image data streams supplied by different CCUs of the system, or, for example, a (virtually arbitrary) calculation of such different video image data streams. The video image data streams can preferably be transmitted from the respective CCU to the AVM via video signals.

[0023] The AVM can be used to implement advanced imaging functions such as the overlaying of multiple live video images to create an artificial overall image and / or the augmentation of video images (“augmented images”) with additional objects and / or additional information.

[0024] A characteristic of a visualization system according to the invention can thus be, among other things, that the CCM has a controlling effect on a respective one of at least two different CCUs via at least two different control paths. Of course, a CCM according to the invention can also be used effectively with just one CCU. Due to the proposed type of control, the CCM can trigger and / or control a specific signal processing in the respective CCU, for example, to generate a respective image data stream (preferably in the form of a video image data stream). Such a (video) image data stream ("processed image data i") can then be fed to the AVM, whereby here too the CCM (e.g. via a path "iv" - cf. Fig. 3) can have a controlling effect on the AVM.

[0025] Each of the CCUs used in the system can have its own processor, configured to process image signals from the respective associated image recording device / camera.

[0026] The AVM can also have its own processor and associated software, wherein the processor of the AVM is configured to process the different video image data streams (transmitted / incoming from the respective CCU) and to generate at least one extended image data stream therefrom, preferably in the form of a live video image data stream.

[0027] The CCM can also have its own input unit and its own display device (ideally even combined in the form of a touchscreen). This allows the CCM to visualize a wide range of information to the user, for example, information required to configure desired settings. Furthermore, the user can enter control commands into the CCM via the input unit / touchscreen, so that the CCM generates corresponding control commands. In other words, the user can thus exercise / execute a central control function within the visualization system via the CCM and thereby control (possibly all) of the system's components.

[0028] The medical visualization system described above can be further developed as follows, as can be seen from the subclaims: For example, the central control module can be configured to access the at least one camera control unit and at least one peripheral device via a local network in a control and regulation manner. For this purpose, a plurality of respective bidirectional control connections between the central control module and other devices of the visualization system can be configured in the network.

[0029] It is further preferred if the central control module is not configured to receive image data, as this significantly simplifies communication within the system. Rather, the central control module can be configured to merely control the flow of image data (particularly in the form of a video image data stream) between individual components of the visualization system. This control can, in particular, include a specification of the timing at which the respective video image data stream is to be output and / or the video image data format.

[0030] It is further preferred if the central control module is configured to query parameters from the at least one camera control unit and / or from the at least one peripheral device via respective direct control connections; ie, in particular, without a detour via another device being taken for this query.

[0031] The central control module can further be configured to provide, as part of a gateway function, Internet access and / or access to a local database, in particular to a server, and / or access to a cloud service (i.e., a server that is only accessible via the Internet) for the at least one camera control unit and / or for at least one peripheral device. In this way, the central control module can enable communication between such external instances (Internet / Cloud / Database) and the respective device / camera control unit, in particular without the respective device having to communicate bidirectionally with the external instance (e.g., the database or the cloud). It can also be provided that, for example, the respective camera control unit or one of the peripheral devices itself transmits data, in particular image data, via an additional data connection (cf. Fig. 3, path i)) to the external instance, whereby this transmission also preferably takes place in response to an instruction from the central control module.

[0032] The central control module can also be configured to offer network-based functions such as DICOM ("digital imaging and communications in medicine") and / or a central control function for the visualization system and / or at least one auxiliary function, such as the automatic creation of worklists, to a user of the visualization system. In such an implementation, it is preferred if the user can operate this function(s) via a user interface (which can in particular be an input unit such as a touchscreen) of the central control module.

[0033] The central control module can thus have its own input unit and / or its own display device to enable the central control function described above. In particular, a user can, for example, use the input unit to control the at least one camera control unit (i.e., in particular, several differently configured camera control units, each with appropriate control commands).

[0034] It can further be provided that at least one external piece of information obtained from the camera control unit and / or from a peripheral device connected to the control module can be displayed on the display device. Such information can be, for example: an operating state or an operating parameter of a peripheral device connected to the control module; vital data of a patient; a measured pressure on an insufflator (connected to the CCM as a peripheral device) or a pressure of a pump (such information can be critical because above a certain pressure there is a risk to the patient); or, for example, current settings of an HF surgical instrument that is currently being used to cut tissue.Such a design significantly improves the usability of the overall system because it allows the user to display important information from the periphery of the visualization system on the display device of the control module as required.

[0035] Furthermore, the CCM and the display device can be configured so that peripheral devices can be controlled via the CCM, e.g., a pump and / or an insufflator, in particular to specify a specific pressure. The same applies to the control of an HF surgical instrument, as this allows HF operating parameters to be easily specified.

[0036] A visualization system according to the invention can also comprise a module configured for advanced video processing ("advanced video processing module" = AVM). This module / the AVM can thus be configured to receive pre-processed image data from the at least one camera control unit and to generate advanced image data therefrom by means of downstream video processing. The advanced video processing module can also output the advanced image data directly to a connected monitor.

[0037] It is particularly preferred if the module for advanced video processing (AVM) is designed as a structural unit separate from the central control module.

[0038] Furthermore, the central control module (CCM) can access the enhanced video processing module (AVM) via a control connection to perform a control function there as well. The transmission of image data from the camera control unit to the (respective) monitor can thus be mediated via the AVM, preferably without the respective image data being transmitted via / to the central control module.

[0039] The described module for extended video processing (AVM) can also be configured to receive a plurality of video image data streams, in particular in the form of video signals, from assigned camera control units of the visualization system (i.e. from at least two such camera control units) and to calculate and / or scale these received video image data streams with one another and / or to specify a spatial arrangement of at least two of these received video image data streams.

[0040] The AVM may also be configured to overlay multiple live video images and / or augment at least one live video image data stream with additional objects and / or additional information.

[0041] As mentioned at the outset, a medical surgical system according to claim 9 is also proposed to achieve the object. It is provided that the at least one peripheral device of this surgical system (which can be configured as described at the outset) can be read and / or controlled via the central control module, i.e., in particular, can be operated by a human. Such reading / control / operation can be implemented, in particular, using an input unit and / or a display device of the central control module. This is particularly advantageously achieved, for example, with a touchscreen, which can be used both to enter inputs and to display data / parameters.

[0042] It should also be noted that a medical operating system may of course comprise a medical visualization system as described above and / or according to one of the claims directed to such a visualization system.

[0043] To achieve the object, a method for visualizing at least one video image data stream according to claim 10 is further proposed. In particular, in a method of the type mentioned at the outset, it is proposed that, as part of a central control function, with the aid of a central control module (which can be configured as described above) via a respective control connection, the at least one camera control unit (this can be one or more devices) is instructed to transmit the processed image data to the monitor. "Instructing" can be understood here in particular to mean that the forwarding of video image data by the camera control unit takes place in response to and in accordance with a control signal which the central control module sends to the respective camera control unit.

[0044] This procedure can be further developed as follows: For example, the aforementioned enhanced image data can be generated using an enhanced video processing module (AVM - this can be configured as described above) as part of downstream video processing. The enhanced image data thus generated can then be transmitted by this enhanced video processing module (AVM) to the monitor on which the video image data stream is to be displayed. This transmission and / or the downstream video processing can be controlled and / or adapted (particularly according to a user's wishes / input commands) via a control connection using the central control module.In other words, the control of the type of downstream video processing described can be centrally controlled by a user via the central control module using the advanced video processing module and, for example, adapted to his or her current requirements.

[0045] During the described visualization of the image data or the extended image data, the at least one camera control unit and / or the module for extended video processing can be accessed via / mediated by the central control module, preferably taking into account external information supplied by a peripheral device. This external information can, for example, be displayed to a user on a display device of the central control module. Such external information can, for example, be required if so-called "case data" is to be processed on the CCM, for example if "worklists" are obtained from an external instance (e.g. from KIS(online)). There are also possible offline scenarios: For example, the manual creation of a worklist and / or the manual creation of "case data" for a patient.All such operations, in particular saving and / or archiving case data as well as deleting data on a CCU, can be performed with the CCM if it is configured for this purpose.

[0046] The method can further provide for the central control module to control access to a peripheral device connected to the central control module (by cable or via a wireless connection). In this way, imaging can be influenced, in particular, using the at least one image recording device, for example, when the peripheral device provides an illumination light or an excitation light for the imaging.

[0047] In other words, the central control module (CCM) can serve as a "surgical cockpit" and display important parameters of a peripheral device to the user. However, the user can also use the central control module to control, for example, a light source used during imaging with the respective image acquisition device of the visualization system.

[0048] The invention will now be described in more detail using exemplary embodiments, but is not limited to these embodiments. Further developments of the invention can be derived from the following description of a preferred embodiment in conjunction with the general description, the claims, and the drawings.

[0049] In the following description of various preferred embodiments of the invention, elements which correspond in function are given the same reference numbers even if they have a different design or shape.

[0050] It shows: Fig. 1 a visualization system as already used in the state of the art, Fig. 2 a first visualization system designed according to the invention, Fig. 3 a second visualization system also designed according to the invention, and Fig. 4 shows a typical application situation in which a visualization system according to the invention, in particular as shown in Fig. 2 or Fig. 3, can be used as part of an operating system.

[0051] The Fig. Figure 1 shows a prior art visualization system 1 comprising an image recording device 2 in the form of a video camera that generates (unprocessed) image data 20 and transmits it to a camera control unit (CCU) 3. The CCU 3 has its own processor 14 and associated software 13 to further process the image data stream 20 received from the image recording device 2. In this way, the CCU 3 can output two different image data streams of respectively processed image data 12a, 12b in the form of respective video signals 21 to an associated respective monitor 10a, 10b so that these two video image data streams can be displayed on the respective monitor 10a, 10b.

[0052] The Fig. Figure 2 shows a system architecture of a first medical visualization system 1 according to the invention. The previously described structure can also be seen here, with an image recording device 2, which transmits a stream of unprocessed image data 20 to a CCU 3 for further image processing. The CCU 3 outputs two different image data streams 12a, 12b, each consisting of independently processed image data, to the respective monitor 10a, 10b. However, the system 1 additionally comprises a central control module 4, which is connected via numerous control connections 11 not only to the single camera control unit 3, but also to several peripheral devices 6a, 6b, 6c, to a display device 9 in the form of a touchscreen 15, and via path ii) also to an external server 23.

[0053] As part of a central control function, the central control module 4 instructs the CCU 3 via path v) to process the received unprocessed image data 20 and to transmit it in the form of processed image data 12a, 12b to the respective monitor 10a, 10b. As can be seen from the Fig. 2 clearly recognizes, the processed image data 12, however, do not reach the central control module (CCM) 4, since this is not involved in the transmission of the processed image data 12. Rather, the CCM 4 controls and regulates this transmission solely via the control connection 11v). The entirety of the control connections 11, each designed as bidirectional data connections, between the central control module CCM 4 and the respective connection partner, forms a local network 16, via which the CCM 4 can access the CCU 3, the peripheral devices 6a, 6b and 6c as well as the external server 23 in a controlling and regulating manner. In this way, the CCM 4 can, for example, query parameters from the CCU 3 or one of the peripheral devices 6, in each case without detouring via another device, namely via the respective direct control connection 11.

[0054] Based on the reference number 25, which symbolizes the separation between the local network 16 and external instances such as the server 23 or the Internet, it can also be understood that the CCM 4 assumes a gateway function: For example, via the control connection 11 ii), the CCM 4 can provide access to the server 23 or to the Internet for one of the peripheral devices 6, for example in order to carry out a software update of this respective system component.

[0055] The CCM 4 can also implement network-based functions. For example, in addition to the central control function, the CCM 4 can also exchange DICOM objects with the server 23 via the control line 11. Furthermore, the CCM 4 can also instruct the CCU 3 via the control connection 11 v) to transfer image data via the additional data connection 26 (dotted line in Fig. 2), which is not part of the network 16, to the server 23 (path i)).

[0056] Alternatively, a local network can be set up using the CCM, via which the CCM can then communicate with all other devices in the network (CCUs and peripherals). The CCM can also establish a connection to a higher-level network (e.g., a hospital). In such an architecture, end devices, especially the individual CCUs, do not need to transmit data to a PAC. Accordingly, the previously explained connection i) can be omitted. With this approach, there is only one connection to the higher-level (hospital) network / PACS, thus implementing a cost-effective architecture.

[0057] The CCM 4 also has the ability to receive input commands from a user based on a touchscreen 15 and convert them into corresponding control signals, for example to control one of the peripheral devices 6. In this way, the user can, for example, centrally control and operate a light source or a surgical instrument as a respective peripheral device 6 via the CCM 4. The user can also display operating parameters and / or states of the respective peripheral device 6 on the display device 9. In other words, the touchscreen 15 serves as a "surgical cockpit" with which the user can centrally control and regulate all relevant functions of the visualization system 1.

[0058] The Fig. 3 shows a further visualization system 1 according to the invention, which differs essentially from the previous example of Fig. 2 in that two image recording devices 2a and 2b are provided, each of which is read by an associated CCU 3a, 3b. Also in the example of the Fig. 3 there are again respective control connections 11 v) via which the CCM 4 can control the two CCUs 3a, 3b and communicate bidirectionally with them. Unlike the previous example of the Fig. 2, however, the processed image data 12a and 12b supplied by the two camera control units 3a, 3b are not output directly to a monitor, but are transferred in the form of respective video signals 21 to a module for advanced video processing (“advanced video processing module” = AVM) 5.

[0059] The AVM 5 is also centrally controlled by the CCM 4 via the control connection 11 iv). For example, the user can specify via the touchscreen 15 how the AVM 5 should process the respective video signals 21 in order to generate enhanced image data 27 therefrom and output it to the respective monitor 10a, 10b in the form of a live video image data stream 21. Furthermore, the AVM 5 can be instructed via the CCM 4 to spatially arrange the received video image data streams 12a, 12b next to one another in a specific manner and, if necessary, to augment them with additional information in order to offer the user an augmented view of a surgical scene.

[0060] The Fig. Figure 4 shows how a visualization system 1 designed according to the invention can be used in a surgical procedure that is carried out with a surgical system 7, which comprises a surgical robot with a movable robot arm 18. Fig. 4, that the head of the patient 19 is visualized / observed by means of the visualization system 1, which can be moved in space on the movable robot arm 18, wherein a live video image of the surgical area can be displayed to the neurosurgeon on the illustrated monitor 10. Via the touchscreen 15, the neurosurgeon can transmit control commands to the CCM 4, which then converts these into corresponding control signals and transmits these control signals via corresponding control connections 11 (as in Fig. 2 and Fig. 3) to the other components of the visualization system 3, 2, 6 and, if applicable, 23.

[0061] Finally, it should be mentioned that the Fig. 3, the CCM 4 implements a method according to claim 10, since the CCM 4, as part of the central control function, instructs the two CCUs 3a, 3b via the described control connection 11 v) to transmit the processed image data 12 to the respective monitor 10a, 10b, wherein the transmission is mediated via the AVM 5, as previously described with reference to Fig. 3 described.

[0062] In summary, a new modular system architecture for a medical visualization system 1 is proposed, which provides a central control module 4, with which numerous components 3, 2, 6 and optionally 23, in particular a camera control unit 3 and optionally peripheral devices 6, can be accessed in a controlling manner in order to thus be able to exercise a central control function in the sense of a "surgical cockpit". With the help of the CCM 4, the user can control all important functions of the visualization system 1, for example with the help of a touchscreen 15, whereby the visualization system 1 can be modularly expanded with additional components, which can then be newly connected to the CCM 4 (cf. Fig.3). This architecture is thus based on a central control module (4) with which a central control function can be executed. The visualization system 1 can be designed, in particular, as a live video system. List of reference symbols 1 visualization system 2 Image recording device (particularly designed as a video camera) 3 Camera control unit (CCU; for reading and / or controlling 2) 4 central control module (central control module = CCM) 5 Advanced video processing module (AVM) 6 Peripheral devices (anaesthesia machine, insufflator, pump, surgical instrument, light source, etc.) 7 operating system (comprising 1 and at least one 6) 8 input units (of 4) 9 Display device (of 4) 10 Monitor (for displaying a live video stream recorded with 2) 11 Control connection (enables control and, preferably bidirectional, communication between the connection partners, e.g. 4 / 3 or 4 / 5 or 4 / 6 or 4 / 23) 12 processed image data 13 Software 14 processor 15 touchscreen 16 local network (e.g. LAN) 17 surgical robots 18 movable robot arm 19 patients 20 (unprocessed) image data 21 Video signal / video image data stream 22 User interface 23 servers 24 Database object (e.g. DICOM object) 25 Gateway (= interface to Internet / external or local network / database) 26 additional data connection (e.g. between 3 and 23), not part of 16 27 advanced image data

Claims

[1] Medical visualization system (1) comprising: - at least one camera control unit (3) which is configured to read out image signals or image data (20) from at least one associated image recording device (2) and to generate respective processed image data (12) from the respective image signals / image data (20), and - a central control module (4), via which a user can access the at least one camera control unit (3) in a controlling manner in order to display the processed image data (12) on at least one monitor (10), characterized by , - that within the framework of a central control function, with the aid of the central control module (4) via a respective control connection (11), the at least one camera control unit (3) can be instructed to transmit the processed image data (12) to a monitor (10), - preferably without the processed image data (12) reaching the central control module (4). [2] Visualization system (1) according to claim 1, wherein the central control module (4) is configured to control and regulate the at least one camera control unit (3) and at least one peripheral device (6) via a local network (16), - in particular to access a light source and / or an anaesthesia device and / or an insufflator and / or a pump and / or a surgical instrument, in particular wherein for this purpose a plurality of respective bidirectional control connections (11) are formed in the network (16) between the central control module (4) and further devices (2, 3, 5, 6, 7) of the visualization system (1), - preferably wherein the central control module (4) is not configured to receive image data, but merely to control a flow of image data between individual components of the visualization system (1) and / or - preferably wherein the central control module (4) is configured to query parameters from the at least one camera control unit (3) and / or from the at least one peripheral device (6) via respective direct control connections (11), in particular without detours via other devices. [3] Visualization system (1) according to one of the preceding claims, wherein the central control module (4) is configured as part of a gateway function to - Internet access and / or - access to a local database and / or - to provide access to a cloud service for the at least one camera control unit (3) and / or for at least one peripheral device (6). [4] Visualization system (1) according to one of the preceding claims, wherein the central control module (4) is configured to - network-based functions such as DICOM (digital imaging and communications in medicine) and / or - a central control function for the visualization system (1) and / or - to offer at least one auxiliary function, for example an automatic creation of work lists (automated worklists), to a user of the visualization system (1), - in particular wherein a user can operate this function / functions via a user interface (22), in particular an input unit (8) such as a touchscreen (15), of the central control module (4). [5] Visualization system (1) according to one of the preceding claims, wherein the central control module (4) has its own input unit (8) and / or its own display device (9) to enable the central control function, - in particular so that a user can access the at least one camera control unit (3) via the input unit and / or - wherein at least one external information obtained from the camera control unit (3) and / or from a peripheral device (6) connected to the control module (4) can be displayed on the display device (9). [6] Visualization system (1) according to one of the preceding claims, comprising: - a module for advanced video processing (AVM - 5), which is configured to receive pre-processed image data from the at least one camera control unit (3) and to generate advanced image data therefrom by means of downstream video processing, preferably and to output it directly to the at least one monitor (10), - particularly preferred wherein the module for extended video processing (5) is designed as a structural unit separate from the central control module (4) and / or - wherein the central control module (4) can access the module for extended video processing (5) via a control connection (11). [7] Visualization system (1) according to the preceding claim, wherein the module for extended video processing (5) is configured to receive a plurality of video image data streams, in particular in the form of video signals (21), from associated camera control units (3) of the visualization system (1) and to process these received video image data streams (12a, 12b) - to offset against each other and / or - to scale and / or - to specify a spatial arrangement of at least two of the received video image data streams. [8] Visualization system (1) according to one of the two preceding claims, wherein the module for extended video processing (5) is arranged to - to overlay multiple live video images and / or - to augment at least one live video image data stream (21) with additional objects and / or additional information. [9] Medical operating system (7) intended for carrying out a medical procedure or a medical examination, comprising - a medical visualization system (1) according to one of the preceding claims and - at least one peripheral device (6) which can be read and / or controlled / operated via the central control module (4), - in particular with the aid of an input unit (8) and / or a display device (9) of the central control module (4). [10] Method for visualizing at least one video image data stream which is recorded with at least one image recording device (2), for example an endoscope / exoscope / microscope, preferably a visualization system (1) according to one of claims 1 to 8, - wherein processed image data (12) are generated from image signals or image data (20) of the at least one image recording device (2) with the aid of at least one camera control unit (3) as part of a pre-processing process, and - wherein the processed image data (12) or extended image data (27) generated therefrom are displayed on a monitor (10) in the form of the video image data stream, characterized by , - that within the framework of a central control function with the aid of a central control module (4) via a respective control connection (11) the at least one camera control unit (3) is instructed to transmit the processed image data (12) to the monitor (10). [11] Method according to the preceding claim, wherein the extended image data (27) are generated with the aid of a module for extended video processing (5) as part of a downstream video processing and are transmitted from this module (5) to the monitor (10), in particular wherein this transmission and / or the downstream video processing is controlled and / or adapted via a control connection (11) with the aid of the central control module (4). [12] Method according to one of the two preceding claims, wherein during the visualization of the processed image data (12) or the extended image data (27) via the central control module (4) - controlling access to the at least one camera control unit (3) and / or to the module for extended video processing (5) is carried out taking into account external information from a peripheral device (6) which is displayed on a display device (9) of the central control module (4), and / or - a peripheral device (6) connected to the central control module (4) is accessed in a controlling manner, in particular in order to thereby influence imaging with the aid of the at least one image recording device (2).

Citation Information

Patent Citations

  • Communication device for a surgical system and surgical system, in particular an ophthalmic microsurgical system for phaco surgery

    DE102007031719A1

  • Method and apparatus for generating an annotated image in a sterile work area of ​​a medical facility

    DE10349649B3