Medical visualization system, medical surgical system, method for visualizing a video image data stream

Through the design and introduction of extended video processing modules separately from the central control module and the camera control unit, the problems of large communication costs and difficulty in expansion in the existing system are solved, and efficient image data processing and user-friendly visualization system are realized.

CN120436804APending Publication Date: 2025-08-08SCHOLLY FIBEROPTIC GMBH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202510136080.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-02-08
Filing Date
2025-02-07
Publication Date
2025-08-08

AI Technical Summary

Technical Problem

The existing visualization system consumes a lot of bidirectional communication between the control module and the camera control unit, and it is difficult to modularly expand peripheral devices, affecting the flexibility and efficiency of the system.

Method used

The central control module (CCM) is separated from the camera control unit (CCU), and the indicator image data is transmitted to the monitor through the control connection, and an extended video processing module (AVM) is introduced for post-processing, simplifying the communication path and realizing modular expansion.

Benefits of technology

It improves the flexibility and efficiency of the system, supports DICOM data archiving, and implements advanced visualization functions, such as spatial arrangement of image data and real-time video overlay, simplifies the system architecture and improves the user's operation experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120436804A_ABST
    Figure CN120436804A_ABST
Patent Text Reader

Abstract

The invention relates in general to a new system architecture for a medical visualization system 1, which specifies a central control module ("central control module" = CCM), by means of which a plurality of components 3, 2, 6 and if necessary 23, in particular a camera control unit 3 and if necessary peripheral devices 6, can be controllably accessed, in this way, a central control function can be carried out in the sense of a'surgical cab '. According to the invention, a user can controllably control and regulate all important functions of the visualization system 1 by means of the CCM 4, for example by means of a touch screen 15, the visualization system 1 also being able to modularly extend further components, which can then be newly connected to the CCM 4, respectively.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a medical visualization system comprising at least one camera control unit and a central control module. The camera control unit is configured to read image signals or image data from at least one associated / assigned image recording device (e.g., one or more video cameras) and to generate corresponding processed image data from the corresponding (received) image signals / image data. The central control module allows a user to control access to the at least one camera control unit in order to display the corresponding (processed) image data generated by the corresponding camera control unit on at least one monitor. In other words, the central control module instructs the corresponding camera control unit via a control connection (which can be wireless or via a cable) to output the corresponding processed image data to the associated monitor. However, the central control module does not necessarily receive the actual image data for this purpose; as will be explained more precisely, the central control module does not itself transmit the image data. Furthermore, the system may include at least one such associated image recording device—e.g., in the form of an endoscope, exoscope, or microscope—and / or an associated monitor.

[0002] The present invention further relates to an associated medical surgical system which, in addition to such a visualization system, comprises at least one peripheral device (eg a light source and / or an anesthesia device and / or an insulator and / or a pump and / or a surgical instrument).

[0003] Finally, the present invention also relates to a method for visualizing at least one video image data stream recorded with the aid of at least one image recording device (e.g., an endoscope / exoscope / microscope as described above), wherein the image recording device can be part of a visualization system according to the present invention. In this method, processed image data can be generated from the image signals or image data of the at least one image recording device within the scope of preprocessing by means of at least one camera control unit. The processed image data ("processed image data") or the extended image data ("advanced image data") generated therefrom can then be displayed on a monitor in the form of a video image data stream. Background Art

[0004] Such visualization systems, as described above, are already used in surgical procedures, for example, based on video endoscopes as image recording devices. Typically, such systems are equipped with a higher-level controller, often in the form of a separate camera control module (often referred to as a "camera control unit," CCU), so that the user can use this camera control module to influence the imaging according to their wishes and ultimately visualize the recorded image data.

[0005] Documents EP 2 749 201 B1 and EP 3 335 6119 B1 each describe a modular endoscopic video system comprising one or more cameras, which are read by corresponding "input modules" in order to generate image data. The video system also includes a higher-level control module ("control module"), which can control access to the corresponding "input module". The higher-level control module receives the image data, processes it further, and finally forwards it to a monitor for display. The main disadvantage of this system is the complex bidirectional communication between the control module and the corresponding "input module", because the two communication partners must first be unified on a common standard for transmitting image data. In particular, a so-called "module identifier" must be transmitted to the "control module" for this purpose. Summary of the Invention

[0006] Based on this, the object of the present invention is to propose a system architecture that allows for simple adaptability of the visualization system to customer requirements and thereby overcomes previously known disadvantages of previous systems. In particular, this system architecture should make it possible to use existing components as part of the visualization system, while also being able to modularly expand the visualization system with new peripherals at any time, as required by the application.

[0007] To achieve this object, the features according to claim 1 are provided.

[0008] In particular, to achieve the aforementioned object, a visualization system is proposed, which is characterized in that, within the scope of a central control function, the central control module can instruct the at least one camera control unit via a corresponding control connection to transmit image data to a monitor. In other words, the central control module is configured to instruct the respective camera control unit via the corresponding control connection to transmit image data to the monitor, which image data the respective camera control unit has already received from the image recording device assigned to it and subsequently processed.

[0009] As will be explained in more detail, in this transmission another module can receive the already processed image data from the camera control unit and process them further (e.g. as “advanced image data”) and then finally output the further processed image data in the form of a video image data stream to a monitor.

[0010] Unlike previously known approaches—for example, those described in EP 2 749 201 B1 and EP 3 3356 119 B1—in the solution according to the present invention, the corresponding video image data streams are not output by a higher-level control module, but by the corresponding camera control unit (CCU) itself to the corresponding display / monitor for visualization. This can occur via another (non-central) module, such as a module for extended video image processing (AVM). Nevertheless, the central control module according to the present invention performs central control within the visualization system and thus serves as the system's master, directing the other components acting as slaves. However, the central control module according to the present invention does not output any image data to the monitor.

[0011] The central control module and the corresponding camera control units are preferably each designed as a separate structural unit, because in this way the overall system can be adapted, in particular scaled, to customer requirements in a modular and very simple manner.

[0012] The visualization system according to the invention is therefore characterized by a defined system architecture, which is itself characterized in that a central control module (also referred to herein as "central control module = CCM") is provided as a separate structural unit, which performs central control and acts in this control manner on at least one camera control unit (CCU).

[0013] The corresponding CCU can be designed as a structural unit separate from the CCM, for example if a CCU is already present. The corresponding CCU reads the image signal or image data already provided by the camera from at least one associated camera and further processes it accordingly to form processed image data. The at least one image recording device mentioned above as part of the visualization system can thus be a camera, in particular a video camera.

[0014] The visualization system according to the present invention can provide users with network-based functions such as DICOM (Digital Imaging and Communications in Medicine) and / or central control functions and / or functions such as the automatic creation of worklists (automated worklists). Therefore, the CCM according to the present invention can significantly improve the overall system's availability for users. This is particularly relevant in medical applications, where archiving requirements are becoming increasingly stringent. Consequently, there is a need to archive video image data recorded using visualization systems in the form of so-called DICOM database objects. DICOM standardizes not only the format for storing data but also the communication protocol for exchanging it, for example, within a hospital's computer network. The DICOM standard is already used in imaging or image processing systems such as digital X-rays, MRI (Magnetic Resonance Imaging), CT (Computed Tomography), or ultrasound products. DICOM also often forms the basis for digital image archiving in hospitals using so-called PACS (Picture Archiving and Communication Systems).

[0015] Therefore, it can be provided that the central control module is designed such that it can access the external server at least indirectly (i.e., in particular via another component of the visualization system) in order to archive the DICOM objects and the video image data recorded therefrom on the server. However, the central control module itself does not necessarily have to receive or process the image data, but rather the central control module (CCM) can instruct, for example, the system's CCU or other system components downstream of the central control module to generate DICOM objects and transmit them to the external instance (or be configured for this purpose).

[0016] In such a design, communication between the CCM and the corresponding CCU can be designed to be bidirectional. In this case, however, network data, not image data, is exchanged between the CCM and the corresponding CCU, while image and / or video files can be transmitted to the CCM via the network, for example, via a separate transmission path (in which the CCU does not participate). In such a design, real-time data, in particular, does not need to be exchanged between the CCM and the corresponding CCU, as in previously known designs. This significantly simplifies the system architecture. Unlike previously known designs, bidirectional communication between the CCM and CCU is therefore limited to network data and does not extend to supporting real-time video or image data.

[0017] The visualization system according to the present invention may also include a module for extended video processing, in particular in the form of an "advanced video processing module" (AVM). The AVM can receive pre-processed image data from the corresponding CCU and supply it to a subsequent video processing or perform such a subsequent video processing. The subsequent video processing performed by the AVM can generate extended image data ("advanced image data"). This extended image data can then be output by the AVM to the corresponding display unit / monitor in order to achieve extended visualization ("advanced visualization").

[0018] As will be explained below, "advanced image data" may be understood in particular to mean image data that should / must be visualized with the aid of geometric scaling of the video image and user-specific spatial arrangement / visualization of the image data, for example, as "side by side," PiP ("Picture in Picture"), PoP ("Picture outside Picture"), or with the aid of "window throwing" (this is understood to mean manual movement of the corresponding window back and forth, as in conventional office software applications). Such "advanced visualization" may also be understood to mean the calculation of different video signals or video channels, for example, in order to achieve a specific desired display (for example, in "hyperspectral imaging" applications).

[0019] Overlay technology is also important: for example, in the case of fluorescence imaging, the infrared signal as an overlay on the video image.

[0020] Such downstream video processing can therefore include, for example, scaling and / or spatial arrangement of at least two video image data streams provided by different CCUs of the system, or (almost any) calculations of such different video image data streams. The video image data streams can preferably be transmitted by the respective CCU to the AVM by means of video signals.

[0021] AVM can in particular realize "advanced imaging" functions, such as superimposing multiple real-time video images to form an artificial overall image and / or enhancing video images with additional objects and / or additional information ("augmented images").

[0022] The visualization system according to the invention can therefore also be characterized in that the CCM acts on a corresponding CCU of at least two different CCUs in a controlled manner via at least two different control paths. Naturally, the CCM according to the invention can also be used meaningfully in conjunction with only one CCU. By means of the proposed control method, the CCM can respectively trigger and / or control a specific signal processing in the corresponding CCU, for example in order to generate a corresponding image data stream (preferably in the form of a video image data stream). Such a (video) image data stream ("processed image data i") can then be supplied to the AVM, wherein the CCM can also (for example via path "iv" see also for this purpose) Figure 3 ) acts on the AVM in a controlled manner.

[0023] Each of the CCUs used in the system can have its own processor, which is provided for processing the image signals of the respectively associated image recording device / camera.

[0024] Furthermore, the AVM can also have its own processor and associated software, wherein the processor of the AVM is configured to process different video image data streams (transmitted / input by the corresponding CCU) and thereby generate at least one extended image data stream, preferably in the form of a real-time video image data stream.

[0025] The CCM can also have its own input unit and its own display device (ideally even in the form of a touchscreen in combination). In this way, the CCM can display various information to the user, which is required, for example, to make desired settings, and the user can also enter control commands into the CCM via the input unit / touchscreen, so that the CCM generates the corresponding control commands. In other words, the user can thus execute / implement central control functions within the visualization system via the CCM and thereby access (if necessary all) components of the system in a controlled manner.

[0026] The above-described medical visualization system can be further developed as follows, as can be seen from the dependent claims:

[0027] For example, the central control module can be configured to control and regulate access to the at least one camera control unit and to at least one peripheral device via a local area network. To this end, a plurality of corresponding bidirectional control connections, in particular, can be formed between the central control module of the visualization system and the other devices in the network.

[0028] Furthermore, the central control module is preferably not configured to receive image data, as this significantly simplifies communication within the system. Instead, the central control module can be configured to merely control and regulate the flow of image data (particularly in the form of video image data streams) between the various components of the visualization system. This control can, in particular, include specifying the clock frequency of the corresponding video image data stream to be output and / or the format of the video image data to be output.

[0029] Furthermore, the central control module is preferably configured to query parameters of the at least one camera control unit and / or the at least one peripheral device via a corresponding direct control connection; ie in particular without detouring through other devices during this query.

[0030] The central control module can furthermore be configured to provide, within the scope of a gateway function, the at least one camera control unit and / or the at least one peripheral device with: Internet access and / or access to a local database, in particular a server and / or access to a cloud service (i.e. a server that is accessible only via the Internet). In this way, the central control module can enable communication between such an external instance (Internet / cloud / database) and the corresponding device / camera control unit, i.e. in particular without the corresponding device having to communicate bidirectionally with the external instance (e.g. a database or cloud). It can also be provided that, for example, one of the corresponding camera control units or peripheral devices can itself transmit data, in particular image data, via an additional data connection (see for this purpose). Figure 3 , path i) is sent to an external instance, wherein the sending is preferably also performed in response to an instruction by the central control module.

[0031] The central control module can also be configured to provide the user of the visualization system with network-based functions, such as DICOM (Digital Imaging and Communications in Medicine), and / or central control functions for the visualization system, and / or at least one auxiliary function, such as automatic creation of worklists. In such an implementation, it is then preferred that the user can operate the function(s) via a user interface of the central control module (which can in particular be an input unit, such as a touch screen).

[0032] The central control module can therefore have its own input unit and / or its own display device in order to implement the central control functions described above. In particular, for example, a user can control access to the at least one camera control unit (i.e., in particular to a plurality of differently designed camera control units with respectively equivalent control commands) via the input unit.

[0033] Furthermore, provision can be made for at least one external information item acquired by the camera control unit and / or a peripheral device connected to the control module to be displayed on the display device. Such information can include, for example, the operating status or operating parameters of the peripheral device connected to the control module; vital data of the patient; the pressure measured at the insulator (connected as a peripheral device to the CCM) or the pump pressure (such information can be critical, as a determined pressure can pose a risk to the patient); or, for example, the current setting of a high-frequency surgical instrument used to cut tissue. This design significantly improves the usability of the overall system, as the user can, as desired, display important information from the peripherals of the visualization system on the display device of the control module.

[0034] Furthermore, the CCM and the display device can be designed so that peripheral devices such as pumps and / or inflators can be controlled via the CCM, in particular to enable specific pressures to be specified. This also applies to controlling high-frequency surgical instruments, as high-frequency operating parameters can be easily specified in this way.

[0035] The visualization system according to the present invention may also include a module that is configured for extended video processing ("advanced video processing module" = AVM). This module / AVM can then be configured to receive pre-processed image data from the at least one camera control unit and generate extended image data therefrom by means of downstream video processing. The module for extended video processing can also output the extended image data directly to a connected monitor.

[0036] It is particularly preferred here if the module for extended video processing (AVM) is designed as a structural unit separate from the central control module.

[0037] Furthermore, the central control module (CCM) can access the module for extended video processing (AVM) via a control connection in a controlled manner so that control functions can also be performed there. The image data can then be transmitted from the camera control unit to the (corresponding) monitor, in particular, via the AVM, i.e., preferably without the corresponding image data being transmitted via / to the central control module.

[0038] The module for extended video processing (AVM) can also be configured to receive multiple video image data streams, in particular video image data streams in the form of video signals, from a configured camera control unit of the visualization system (i.e. from at least two such camera control units) and to calculate and / or scale these received video image data streams with respect to one another and / or to predetermine the spatial arrangement of at least two of the received video image data streams.

[0039] The AVM may also be configured to overlay a plurality of real-time video images and / or enhance at least one real-time video image data stream with additional objects and / or additional information.

[0040] As described above, to achieve this object, a medical surgical system according to claim 9 is also proposed. It is provided that the at least one peripheral device of the surgical system (which can be designed as described above) can be read and / or controlled via the central control module, i.e., can be operated, in particular, by a person. Such reading / control / operation can be performed, in particular, by means of an input unit and / or display device of the central control module. This can be particularly advantageously achieved, for example, by means of a touch screen, which can be used to both input and display data / parameters.

[0041] Furthermore, it should be mentioned that the medical surgical system can naturally include a medical visualization system as described above and / or according to the claims directed to such a visualization system.

[0042] To achieve this object, a method for visualizing at least one video image data stream according to claim 10 is also proposed. In particular, in a method of the type mentioned at the outset, within the scope of a central control function, a central control module (which can be designed as described above) instructs at least one camera control unit (which can be one or more devices) via corresponding control connections to transmit the processed image data to a monitor. "Instruct" in this context is to be understood as meaning that the video image data is forwarded by the camera control unit in response to and in accordance with a control signal, which the central control module sends to the corresponding camera control unit.

[0043] This method can be further improved as follows:

[0044] For example, the aforementioned extended image data can be generated within the scope of downstream video processing using a module for extended video processing (AVM—which can be designed as described above). The extended image data generated in this manner can then be transmitted by the module for extended video processing (AVM) to a monitor, on which the video image data stream is to be displayed. In particular, via a control connection, the central control module can control and / or adapt the transmission and / or downstream video processing (particularly according to user preferences / input commands). In other words, the type and method of control of the downstream video processing can be centrally controlled by the user via the central control module using the module for extended video processing and, for example, adapted to their current preferences.

[0045] During the visualization of the image data or extended image data, access to the at least one camera control unit and / or modules for extended video processing can be controlled via / through the central control module, preferably taking into account external information provided by peripheral devices. This external information can, for example, be displayed to the user on a display device of the central control module. Such external information may be necessary, for example, if so-called "case data" is to be processed on the CCM, i.e., if "worklists" are obtained from an external instance (e.g., from KIS (online)). Offline scenarios are also possible, such as manual creation of worklists and / or manual compilation of patient "case data." All such operations, in particular storage and / or archiving of "case data" and deletion of data on the CCU, can be performed using the CCM, if the CCM is equipped for this purpose.

[0046] The method may also provide for controlled access to peripheral devices connected to the central control module (via a cable or by means of a radio connection). In this way, in particular, the imaging performed by the at least one image capturing device can be influenced, for example, if the peripheral device provides illumination or excitation light for the imaging.

[0047] In other words, the central control module (CCM) can be used as a "surgical cockpit" and display important parameters of peripheral devices to the user. However, the user can also control, for example, the light source via the central control module, which is used for imaging with the corresponding image recording device of the visualization system.

[0048] The invention will now be further described with reference to various exemplary embodiments, but without being restricted to these. Further configurations of the invention can be derived from the following description of preferred exemplary embodiments in conjunction with the general description, the claims and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In the following description of different preferred embodiments of the present invention, elements that are identical in their function also receive identical reference numerals in different designs or configurations.

[0050] Figure 1 Shows a visualization system as already applied in the prior art;

[0051] Figure 2 A first visualization system designed according to the present invention is shown;

[0052] Figure 3 A second visualization system is shown, also designed according to the present invention; and

[0053] Figure 4 A typical application scenario is shown, in which the visualization system according to the invention, in particular as in Figure 2 or Figure 3 Shown in - can be used as part of a surgical system. DETAILED DESCRIPTION

[0054] Figure 1 A visualization system 1 known from the prior art is shown, which includes an image recording device 2 in the form of a video camera, which generates (unprocessed) image data 20 and forwards it to a camera control unit 3 ("camera control unit" = CCU). The CCU 3 has its own processor 14 and associated software 13 for further processing the image data stream 20 input by the image recording device 2. In this way, the CCU 3 can output two different image data streams of respectively processed image data 12a, 12b in the form of corresponding video signals 21 to correspondingly assigned monitors 10a, 10b, so that the two video image data streams can be displayed on the corresponding monitors 10a, 10b.

[0055] Figure 2 The system architecture of a first medical visualization system 1 according to the present invention is shown. The previously described configuration with an image recording device 2 is also visible, which forwards a stream of unprocessed image data 20 to a CCU 3 for further image processing. The CCU 3 outputs two different image data streams 12a, 12b, each consisting of independently processed image data, to respective monitors 10a, 10b. However, the system 1 also includes a central control module 4, which is connected via a plurality of control connections 11 not only to a single camera control unit 3 but also to a plurality of peripheral devices 6a, 6b, 6c, to a display device 9 in the form of a touchscreen 15, and, via path ii), to an external server 23.

[0056] Within the scope of the central control function, the central control module 4 instructs the CCU 3 via path v) to process the received unprocessed image data 20 and transmit it to the corresponding monitors 10a, 10b in the form of processed image data 12a, 12b. Figure 2 As can be clearly seen, the processed image data 12 does not reach the central control module (CCM) 4, however, since it is not involved in the transmission of the processed image data 12. Instead, the CCM 4 controls and regulates this transmission solely via a control connection 11v. The entirety of the control connections 11, each designed as a bidirectional data connection—in each case between the central control module CCM ("central control module") 4 and the corresponding connection partner—forms a local network 16, via which the CCM 4 has controllable and regulated access to the CCU 3, the peripheral devices 6a, 6b, and 6c, and the external server 23. In this way, the CCM 4 can query, for example, parameters of the CCU 3 or one of the peripheral devices 6 without having to bypass another device, i.e., via the corresponding direct control connection 11.

[0057] According to the reference numeral 25 , which symbolically represents the separation between the local network 16 and external instances, such as a server 23 or the Internet, it can also be understood that the CCM 4 assumes a gateway function: this is because via the control connection 11ii) the CCM 4 can provide one of the peripheral devices 6 with access to the server 23 or to the Internet, for example in order to carry out a software update of the corresponding system component.

[0058] However, the CCM 4 can also implement network-based functions. For example, in addition to the central control function, the CCM 4 can also exchange DICOM objects with the server 23 via the control connection 11. In addition, the CCM 4 can also instruct the CCU 3 to transmit image data via the additional data connection 26 (in the control connection 11v). Figure 2 dotted line in FIG)—which is not part of the network 16—is transmitted to the server 23 (path i)).

[0059] Alternatively, a local area network can be formed using the CCM, through which the CCM can communicate with all other networked devices (CCUs and peripherals). The CCM can also establish a connection to a higher-level (e.g., hospital) network. In such an architecture, terminals, particularly individual CCUs, do not need to output data to the PACS. Consequently, the previously described connection i) can be omitted. In this approach, only a connection to the higher-level (hospital) network / to the PACS exists, thus achieving a cost-effective architecture.

[0060] CCM 4, based on touch screen 15, also has the ability to receive input commands from the user and convert them into corresponding control signals, for example, to control one of peripheral devices 6. In this way, the user can centrally control and operate, via CCM 4, a corresponding peripheral device 6, such as a light source or a surgical instrument. Furthermore, the user can have the operating parameters and / or status of the corresponding peripheral device 6 displayed on display device 9. In other words, touch screen 15 serves as a "surgical operating room" through which the user can centrally control and adjust all relevant functions of visualization system 1.

[0061] Figure 3 A further visualization system 1 according to the invention is shown, which is essentially similar to Figure 2 The difference from the previous example is that here there are now two image recording devices 2a and 2b, which are each read by an associated CCU 3a, 3b. Figure 3 In the example of FIG, there is again a corresponding control connection 11v), via which the CCM 4 can control the two CCUs 3a, 3b and communicate bidirectionally with them. Figure 2 In the previous example, however, the processed image data 12a and 12b provided by the two camera control units 3a, 3b are not output directly to a monitor, but are forwarded in the form of corresponding video signals 21 to a module for extended video processing ("advanced video processing module" = AVM) 5.

[0062] Furthermore, the AVM 5 is centrally controlled by the CCM 4 via a control connection 11iv). For example, the user can specify via the touch screen 15 the manner in which the AVM 5 is to process the respective video signals 21 in order to thereby generate expanded image data 27 and output it to the respective monitors 10a, 10b in the form of a real-time video image data stream 21. Furthermore, the CCM 4 can communicatively instruct the AVM 5 to spatially arrange the received video image data streams 12a, 12b in a specific manner and, if necessary, to augment them with additional information, thereby providing the user with an expanded view ("augmented view") of the surgical scenario.

[0063] Figure 4 It shows how the visualization system 1 designed according to the invention can be used in a surgical operation which is performed using a surgical system 7 comprising a surgical robot with a movable robot arm 18. Figure 4As can be seen in FIG, the head of a patient 19 is visualized / observed by means of a visualization system 1, which can be moved in space by means of a movable robot arm 18, wherein a real-time video image of the operating area can be displayed to the neurosurgeon on the illustrated monitor 10. The neurosurgeon can transmit control commands via a touch screen 15 to the CCM 4, which converts the control commands into corresponding control signals and transmits the control signals via corresponding control connections 11 (e.g., Figure 2 and 3 ) are transmitted to further components 3, 2, 6 and, if necessary, 23 of the visualization system.

[0064] Finally, it should be mentioned that Figure 3 The CCM 4 shown in FIG. 1 implements the method according to claim 10 , in that the CCM 4 instructs the two CCUs 3 a, 3 b within the scope of the central control function via the control connection 11 v) to transmit the processed image data 12 a to the corresponding monitors 10 a, 10 b, wherein the transmission is effected transitively via the AVM 5, as previously described according to Figure 3 As described.

[0065] In summary, a novel modular system architecture for a medical visualization system 1 is proposed, which provides for a central control module 4, with which a large number of components 3, 2, 6 and, if necessary, 23, in particular the camera control unit 3 and, if necessary, the peripheral devices 6, can be accessed in a controlled manner, so that central control functions can be implemented in the sense of a "surgical operating room". By means of the CCM 4, a user can control all important functions of the visualization system 1 in a controlled manner, for example, by means of a touch screen 15, wherein the visualization system 1 can be expanded in a modular manner by further components, which can then each be newly connected to the CCM 4 (see Figure 3 ). The architecture is therefore based on a central control module (4), which enables the central control function to be implemented. The visualization system 1 can be designed in particular as a real-time video system.

[0066] Reference Signs List

[0067] 1Visualization system

[0068] 2. Image capture device (especially designed as a video camera)

[0069] 3 Camera control unit (CCU; used to read and / or control 2)

[0070] 4Central Control Module (CCM)

[0071] 5. Advanced Video Processing Module (AVM)

[0072] 6. Peripheral equipment (anesthesia equipment, inflators, pumps, surgical instruments, light sources, etc.)

[0073] 7 surgical system (including 1 and at least one 6)

[0074] 8 input units (4 of 4)

[0075] 9 display devices (4)

[0076] 10 Monitor (used to display real-time video image data stream, the real-time video image data stream is recorded by 2)

[0077] 11 Control connection (enabling control and preferably bidirectional communication between connection partners, such as 4 / 3 or 4 / 5 or 4 / 6 or 4 / 23)

[0078] 12Processed image data

[0079] 13 Software

[0080] 14 processors

[0081] 15 touch screen

[0082] 16 Local area network (such as LAN)

[0083] 17. Surgical Robot

[0084] 18 movable robot arms

[0085] 19 patients

[0086] 20 (unprocessed) image data

[0087] 21 Video signal / video image data stream

[0088] 22 User Interface

[0089] 23 servers

[0090] 24 database objects (e.g. DICOM objects)

[0091] 25 Gateway (=interface to the Internet / external or local area network / database)

[0092] 26 additional data connections (e.g. between 3 and 23), not part of 16

[0093] 27 Extended image data (Advanced image data)

Claims

1. Medical visualization system (1), including: at least one camera control unit (3) configured to read image signals or image data (20) of at least one associated image recording device (2) and to generate corresponding processed image data (12) from the corresponding image signals / image data (20), and a central control module (4) through which a user can controllably access the at least one camera control unit (3) in order to display the processed image data (12) on at least one monitor (10), characterized in that - within the scope of a central control function, the central control module (4) can instruct the at least one camera control unit (3) via a corresponding control connection (11) to transmit the processed image data (12) to a monitor (10), Preferably, the processed image data (12) do not reach the central control module (4).

2. The visualization system (1) according to claim 1, wherein The central control module (4) is configured to control and regulate access to the at least one camera control unit (3) and to at least one peripheral device (6) via a local area network (16), - in particular access to light sources and / or anesthesia equipment and / or insulators and / or pumps and / or surgical instruments, In particular, for this purpose, a plurality of corresponding bidirectional control connections (11) are formed in the network (16) between the central control module (4) of the visualization system (1) and the further devices (2, 3, 5, 6, 7). - preferably, the central control module (4) is not configured to receive image data, but only to control and regulate the flow of image data between the various components of the visualization system (1), and / or Preferably, the central control module (4) is configured to query parameters of the at least one camera control unit (3) and / or the at least one peripheral device (6) via corresponding direct control connections (11), in particular without detours through other devices.

3. The visualization system (1) according to claim 1, wherein: The central control module (4) is configured within the scope of a gateway function to provide: - Internet access, and / or - access to local databases, and / or -Access to cloud services.

4. The visualization system (1) according to one of the preceding claims, wherein: The central control module (4) is configured to provide a user of the visualization system (1) with: - Web-based functionality, such as DICOM (Digital Imaging and Communications in Medicine), and / or - a central control function (central control) for the visualization system (1), and / or at least one auxiliary function, such as automatic creation of a task list (automated task list), In particular, the user can operate the function(s) via the user interface (22), in particular the input unit (8), such as the touch screen (15), of the central control module (4).

5. The visualization system (1) according to one of the preceding claims, wherein The central control module (4) has its own input unit (8) and / or its own display device (9) so as to realize the central control function. - in particular so that a user can access the at least one camera control unit (3) in a controlled manner via an input unit, and / or - at least one external information item obtained by the camera control unit (3) and / or by a peripheral device (6) connected to the control module (4) can be displayed on a display device (9).

6. The visualization system (1) according to one of the preceding claims, comprising: a module for extended video processing (Advanced Video Processing Module = AVM-5), which is configured to receive pre-processed image data from the at least one camera control unit (3) and to generate extended image data (advanced image data) therefrom by means of subsequent video processing, preferably outputting the extended image data directly to the at least one monitor (10), - Particularly preferably, the module (5) for extended video processing is designed as a structural unit separate from the central control module (4), and / or The central control module (4) has controllable access to the module (5) for extended video processing via a control connection (11).

7. The visualization system (1) according to one of the preceding claims, wherein: The module (5) for extended video processing is configured to receive a plurality of video image data streams, in particular in the form of video signals (21), from a camera control unit (3) configured in the visualization system (1) and to process these received video image data streams (12a, 12b) - mutual calculations, and / or - Zoom, and / or - predetermining a spatial arrangement of at least two of said received video image data streams.

8. Visualization system (1) according to one of the two preceding claims, wherein The module (5) for extended video processing is configured to - overlay multiple real-time video images, and / or - enhancing at least one real-time video image data stream (21) with additional objects and / or additional information.

9. A medical surgery system (7), the medical surgery system being configured to perform a medical surgery or a medical examination, the medical surgery system comprising: - a medical visualization system (1) according to one of the preceding claims, and at least one peripheral device (6) which is readable and / or controllable / operable via the central control module (4), In particular, the peripheral device can be read out and / or controlled / operated by means of an input unit (8) and / or a display device (9) of the central control module (4).

10. Method for visualizing at least one video image data stream, which is recorded with at least one image recording device (2), such as an endoscope / exoscope / microscope, preferably of a visualization system (1) according to one of claims 1 to 8, - generating processed image data (12) from the image signal or image data (20) of the at least one image recording device (2) within the scope of preprocessing by means of at least one camera control unit (3), and The processed image data (12) or the expanded image data (27) generated therefrom are displayed on a monitor (10) in the form of a video image data stream, characterized in that - within the scope of a central control function, by means of a central control module (4) via a corresponding control connection (11), instructing the at least one camera control unit (3) to transmit the processed image data (12) to the monitor (10).

11. The method according to any one of the preceding claims, wherein: The extended image data (27) are generated within the scope of downstream video processing by means of a module (5) for extended video processing and transmitted by this module (5) to the monitor (10), in particular, the transmission and / or downstream video processing are controlled and / or adapted by means of a central control module (4) via a control connection (11).

12. The method according to one of the two preceding claims, wherein: During the visualization of the processed image data (12) or the expanded image data (27), the central control module (4) performs: - controlled access to the at least one camera control unit (3) and / or the module (5) for extended video processing taking into account external information from peripheral devices (6), which is displayed on a display device (9) of the central control module (4), and / or - controlled access to peripheral devices (6) connected to the central control module (4), in particular in order thereby to influence the imaging by means of the at least one image recording device (2).

Citation Information

Patent Citations

  • Endoscope system

    CN106455953A

  • Endoscope system and screen projection method thereof

    CN114339183A

  • Image processor applied to endoscope and endoscope system

    CN219331578U

  • Remote medical supporting system

    US20030046562A1

  • Optical adaptor and endoscope device

    US20050014996A1