Apparatus for an optical imaging system, optical imaging system method and computer program

Abstract

Examples relate to an apparatus for an optical imaging system. The apparatus comprises one or more processors and one or more storage devices. The apparatus is configured to obtain surgery data indicative of a surgery being performed or to be performed using the optical imaging system. Further, the apparatus is configured to determine setting data indicative of a setting of a diaphragm of the optical imaging system. The setting data is determined based on the surgery data. The apparatus is further configured to transmit the setting data for adjusting the setting of the diaphragm.

Description

[0001] Apparatus for an Optical Imaging System, Optical Imaging System Method and Computer Program

[0002] Technical field

[0003] Examples relate to an apparatus for an optical imaging system, such as surgical optical imaging system, an optical imaging system, a method, and a computer program.

[0004] Background

[0005] In optical imaging system, a high light power and a high-resolution capability require a large aperture, which is to say a large orifice in respect of the aperture stop, whereas a great depth of focus requires a small aperture, which is to say a small orifice in respect of the aperture stop. In order to increase the depth of focus the aperture must be reduced in size, which however results in a lower resolution capability and a lower level of light power for the optical imaging system. If on the other hand the light power or the resolution capability respectively of the optical imaging system is to be increased, then the aperture is to be enlarged, whereby the depth of focus of the optical imaging system is reduced. A high level of light power and a high-resolution capability are therefore linked to a low depth of focus and vice-versa.

[0006] It is possible for an iris aperture stop to be introduced into the beam path of a microscope. In the case of a stereoscopic operating microscope a so-called double iris aperture stop with a respective iris aperture stop is introduced into the partial beam paths. That iris or double iris aperture stop can be drawn open and closed mechanically so that the aperture which is made available by the aperture stop arrangement can be adjusted. When the aperture of the double iris aperture stop device, that is to say the diameter of the orifices of the irises, is adjusted, that establishes the transmission characteristic of an optical imaging system, that is to say the proportion of the amount of radiation issuing from the optical imaging system in relation to the amount of radiation passing into the microscope, as a function of the magnification factor. However, during use of an optical imaging system multiple parameters besides a magnification factor may affect the performance of the optical imaging system. Thus, there may be a desire for an improved concept for adjusting a setting of a diaphragm. Summary

[0007] This desire is addressed by the subject-matter of the independent claims.

[0008] The concept proposed in the present disclosure is based on the insight, that a setting of a diaphragm can be adjusted based on surgery data. The surgery data may be indicative of a surgery being performed or to be performed. That is, the setting of the diaphragm can be adjusted to an actual or current surgery performed using the optical imaging system.

[0009] Examples provide an apparatus for an optical imaging system. The apparatus comprises one or more processors and one or more storage devices. The apparatus is configured to obtain surgery data indicative of a surgery being performed or to be performed using the optical imaging system. Further, the apparatus is configured to determine setting data indicative of a setting of a diaphragm of the optical imaging system. The setting data is determined based on the surgery data. The apparatus is further configured to transmit the setting data for adjusting the setting of the diaphragm. The surgery data may allow to determine an intended use or a current use of the optical imaging system. The intended use or the current use of the optical imaging system may be specific for a desired or appropriate setting of the diaphragm. Thus, the intended use or the current use may require a specific setting of the diaphragm. That is, the surgery data may indicate the setting of the diaphragm. Therefore, based on the surgery data a user experience and / or a performance of the optical imaging system can be improved. Thus, the setting data determined based on the surgery data may allow adjustment of the setting of the diaphragm according to an intended use or current use. In this way, a setting of the diaphragm can be adjusted in a facilitated way.

[0010] In an example, the surgery data may be indicative of a surgical workflow and / or a surgical workflow sequence of the surgical workflow. The surgical workflow may be an entire surgery, such like retina surgery or cataract surgery. The surgical workflow sequence may be a process step of the entire surgery, such like capsulorhexis guidance, phacoemulsification monitoring, wound closure confirmation. That is, the setting of the diaphragm can be adjusted depending on a surgery performed using the optical imaging system. In this way, the setting of the diaphragm can be adjusted, e.g., automatically, to the intended use or current use of the optical imaging system. In an example, the apparatus may be configured to obtain the surgery data by obtaining microscope data indicative of a setting of the optical imaging system and by determining the surgery data based on the microscope data. For example, the setting of the optical imaging system may be specific for the surgery, e.g., a specific setting parameter may indicate a surgery. Thus, the setting of the diaphragm can be adjusted based on the setting of the optical imaging system, e.g., the setting parameter. This may allow to determine the setting data in a facilitated way.

[0011] In an example, the apparatus may be configured to obtain the surgery data by obtaining sensor data of an optical imaging sensor of the optical imaging system. The sensor data may be indicative of a view of the sample. The apparatus may be configured to obtain the surgery data by determining the surgery data based on the sensor data. That is, the apparatus may perform an analysis of the view of the sample to identify a structure in the view of the sample. For example, the view of the sample may show a retina. In this case, the apparatus can identify the retina and may determine that a retina surgery may be performed. In this way, the surgery data can be determined based on a view of a sample acquired with the optical imaging system. Thus, an adjustment of the setting of the diaphragm can be performed automatically, for example.

[0012] In an example, the apparatus may be configured to obtain the surgery data by receiving user input data indicative of an intention of the user to perform a surgical workflow or a surgical workflow sequence of a surgical workflow and by determining the surgery data based on the user input. The user input may allow to determine the surgery data based on an actual intent of the user. That is, the user can provide information about an intended or actual performed surgical workflow. In this way, the setting of the diaphragm can be adjusted according to an intention of the user.

[0013] In an example, the apparatus may be configured to obtain second surgery data indicative of the surgery being performed and to determine second setting data indicative of a second setting of the diaphragm of the optical imaging system. When the second setting of the diaphragm is different from the setting of the diaphragm, the apparatus may be configured to transmit the second setting data for readjusting the setting of the diaphragm. That is, the apparatus can control the readjustment of the setting of the diaphragm according to a surgi- cal workflow sequence, for example. The setting of the diaphragm may vary during a surgical workflow. Obtaining the second surgery data may allow the apparatus to monitor the setting of the diaphragm with respect to an actual required or appropriate setting of the diaphragm. In this way, the apparatus can automatically readjust the setting of the diaphragm, e.g., during a surgical workflow.

[0014] In an example, the apparatus may be configured to repeatedly obtain microscope data indicative of a setting of the optical imaging system. The apparatus may be further configured to determine when the setting of the optical imaging system has been changed based on the microscope data. When the setting of the optical imaging system has been changed, the apparatus may be configured to obtain the second surgery data by determining based on the determined change of the setting of the optical imaging system. Repeatedly obtaining microscope data may allow to facilitate a determination of a change of the setting of the optical imaging system. In this way, a trigger event for adjusting or readjusting the setting of the diaphragm can be determined. The use of a trigger event may allow to facilitate the (re)adjustment of the setting of the diaphragm.

[0015] In an example, the apparatus may be configured to repeatedly obtain sensor data of an optical imaging sensor of the optical imaging system. The sensor data may be indicative of a view of a sample. Further, the apparatus may be configured to determine when the current surgical workflow sequence of the surgical workflow has been changed based on the sensor data. When the current surgical workflow sequence of the surgical workflow has been changed, the apparatus may be configured to obtain the second surgery data by determining based on the determined change of the current surgical workflow sequence of the surgical workflow. For example, a user of the optical imaging system may have finished a surgical workflow sequence and may change a field of view or a magnification to view a different part of the sample. In this way, a trigger event for adjusting or readjusting the setting of the diaphragm can be determined. Determining the trigger event can be based on the view of the sample.

[0016] In an example, the apparatus may be configured to obtain feedback data indicative of a feedback of the user on the adjusted setting of the diaphragm. Further, the apparatus may be configured to determine adjusted setting data indicative of an adjusted setting of the diaphragm of the optical imaging system based on the feedback data and to transmit the adjust- ed setting data for readjusting the setting of the diaphragm. That is, the user can provide feedback to readjust the setting of the diaphragm. In this way, the setting of the diaphragm can be adjusted to an actual need of the user.

[0017] In an example, the surgery data may be further indicative of an ending of the surgery. The apparatus may be configured to determine when the surgery has ended based on surgery data. Further the apparatus may be configured to generate control data indicative of a termination of a surgical workflow and to transmit the control data for terminating the surgical workflow. In this way, the surgical workflow can be terminated in a facilitated way.

[0018] Examples provide an optical imaging system comprising an apparatus as described above.

[0019] Examples provide a method for an optical imaging system comprising obtaining surgery data indicative of a surgery being performed or to be performed using the optical imaging system. Further, the method comprises determining, based on the surgery data, setting data indicative of a setting of a diaphragm of the optical imaging system. The method further comprises transmitting the setting data for adjusting the setting of the diaphragm.

[0020] Various examples of the present disclosure relate to a corresponding computer program with a program code for performing the above method when the computer program is executed on a processor.

[0021] Short description of the Figures

[0022] Some examples of apparatuses and / or methods will be described in the following by way of example only, and with reference to the accompanying figures, in which

[0023] Figs, la and lb show schematic diagrams of an example of an apparatus for an optical imaging system and of a corresponding optical imaging system comprising the apparatus;

[0024] Fig. 2 shows a flow chart of an example of a method for an optical imaging system;

[0025] Fig. 3 shows a schematic view of a part of an optical imaging sensor comprising a diaphragm; Fig. 4 shows a flow chart of an example of a method for an optical imaging system; and

[0026] Fig. 5 shows a schematic diagram of a system comprising a microscope and a computer system.

[0027] Detailed Description

[0028] Various examples will now be described more fully with reference to the accompanying drawings in which some examples are illustrated. In the figures, the thicknesses of lines, layers and / or regions may be exaggerated for clarity.

[0029] Figs, la and lb show schematic diagrams of an example of an apparatus 130 for an optical imaging system 100 and of a corresponding optical imaging system 100 comprising the apparatus 130. The apparatus 130 is tasked with controlling various aspects of a microscope 120 of the optical imaging system 100, which may be a surgical optical imaging system, and of the entire optical imaging system 100 and / or with processing various types of sensor data of the optical imaging system 100. Consequently, the apparatus 130 may be implemented as a computer system, which interfaces with the various components of the optical imaging system 100, e.g., the sensor 122. The apparatus 130 may be part of the optical imaging system 100. Alternatively, the apparatus 130 may be communicatively coupled to the optical imaging system 100. For example, the apparatus 130 may be a ready-to-use-module, that could be connected to the optical imaging system 100.

[0030] The apparatus 130 comprises, as shown in Fig. la, one or more processors 134 and one or more storage devices 136. Optionally, the apparatus 130 further comprises one or more interfaces 132. The one or more processors 134 are coupled to the one or more storage devices 136 and to the optional one or more interfaces 132. In general, the functionality of the apparatus 130 may be provided by the one or more processors 134 (for determining the setting data), in conjunction with the one or more interfaces 132 (for exchanging information, e.g., transmitting the setting data) and / or with the one or more storage devices 136 (for storing and / or retrieving information). The apparatus 130 is configured to obtain surgery data indicative of a surgery being performed or to be performed using the optical imaging system 100. For example, the surgery data may be obtained by receiving from an input device. Optionally or alternatively, the surgery data may be determined, e.g., based on sensor data. The surgery data is indicative of the surgery being performed or to be performed, e.g., by the user. That is, the surgery data may indicate a usage of the optical imaging system by the user. For example, the surgery data may comprise a surgical workflow specific for a surgery and / or a surgical workflow sequence part of a surgical workflow. The setting of the diaphragm 124 of the optical imaging system 100 may depend on the actual use case of the optical imaging system 100. That is, the setting of the diaphragm 124 can be adjusted according to the surgery being performed or the surgery to be performed.

[0031] Thus, the apparatus 130 is configured to determine setting data indicative of a setting of a diaphragm of the optical imaging system. The setting data is determined based on the surgery data. Determining the setting data based on the surgery data may allow to adjust the setting of the diaphragm 124 with respect to a usage of the optical imaging system 100. For example, the user may perform a retina surgery or a cataract surgery using the optical imaging system 100. The setting of the diaphragm 124 appropriate for a retina surgery may differ from the setting for a cataract surgery. For example, a retina surgery may rely on high light power and high-resolution capability which require a large aperture, which corresponds to a large entrance pupil (i.e., an increased orifice of the diaphragm 124). The entrance pupil may be the virtual image of the diaphragm as seen through the front of a lens of the optical imaging system. In contrast, achieving a greater depth of focus, e.g., as normally prioritized in cataract surgery, necessitates a smaller entrance pupil (i.e., a decreased orifice of the diaphragm 124). In this way, a setting of the diaphragm 124 with respect to the surgery for which the optical imaging system 100 is used or intended to be used can be determined based on the surgery data.

[0032] Further, the apparatus 130 is configured to transmit the setting data for adjusting the setting of the diaphragm 124. For example, the apparatus 130 may transmit the setting data to an actor. The actor may be configured to adjust an orifice of the diaphragm 124. Optionally or alternatively, the apparatus 130 may transmit the setting data to a control unit of the optical imaging system 100. Thus, the control unit can control an adjustment of the setting of the diaphragm 124. Using the surgery data may allow adjustment of the setting of the diaphragm 124 according to the surgery for which the optical imaging system 100 is used or intended to be used. That is, the setting of the diaphragm is not only controlled based on the magnification. Controlling a setting of a diaphragm merely on the magnification of a microscope may not allow to distinguish between different use cases of the optical imaging system. Different types of surgeries may require varying levels of illumination power, depth of view, and resolution capability, even when the optical imaging system operates at the same magnification. Another drawback in adjusting the setting of diaphragm merely on a magnification may be that when the optical imaging system increases a zoom magnification, the depth of view will decrease, and at high zoom magnification, empty magnification may be often encountered. This means that the contrast can be reduced. If the goal is to increase the depth of view intensively, the contrast will be even worse. It is a finding of the inventors, that an adjustment of a setting of the diaphragm 124 can be improved by obtaining surgery data. The surgery data may allow to adjust the setting of the diaphragm 124 with respect to the surgery for which the optical imaging system 100 is used or intended to be used. For instance, retina surgery demands lower illumination power because the optical imaging system works at its sensitivity limit. Therefore, having a large entrance pupil (i.e., an increased orifice of the diaphragm 124) becomes crucial to enhance light power and maintain reasonably good imaging performance. On the other hand, cataract surgery, which already has sufficient light power, prioritizes depth of view. Consequently, reducing the entrance pupil size (i.e., a decreased orifice of the diaphragm 124) is beneficial for increasing the depth of view in cataract surgery. To achieve an improved performance of the optical imaging system 100, the apparatus 130 may determine the setting of the diaphragm 124 (e.g., a size of an entrance pupil for a specific surgery). For example, the apparatus 130 may incorporate a diaphragm size control into settings of the optical imaging system 100 for at least one surgery. In this way, the setting of the diaphragm 124 of the optical imaging system 100 can be adjusted according to a surgery being performed or to be performed.

[0033] For example, the setting of the diaphragm 124, e.g., an orifice of the diaphragm 124 and / or an arrangement of the diaphragm 124, is controlled to improve the performance of the optical imaging system 100 for different surgeries or surgical procedures. Adjusting the setting of the diaphragm 124 may allow to regulate an image quality and / or a depth of field to achieve an improved suitability for a particular surgery, e.g., a surgical application. The proposed concept may be built around two main components - the microscope 120, which comprises the optical components, and the apparatus 130, which may be used to control the optical imaging system 100, process sensor data of the microscope 120, e.g., the optical imaging sensor 122 comprising the diaphragm 124, and / or to generate the setting data.

[0034] In general, a microscope, such as the microscope 120, is an optical instrument that is suitable for examining objects that are too small to be examined by the human eye (alone). For example, a microscope 120 may provide an optical magnification of a sample, such as a sample 110 shown in Fig. la. In modern microscopes, the optical magnification is often provided for a camera or an imaging sensor, such as the optical imaging sensor 122 of the microscope 120. The microscope 120 may further comprise one or more optical magnification components that are used to magnify a view of the sample 110, such as an objective.

[0035] There are a variety of different types of optical imaging systems. If the optical imaging system 100 is used in the medical or biological fields, the sample 110 may be a sample of organic tissue, e.g., arranged within a petri dish or present in a part of a body of a patient. In some examples of the present disclosure, e.g., as shown in Fig. lb, the optical imaging system 100 may be a surgical optical imaging system, e.g., an optical imaging system that is to be used during a surgical procedure, such as an oncological surgical procedure or during tumor surgery. However, the proposed concept may also be applied to other types of microscopy, e.g., microscopy in a laboratory or microscopy for the purpose of material inspection.

[0036] Fig. lb shows a schematic diagram of an example of a surgical optical imaging system 100 comprising the microscope 120 and the apparatus 130. In general, a (surgical) optical imaging system is a system that comprises a microscope 120 and additional components, which are operated together with the microscope 120. In other words, a (surgical) optical imaging system is a system that comprises the microscope 120 and one or more additional components, such as the apparatus 130 (which may be a computer system being adapted to control the microscope 120 and, for example, generate the setting data), an illumination system (which is used to illuminate a sample being imaged by the microscope 120 and can be controlled by the apparatus 130), additional sensors, displays etc. The surgical optical imaging system 100 shown in Fig. lb comprises a number of optional components, such as a base unit 105 (which may comprise the apparatus 130) with a stand, ocular displays 140; 145 that are arranged at the microscope 120, a head-mounted display 180, and a (robotic or manual) arm 160 which holds the microscope 120 in place, and which is coupled to the base unit 105 and to the microscope 120. In general, these optional and non-optional components may be coupled to the apparatus 130, which may be configured to control and / or interact with the respective components.

[0037] In an example, the surgery data may be indicative of a surgical workflow and / or a surgical workflow sequence of the surgical workflow. The surgical workflow may be a series of steps and / or processes that a surgeon follows during a surgery. For example, a surgical workflow may be an abstraction of a surgical procedure. The surgical workflow sequence may be a step or process part of the surgical workflow. For example, multiple surgical workflow sequences may form a surgical workflow. Thus, the surgery data may comprise information about a surgery or a surgical procedure to be performed by a user of the optical imaging system. The information about the surgery or surgical procedure can be used by the apparatus 130 to determine the setting data for adjusting the setting of the diaphragm 124. That is, the setting of the diaphragm 124 can be adjusted based on an actual use case or intended use case of the optical imaging system.

[0038] In an example, the apparatus 130 may be configured to obtain the surgery data by obtaining microscope data indicative of a setting of the optical imaging system 100 and by determining the surgery data based on the microscope data. For example, the optical imaging system 100 may be initialized using a predefined set of parameters. For example, a scene setting of the optical imaging system may be initialized. A scene may be an adjustment of the optical imaging system 100 to adjust the viewing conditions and obtain high-quality microscopic images. That is, a scene may be adapted to a specific surgery and / or to a specific surgery workflow or specific surgery workflow sequence. The microscope data may comprise information about a setting of the scene, for example.

[0039] The microscope data may be obtained by receiving from a control unit of the optical imaging system 100 and / or may be retrieving from a storage device, such like the storage device 136. Obtaining the microscope data may allow to facilitate an adjustment of the setting of the diaphragm 124. For example, a parameter of the optical imaging system 100 may be indicative of a surgery or a surgical procedure. By obtaining information about the parameter the determination of the setting data can be facilitated. In this way, the setting of the diaphragm 124 can be determined in a facilitated way.

[0040] In an example, the apparatus 130 may be configured to obtain the surgery data by obtaining sensor data of an optical imaging sensor 122 of the optical imaging system 100. The sensor data may be indicative of a view of the sample 110. The apparatus 130 may be configured to obtain the surgery data by determining the surgery data based on the sensor data. For example, the apparatus 130 may perform an object or structure recognition on the sample data. That is, the apparatus 130 can be configured to determine an object, a structure and / or a feature in a view of the sample 110. For example, the apparatus 130 can determine a retina or a cataract in the view of the sample 110. Thus, the apparatus 130 can determine the setting data based on the sensor data, e.g., a setting for retina surgery or a setting for cataract surgery. In this way, the apparatus 130 can adjust the setting of the diaphragm 124 according to the sample 110 acquired using the optical imaging system 100.

[0041] For example, the sensor data may be obtained by receiving from a sensor, e.g., an optical imaging sensor 122 of the microscope 120 or from a frame buffer, e.g., part of the optical imaging system 100. Optionally or alternatively, the sensor data may be obtained by measuring by the apparatus 130. For example, the optical imaging sensor 122 may be part of the apparatus 130. Thus, the apparatus 130 may control the optical imaging sensor 122 to measure the sensor data.

[0042] In an example, the apparatus 130 may be configured to obtain the surgery data by receiving user input data indicative of an intention of the user to perform a surgical workflow or a surgical workflow sequence of a surgical workflow and by determining the surgery data based on the user input. The user input may be retrieved from a user input display, e.g., a touch display device, a keyboard, a mouse. Optionally or alternatively, the user input may be retrieved from a storage device, e.g., the storage device 136. The user input may comprise information about a surgery the user intends to perform. That is, the user of the optical imaging system 100 can provide information about an intended use of the optical imaging system 100. In this way, the apparatus 130 can adjust the setting of the diaphragm 124 ac- cording to a need of the user of the optical imaging system 100. Thus, a user experience can be improved.

[0043] In an example, the apparatus 130 may be configured to obtain second surgery data indicative of the surgery being performed and to determine second setting data indicative of a second setting of the diaphragm 124 of the optical imaging system 100. When the second setting of the diaphragm 124 is different from the setting of the diaphragm 124, the apparatus may be configured to transmit the second setting data for readjusting the setting of the diaphragm 124. That is, the second setting data can be used to readjust the setting of the diaphragm 124. For example, during a surgical workflow multiple surgical workflow sequences may be performed by a surgeon. Different surgical workflow sequences may require different settings of the diaphragm 124. The apparatus 130 can monitor the setting of the diaphragm 124. When the determined second setting data differs from the setting data, the setting of the diaphragm 124 can be adjusted. For example, the surgery data may be indicative of a first surgical workflow sequence and the second surgery data may be indicative of a second surgical workflow sequence to be performed after the first surgical workflow sequence. Thus, the apparatus 130 may determine second setting data different from the setting data based on the second surgery data. Therefore, the apparatus 130 may transmit the second setting data for readjusting the setting of the diaphragm 124. In this way, the setting of the diaphragm 124 can be automatically adjusted, e.g., according to a surgical workflow. The second surgery data can be obtained in the same way as the surgery data. For example, the second surgery data may be obtained after the surgery data.

[0044] In an example, the apparatus 130 may be configured to repeatedly obtain microscope data indicative of a setting of the optical imaging system 100. The apparatus 130 may be further configured to determine when the setting of the optical imaging system has been changed based on the microscope data. When the setting of the optical imaging system 100 has been changed, the apparatus 130 may be configured to obtain the second surgery data by determining based on the determined change of the setting of the optical imaging system 100. Repeatedly obtaining the microscope data may allow to easily determine a change of the setting of the optical imaging system 100. The change of the setting of the optical imaging system 100 may be indicative of a needed readjustment of the setting of the diaphragm 124. That is, the change of the setting of the optical imaging system 100 can be interpreted as trigger event to determine the setting of the diaphragm 124. In this way, the readjustment of the setting of the diaphragm 124 can be facilitated.

[0045] In an example, the apparatus 130 may be configured to repeatedly obtain sensor data of an optical imaging sensor 122 of the optical imaging system 100. The sensor data may be indicative of a view of a sample 110. Further, the apparatus 130 may be configured to determine when the current surgical workflow sequence of the surgical workflow has been changed based on the sensor data. When the current surgical workflow sequence of the surgical workflow has been changed, the apparatus 130 may be configured to obtain the second surgery data by determining based on the determined change of the current surgical workflow sequence of the surgical workflow. That is, the apparatus 130 can determine a current surgical workflow sequence based on the sensor data, i.e., on the view of the sample 110. Thus, the view of the sample 110 can be used to determine a change in the setting of the optical imaging system 100. For example, the setting of the optical imaging system 100 may be changed and thus the view of the sample 110 may be changed, too. Therefore, the sensor data can be used to determine a change in the setting of the optical imaging system 100 in a facilitated way.

[0046] In an example, the apparatus 130 may be configured to obtain feedback data indicative of a feedback of the user on the adjusted setting of the diaphragm 124. Further, the apparatus 130 may be configured to determine adjusted setting data indicative of an adjusted setting of the diaphragm 124 of the optical imaging system 100 based on the feedback data and to transmit the adjusted setting data for readjusting the setting of the diaphragm 124. For example, the feedback data may be obtained (e.g., received or read out) from the optical imaging system 100 or an input device and / or an external storage device. The feedback data may be obtained by receiving the feedback data from the optical imaging system or an input device (e.g., via the interface 132), by reading the feedback data out from a memory of the optical imaging system or an input device (e.g., via the interface 132), or by reading the feedback data from a storage device 136 of the apparatus 130, e.g., after the feedback data has been written to the storage device 136 by the optical imaging system 100 or by another system or processor (such like an input device), e.g., comprising an external storage device. The feedback data can be used to adjust the setting of the diaphragm 124 according to a desire of a user of the optical imaging system 100. In this way, a user experience can be improved. In an example, the surgery data may be further indicative of an ending of the surgery. The apparatus 130 may be configured to determine when the surgery has ended based on surgery data. Further the apparatus 130 may be configured to generate control data indicative of a termination of a surgical workflow and to transmit the control data for terminating the surgical workflow. In this way, the surgical workflow can be terminated in a facilitated way. For example, the apparatus 130 may transmit the control data to a control unit of the optical imaging system 100. Thus, the control unit can control a termination of the surgery or a surgical workflow. Alternatively, the apparatus 130 may control a termination of a usage of the optical imaging system 100. That is, the apparatus 130 may control a termination of a surgery or a surgical workflow.

[0047] As shown in Fig. la the optional one or more interfaces 132 is coupled to the respective one or more processors 134 at the apparatus 130. In examples the one or more processors 134 may be implemented using one or more processing units, one or more processing devices, any means for processing, such as a processor, a computer or a programmable hardware component being operable with accordingly adapted software. Similar, the described functions of the one or more processors 134 may as well be implemented in software, which is then executed on one or more programmable hardware components. Such hardware components may comprise a general-purpose processor, a Digital Signal Processor (DSP), a microcontroller, etc. The one or more processors 134 is capable of controlling the one or more interfaces 132, so that any data transfer that occurs over the one or more interfaces 132 and / or any interaction in which the one or more interfaces 132 may be involved may be controlled by the one or more processors 134.

[0048] In an embodiment the apparatus 130 may comprise a memory, e.g., the one or more storage devices 136 and at least one or more processors 134 operably coupled to the memory and configured to perform the method described below.

[0049] In examples the one or more interfaces 132 may correspond to any means for obtaining, receiving, transmitting or providing analog or digital signals or information, e.g., any connector, contact, pin, register, input port, output port, conductor, lane, etc. which allows providing or obtaining a signal or information. The one or more interfaces 132 may be wire- less or wireline and it may be configured to communicate, e.g., transmit or receive signals, information with further internal or external components.

[0050] The apparatus 130 may be a computer, processor, control unit, (field) programmable logic array ((F)PLA), (field) programmable gate array ((F)PGA), graphics processor unit (GPU), application-specific integrated circuit (ASICs), integrated circuits (IC) or system-on-a-chip (SoCs) system.

[0051] More details and aspects are mentioned in connection with the examples described below. The example shown in Fig. 1 may comprise one or more optional or additional features corresponding to one or more aspects mentioned in connection with the proposed concept or one or more examples described below (e.g., Fig. 2 - 5).

[0052] Fig. 2 shows a flow chart of an example of a method for an optical imaging system. The method 200 may comprise a surgical workflow 200, which may be performed or controlled by an apparatus as described above, e.g., with reference to Fig. 1. At 210 the surgical workflow may be started. For example, a user of the optical imaging system may start the surgical workflow. That is, a surgical initialization may be performed at 210. For example, a surgical procedure may begin, and a specific surgery category may be identified.

[0053] At 220 the optical imaging system may be initialized. For example, the setting of the optical imaging system may be adjusted, such that a surgery according to the surgical workflow can be performed using the optical imaging system. That is, a parameter initialization may be performed. For example, parameters required for a particular surgery may be initialized, e.g., including setting up the optical imaging system.

[0054] At 230 a setting of a scene may be selected. For example, the apparatus may obtain setting data for adjusting a setting of a diaphragm of the optical imaging system based on the selected setting of the scene. For example, the apparatus may retrieve the setting data from an external storage device. That is, a scene selection may be performed. For example, an appropriate scene setting may be selected, which may involve determining the specific requirements for the surgery, e.g., a setting of the diaphragm. Therefore, the setting data may be retrieved for adjusting the setting of the diaphragm according to the selected setting of the scene. At 240 the setting of the diaphragm may be adjusted. For example, the apparatus may transmit the setting data for adjusting the setting of the diaphragm. That is, an adjustment of the diaphragm may be performed. For example, the setting of the diaphragm, e.g., a size of an orifice of the diaphragm, a position of the diaphragm, may be adjusted based on the selected scene setting. This may ensure improved imaging conditions for the surgery.

[0055] At 250 a check whether the setting of the scene has been changed or not may be performed. When the setting of the scene has been changed, the method 200 may repeat at least partly 230, e.g., retrieving second setting data for the changed setting of the scene. Then 240 can be repeated, i.e., adjusting the setting of the diaphragm based on the second setting data.

[0056] When the setting of the scene has not been changed, a check whether the surgery is completed may be performed at 260. That is, a surgery completion verification may be performed. For example, a check may be performed to verify a surgery is completed. When the surgery is not completed, 250 and 260 may be repeated.

[0057] When the surgery is completed, the surgery workflow may be terminated at 270. For example, the surgery workflow may end. That is, a surgery completion may be performed. For example, the surgery workflow may conclude once the surgery is successfully completed.

[0058] More details and aspects are mentioned in connection with the examples described above and / or below. The example shown in Fig. 2 may comprise one or more optional or additional features corresponding to one or more aspects mentioned in connection with the proposed concept or one or more examples described above (e.g., Fig. 1) and / or below (e.g., Fig. 3 - 5).

[0059] Fig. 3 shows a schematic view of a part of an optical imaging sensor 322 comprising a diaphragm 324, 324’. The diaphragm 324, 324’ may be intended for use in an optical imaging system equipped with at least one adjustable setting of the diaphragm 324, 324’, e.g., an orifice (or entrance pupil). This diaphragm 324, 324’ may be designed to receive a diaphragm control signal, representing the desired setting of the diaphragm e.g., a size of an orifice of the diaphragm, to be adjusted. For example, the diaphragm control signal may comprise the setting data. That is, the diaphragm 324, 324’ may comprise an actor config- ured to adjust a setting of the diaphragm 324, 324’. The actor may receive the setting data transmitted from the apparatus 330. The apparatus may be an apparatus as described with reference to Fig. 1.

[0060] Thus, the apparatus 330 configured to determine the setting data may be external to the diaphragm 324, 324’ (and the optical imaging sensor 322). The apparatus 330 may generate or determine the control signal for adjusting the setting of the diaphragm. The generation of a determination of the control signal is based on the surgery being performed or to be performed. For example, the control signal may be generated or determined based on a specific surgery category and / or a specific surgical process.

[0061] As shown in Fig. 3, the diaphragm 324, 324’ may be part of the optical imaging sensor 322. Alternatively, the diaphragm may be external to an optical imaging sensor of the optical imaging system. The optical imaging sensor 322 may comprise further optional components such like beam splitters 390, 390’ used to split a beam of light for digital imaging and / or video lenses 394, 394’ used to form images on the optical imaging sensor 322. For example, the optical imaging sensor may comprise two different channels, channel A 396 and channel B 396’.

[0062] More details and aspects are mentioned in connection with the examples described above and / or below. The example shown in Fig. 3 may comprise one or more optional or additional features corresponding to one or more aspects mentioned in connection with the proposed concept or one or more examples described above (e.g., Fig. 1 - 2) and / or below (e.g., Fig. 4 - 5).

[0063] Fig. 4 shows a flow chart of an example of a method 400 for an optical imaging system. The method 400 may be performed by an optical imaging system as described above, e.g., with reference to Fig. 1. The method 400 comprises obtaining 410 surgery data indicative of a surgery being performed or to be performed using the optical imaging system. Further, the method 400 comprises determining 420, based on the surgery data, setting data indicative of a setting of a diaphragm of the optical imaging system. The method 400 further comprises 430 transmitting the setting data for adjusting the setting of the diaphragm. More details and aspects are mentioned in connection with the examples described above and / or below. The example shown in Fig. 4 may comprise one or more optional or additional features corresponding to one or more aspects mentioned in connection with the proposed concept or one or more examples described above (e.g., Fig. 1 - 3) and / or below (e.g., Fig. 5).

[0064] Some embodiments relate to a microscope comprising an apparatus as described in connection with Fig. 1. Alternatively, a microscope or an optical imaging system can be communicatively connected to an apparatus as described in connection Fig. 1. Fig. 5 shows a schematic illustration of a system 500, e.g., an optical imaging system, configured to perform a method described herein, e.g., with reference to Fig. 4. The system 500 comprises a microscope 510 and a computer system 520. The microscope may comprise the apparatus as described above, e.g., with reference to Fig. 1. The microscope 510 is configured to take images and is connected to the computer system 520. The computer system 520 is configured to execute at least a part of a method described herein. The computer system 520 may be configured to execute a machine learning algorithm. The computer system 520 and microscope 510 may be separate entities but can also be integrated together in one common housing. The computer system 520 may be part of a central processing system of the microscope 510 and / or the computer system 520 may be part of a subcomponent of the microscope 510, such as a sensor, an actor, a camera or an illumination unit, etc. of the microscope 510.

[0065] The computer system 520 may be a local computer device (e.g., personal computer, laptop, tablet computer or mobile phone) with one or more processors and one or more storage devices or may be a distributed computer system (e.g., a cloud computing system with one or more processors and one or more storage devices distributed at various locations, for example, at a local client and / or one or more remote server farms and / or data centers). The computer system 520 may comprise any circuit or combination of circuits. In one embodiment, the computer system 520 may include one or more processors which can be of any type. As used herein, processor may mean any type of computational circuit, such as but not limited to a microprocessor, a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), multiple core processor, a field programmable gate array (FPGA), for example, of a microscope or a microscope component (e.g., camera) or any other type of processor or pro- cessing circuit. Other types of circuits that may be included in the computer system 520 may be a custom circuit, an application-specific integrated circuit (ASIC), or the like, such as, for example, one or more circuits (such as a communication circuit) for use in wireless devices like mobile telephones, tablet computers, laptop computers, two-way radios, and similar electronic systems. The computer system 520 may include one or more storage devices, which may include one or more memory elements suitable to the particular application, such as a main memory in the form of random access memory (RAM), one or more hard drives, and / or one or more drives that handle removable media such as compact disks (CD), flash memory cards, digital video disk (DVD), and the like. The computer system 520 may also include a display device, one or more speakers, and a keyboard and / or controller, which can include a mouse, trackball, touch screen, voice-recognition device, or any other device that permits a system user to input information into and receive information from the computer system 520.

[0066] More details and aspects are mentioned in connection with the examples described above. The example shown in Fig. 5 may comprise one or more optional or additional features corresponding to one or more aspects mentioned in connection with the proposed concept or one or more examples described above (e.g., Fig. 1 - 4).

[0067] Some or all of the method steps may be executed by (or using) a hardware apparatus, like for example, a processor, a microprocessor, a programmable computer or an electronic circuit. In some embodiments, some one or more of the most important method steps may be executed by such an apparatus.

[0068] Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or in software. The implementation can be performed using a non- transitory storage medium such as a digital storage medium, for example a floppy disc, a DVD, a Blu-Ray, a CD, a ROM, a PROM, and EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed. Therefore, the digital storage medium may be computer readable. Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

[0069] Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer. The program code may, for example, be stored on a machine readable carrier.

[0070] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

[0071] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

[0072] A further embodiment of the present invention is, therefore, a storage medium (or a data carrier, or a computer-readable medium) comprising, stored thereon, the computer program for performing one of the methods described herein when it is performed by a processor. The data carrier, the digital storage medium or the recorded medium are typically tangible and / or non-transitionary. A further embodiment of the present invention is an apparatus as described herein comprising a processor and the storage medium.

[0073] A further embodiment of the invention is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may, for example, be configured to be transferred via a data communication connection, for example, via the internet.

[0074] A further embodiment comprises a processing means, for example, a computer or a programmable logic device, configured to, or adapted to, perform one of the methods described herein.

[0075] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein. A further embodiment according to the invention comprises an apparatus or a system configured to transfer (for example, electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may, for example, be a computer, a mobile device, a memory device or the like. The apparatus or system may, for example, comprise a file server for transferring the computer program to the receiver.

[0076] In some embodiments, a programmable logic device (for example, a field programmable gate array) may be used to perform some or all of the functionalities of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein. Generally, the methods are preferably performed by any hardware apparatus.

[0077] If some aspects have been described in relation to a device or system, these aspects should also be understood as a description of the corresponding method and vice versa. For example, a block, device or functional aspect of the device or system may correspond to a feature, such as a method step, of the corresponding method. Accordingly, aspects described in relation to a method shall also be understood as a description of a corresponding block, a corresponding element, a property or a functional feature of a corresponding device or a corresponding system.

[0078] The following claims are hereby incorporated in the detailed description, wherein each claim may stand on its own as a separate example. It should also be noted that although in the claims a dependent claim refers to a particular combination with one or more other claims, other examples may also include a combination of the dependent claim with the subject matter of any other dependent or independent claim. Such combinations are hereby explicitly proposed, unless it is stated in the individual case that a particular combination is not intended. Furthermore, features of a claim should also be included for any other independent claim, even if that claim is not directly defined as dependent on that other independent claim.

[0079] The aspects and features described in relation to a particular one of the previous examples may also be combined with one or more of the further examples to replace an identical or similar feature of that further example or to additionally introduce the features into the further example.

[0080] List of reference Signs

[0081] 100 optical imaging system

[0082] 105 base

[0083] 110 sample

[0084] 120 microscope

[0085] 122 optical imaging sensor

[0086] 124 diaphragm

[0087] 130 apparatus

[0088] 132 interface

[0089] 134 processor

[0090] 136 storage device

[0091] 140, 145 ocular display

[0092] 160 arm

[0093] 180 display device

[0094] 200 method for an optical imaging system

[0095] 210 start of a surgical workflow

[0096] 220 initializing of the optical imaging system

[0097] 230 selection of a setting of a scene

[0098] 240 adjustment of a diaphragm

[0099] 250 check of the setting of the scene

[0100] 260 check of a completion of the surgery

[0101] 270 termination of the surgery workflow

[0102] 322 optical imaging sensor

[0103] 324, 324’ diaphragm

[0104] 390, 390’ beam splitter

[0105] 394, 394’ lenses

[0106] 396, 396’ channel

[0107] 400 method for an optical imaging system

[0108] 410 obtain surgery data

[0109] 420 determine setting data

[0110] 430 transmit setting data

[0111] 500 system

[0112] 510 microscope 520 computer system

Claims

Claims1. An apparatus (130) for an optical imaging system (100), comprising one or more processors (134) and one or more storage devices (136), wherein the apparatus (130) is configured to: obtain surgery data indicative of a surgery being performed or to be performed using the optical imaging system (100); determine, based on the surgery data, setting data indicative of a setting of a diaphragm (124) of the optical imaging system (100); and transmit the setting data for adjusting the setting of the diaphragm (124).

2. The apparatus (130) according to claim 1, wherein the surgery data is indicative of at least one of a surgical workflow or a surgical workflow sequence of the surgical workflow.

3. The apparatus (130) according to any one of the preceding claims, wherein the apparatus (130) is configured to: obtain the surgery data by obtaining microscope data indicative of a setting of the optical imaging system (100); and by determining the surgery data based on the microscope data.

4. The apparatus (130) according to any one of the preceding claims, wherein the apparatus (130) is configured to: obtain the surgery data by obtaining sensor data of an optical imaging sensor (122) of the optical imaging system (100), the sensor data indicative of a view of a sample (110); and by determining the surgery data based on the sensor data.

5. The apparatus (130) according to any one of the preceding claims, wherein the apparatus (130) is configured to: obtain the surgery data by receiving user input data indicative of an intention of a user to perform a surgical workflow or a surgical workflow sequence of a surgical workflow; andby determining the surgery data based on the user input data.

6. The apparatus (130) according to any one of the preceding claims, wherein the apparatus (130) is configured to: obtain second surgery data indicative of the surgery being performed; determine, based on the second surgery data, second setting data indicative of a second setting of the diaphragm (124) of the optical imaging system (100); and when the second setting of the diaphragm (124) is different from the setting of diaphragm (124); transmit the second setting data for readjusting the setting of the diaphragm (124).

7. The apparatus (130) according to claim 6, wherein the apparatus (130) is configured to: repeatedly obtain microscope data indicative of a setting of the optical imaging system (100); determine, based on the microscope data, when the setting of the optical imaging system (100) has been changed; and when the setting of the optical imaging system (100) has been changed, obtain the second surgery data by determining based on the determined change of the setting of the optical imaging system (100).

8. The apparatus (130) according to claim 6, wherein the apparatus (130) is configured to: repeatedly obtain sensor data of an optical imaging sensor (122) of the optical imaging system (100), the sensor data indicative of a view of a sample (110); determine, based on the sensor data, when the current surgical workflow sequence of a surgical workflow has been changed; and when the current surgical workflow sequence of the surgical workflow has been changed, obtain the second surgery data by determining based on the determined change of the current surgical workflow sequence of the surgical workflow.

9. The apparatus (130) according to any one of the preceding claims, wherein the apparatus (130) is configured to:obtain feedback data indicative of a feedback of the user on the adjusted setting of the diaphragm (124); determine, based on the feedback data, adjusted setting data indicative of an adjusted setting of the diaphragm (124) of the optical imaging system (100); and transmit the adjusted setting data for readjusting the setting of the diaphragm (124).

10. The apparatus (130) according to any one of the preceding claims, wherein the surgery data is further indicative of an ending of the surgery; and the apparatus (130) is configured to: determine, based on the surgery data, when the surgery has ended; generate control data indicative a termination of a surgical workflow; and transmit the control data for terminating the surgical workflow.

11. An optical imaging system (100), comprising an apparatus (130) according to any one of the preceding claims.

12. A method (400) for an optical imaging system, comprising: obtaining (410) surgery data indicative of a surgery being performed or to be performed using the optical imaging system; determining (420), based on the surgery data, setting data indicative of a setting of a diaphragm of the optical imaging system; and transmitting (430) the setting data for adjusting the setting of the diaphragm.

13. A computer program with a program code for performing the method (400) according to claim 12 when the computer program is executed on a processor.

Images