A visualization system and a method for stabilizing the current optical system state of the visualization system.

By introducing a stabilization adjustment loop into the visualization system, temperature changes are detected and optical components are actively adjusted, solving the problem of unstable focal length and zoom level caused by temperature changes, thus achieving stable image quality and surgical precision.

CN120233538BActive Publication Date: 2026-11-10SCHOLLY FIBEROPTIC GMBH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411946474.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2023-12-28
Filing Date
2024-12-27
Publication Date
2026-11-10
Estimated Expiration
2044-12-27

AI Technical Summary

Technical Problem

Existing visualization systems experience significant changes in the focal length and zoom level of optical components when temperatures fluctuate, leading to decreased image quality and optical channel drift, which affects the precision and stability of surgery.

Method used

By introducing a stabilization adjustment loop into the visualization system, temperature changes within the detection area are continuously detected, and the focusing and zooming optical devices are actively adjusted when the threshold is exceeded to maintain the stability of the optical system.

Benefits of technology

It effectively suppresses temperature effects, ensures stable image quality, avoids image jitter, and improves the precision and reliability of surgery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120233538B_ABST
    Figure CN120233538B_ABST
Patent Text Reader

Abstract

The present invention relates to a method for temperature stabilization of the current optical system state for a visualization system and a visualization system. In order to improve the operation of the visualization system (1), which includes an imaging optics (2) with an adjustable zoom optics (3) and an adjustable focusing optics (4), it is proposed that at least one probe temperature (12) within the imaging optics (2) be detected directly and / or indirectly (e.g., by estimation) by means of at least one temperature detector (27), and that once the currently detected temperature change (11) with respect to the probe temperature (12) exceeds a temperature threshold (18), the focusing optics (4) and / or the zoom optics (3) are actively adjusted by means of a stabilization system (9) including one or more stabilization adjustment loops (10).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to a method for stabilizing the temperature of the current optical system state for a visualization system (particularly in medicine). The system includes imaging optics having: an adjustable zoom optics for determining the current zoom level; and an adjustable focusing optics for determining the current spatial position of the focal plane; and at least one image sensor. In this method, at least one image of an object observed using the visualization system, such as a surgical area, is recorded by means of the at least one image sensor. Furthermore, this method stabilizes the current optical system state within the imaging optics against temperature fluctuations, including the current optical zoom level and the current spatial position of the focal plane.

[0002] Furthermore, the present invention relates to a visualization system, which is preferably designed as part of a robotic system and / or a medical visualization system. The visualization system has imaging optics comprising: an adjustable zoom optics for determining the current optical zoom level; an adjustable focusing optics for determining the current spatial position of the focal plane; at least one image sensor for recording at least one image of an object observed using the visualization system, such as a surgical area; and finally, at least one temperature detector configured to directly and / or indirectly detect at least one current temperature change in at least one detection area. Background Technology

[0003] In the prior art, medical visualization systems in the form of exoscopy are known, used in neurosurgery as part of robotic systems to visualize surgical areas for neurosurgeons in a magnified view on a display screen. In such applications, the exoscopy is positioned by a robotic arm at varying working intervals (typically 200-550 mm) from the surgical area to be observed, wherein the visualization system is designed with zoom optics for changing the level of optical zoom (and thus the corresponding local image recorded by means of an image sensor) and focusing optics for spatially determining the focal plane.

[0004] In such a visualization system, in addition to the stepper motors used to adjust the zoom and focus optics, there are typically several other electronic structural units, such as image sensors, adjustment and readout electronics, and electronic image processing units. All these electronic components exhibit electrical power losses, which cause heat generation in the overall system, particularly in the imaging optics.

[0005] During the operation of the visualization system, the various components first undergo a "warm-up" phase, heating from room temperature (approximately 25°C) to a temperature ranging from 40°C to approximately 60°C. The visualization system may also generate additional heat during its operation. This warm-up typically occurs before the surgeon generally begins working with the visualization system. In this respect, this initial heating is relatively minor.

[0006] During the use of the visualization system, however, temperature variations of 10°C and greater may occur for various reasons (variable electrical loss heat, temperature variations in the operating room, etc.), which in the worst case can lead to focal plane changes of several centimeters (up to 80 millimeters have been observed in extreme cases).

[0007] Temperature variations not only affect the refractive index of the corresponding lens material, but also the shape, position, and, if possible, orientation / tilt of the lens. It should also be considered that the mechanical structure holding the lens within it is subjected to thermomechanical stress, which affects optical function. All these effects generally result in significant temperature-induced variations in the focal length of focusing optics and the focal length of zoom optics, and consequently, the zoom levels. Such thermal drift in imaging optics can be particularly disruptive to surgeons when using visualization systems.

[0008] This is particularly applicable when the visualization system has multiple parallel optical channels, such as those used for stereo vision, and the spatial position of the observed object should be determined based on measurement data from these two channels (such a design can also be used in the visualization system according to the invention). This approach allows for optical tracking, such as measuring functions or objects, within a real-time video image. Furthermore, this is also of interest, for example, for recording medical procedures, or for the specialized localization of objects within the field of view observed by means of a robotic system. However, all these functions are affected by the aforementioned thermal drift.

[0009] In stereoscopic displays, interference can occur if the focal planes or zoom levels (and thus the size of the field of view) of the two stereoscopic paths change with different intensities due to temperature variations. Such drift between the two optical paths of a visualization system can occur, for example, due to non-uniform temperature distribution within the camera, and / or because the two optical paths are located at different positions within the overall system, and are affected with varying intensities by system components that generate residual heat. Summary of the Invention

[0010] In this context, the present invention aims to effectively suppress temperature effects, particularly thermal drift, that adversely affect the performance of visualization systems.

[0011] To achieve the stated objective, the method is configured according to the features of claim 1. Specifically, to achieve this objective, the method for stabilizing the current optical system state of a visualization system, as described at the beginning, is proposed according to the invention: at least one current temperature change of the probe temperature in at least one probe region within the visualization system is continuously, directly or indirectly detected by a stabilization system comprising at least one stabilization adjustment loop; and once at least one temperature threshold for the at least one current temperature change is exceeded, the at least one stabilization adjustment loop actively adjusts the focusing optics and / or the zoom optics.

[0012] Direct detection of changes in the probe temperature can be achieved, for example, by using a temperature sensor. However, the change can also be detected indirectly, for example by using a sensor that detects length changes or other temperature-induced mechanical changes within the imaging optics due to temperature variations.

[0013] In other words, the present invention therefore proposes to stabilize the state of the optical system by means of a stabilization system with at least one stabilization adjustment loop and by detecting at least one temperature change in the probe temperature. This allows for the balancing of, in particular, thermally induced displacements of the zoom and / or focusing optics through corresponding readjustment (active readjustment based on directly or indirectly detected temperature changes). This enables temperature regulation to be implemented at a defined operating point—which the user of the visualization system has just selected (i.e., for the precisely set zoom level and / or the specific currently selected focal plane)—that stabilizes the operating point, more precisely, in particular, based on whether and how the temperature within the visualization system (especially the temperature within the housing that encloses the imaging optics) changes.

[0014] Preferably, in the method, at least two probe temperatures can be evaluated, detected within the visualization system, preferably within the imaging optics, and in different probe regions. While detection of such a spatial distribution of temperature is not mandatory, it can be advantageous and therefore meaningful, for example, for stabilizing optical zoom. Detection of current temperature changes can be achieved directly (e.g., by means of temperature measurement) or indirectly, as described above, for example, by detecting positional changes caused by temperature, thereby allowing the inference of the temperature change that has occurred.

[0015] The visualization system can be designed, for example, as a medical visualization system and / or, for example, a stereoscope, microscope, or exoscopy. This results in another significant advantage of the method according to the invention: the corresponding temperature stabilization, for example, in the context of stereoscopic surgery, prevents distortion of stereoscopically acquired images of the surgical area due to temperature fluctuations and therefore thermal changes caused by possible alterations in zoom level and / or the spatial position of focusing optics. Due to the temperature stabilization of the current optical system state of the visualization system, the consistently high quality of the acquired images or sequences of acquired images, such as real-time video images, can be ensured. If the visualization system has a stereoscopic imaging system, then by means of the invention, drift between the corresponding optical system states of the corresponding optical channels can be prevented.

[0016] The visualization system can be equipped with, for example, two parallel optical channels and two image sensors each, to achieve a stereoscopic imaging system that provides the surgeon with a spatial impression. The visualization system can also detect objects, such as surgical instruments, within real-time video images. Furthermore, the visualization system can be configured to calculate the spatial position of the corresponding object in a world coordinate system based on a model of stereo optics and using triangulation. For this purpose, it can be stipulated that each pixel of the image sensor is first assigned a location within the camera coordinate system (specifically, the left or right image sensor). Subsequently, a corresponding coordinate in the world coordinate system can be assigned to that location based on a set zoom level and the focal plane / set current position of the focusing optics. This scheme allows, for example, measurement functions or optical tracking of objects within real-time video images. Furthermore, this is of interest, for example, for recording medical procedures and / or it can also enable specific positioning of objects within the field of view observed by means of a robotic system.

[0017] The problem, in principle, lies in the fact that continuous adjustment of the optics, and the potential for image jitter due to mechanical tolerances, can be highly disruptive. To avoid continuous adjustment, a hysteresis is introduced: for this purpose, it can be specified that the at least one stabilization adjustment loop is designed to have an artificial hysteresis to avoid image jitter in the at least one image acquired by the visualization system. This artificial hysteresis can preferably be implemented electronically. This results in a significant improvement in operational characteristics for the user of the visualization system (e.g., for surgeons performing medical procedures) because image jitter is avoided.

[0018] The regulation implemented by the stabilization control loop can be designed such that it intervenes only when the numerical change in the current temperature variation relative to the detected probe temperature is above a threshold. If the stabilization system detects a temperature change above this threshold, the optical system state can be actively readjusted, for example, by driving the corresponding stepper motor to adjust the zoom optics and / or focusing optics accordingly. Conversely, if only a numerical temperature change below this threshold is detected, the regulation does not intervene.

[0019] For example, the hysteresis can be configured such that no adjustment is made to the focusing optics and / or zoom optics upon detecting a small, short-lived temperature rise, for example, from 20°C to 21°C. On the other hand, the stabilization system can intervene via at least one stabilization adjustment loop, for example, when the temperature rises from 20°C to 22°C, thereby actively adjusting the focusing optics and / or zoom optics and possibly subsequently (in this example) cooling back to 21°C. The hysteresis can therefore be set or determined, for example, with respect to the corresponding lens position. This allows the visualization system to remain in different system states (in terms of the current focal length and current zoom level of the focusing optics) at the same temperature. Different final adjusted optical system states can result depending on whether the temperature approaches 21°C from 22°C or from 20°C (as in the example above). Instead of artificial hysteresis, fixed, predefined temperature thresholds can be set, whereby the stabilization system intervenes once one of these temperature thresholds is reached (i.e., the detected temperature reaches that value). This can be implemented, for example, such that an active readjustment occurs once each when a specific temperature (e.g., 20°C, 23°C, 26°C) is reached.

[0020] However, this invention has recognized that the magnitude of the hysteresis should be limited for two reasons:

[0021] On the one hand, if the surgeon sets a high zoom ratio, the depth of field (DOF) may only be a few millimeters, for example, + / - 1.5 millimeters. In this case, once the current position of the focal plane has changed significantly from the current DOF due to temperature, for example, by 1.0 millimeter, the stabilization system must intervene. This is because if the stabilization system only intervenes after, for example, a 2-millimeter change in the focal plane position, the current real-time image seen by the surgeon will become blurry because temperature stabilization has not intervened in time. This is considered unconditionally to be avoided. Alternatively, it can be specified that the stabilization system automatically adjusts the lag based on the currently selected zoom and / or based on the operating status or the current position of the focal plane.

[0022] However, on the other hand, there are cases where choosing a particularly large working distance from the observed object and setting a particularly small zoom level results in a particularly large field of view. If, in such a case, the world coordinates of the object within the camera's real-time image must now be determined using the described triangulation scheme, this is particularly prone to errors due to temperature-induced fluctuations in the focal length of the focusing optics and the optical zoom level. In this application, that is, an ideal absolute accuracy of 50 μm, but at least 100-300 μm, should be achieved regarding the location resolution when determining the world coordinates of the object. To achieve such accuracy when determining the object's position in space, early intervention in temperature stabilization is necessary to minimize temperature-induced deviations.

[0023] Preferably, this is achieved electronically with artificial hysteresis. This ensures, for example, that the minimum adjustment path is followed when adjusting the respective focusing optics / zoom optics, which is advantageous for achieving high precision during adjustment. Preferably, a stepper motor is used for this purpose, which has the advantage of very high repeatability regarding the position to be reached.

[0024] In particular, the at least one stabilization adjustment loop—designed to have artificial hysteresis—can automatically initiate different adjustments to the focusing optics and / or zoom optics based on the current optical system state and / or the direction of the detected current temperature change.

[0025] The surgeon therefore does not have to readjust the optical system state himself. Preferably, these different adjustments are also initiated automatically, regardless of whether a new target value for adjusting the focusing optics and / or zoom optics is pre-given from outside the at least one stabilization adjustment loop (e.g., by the surgeon).

[0026] It can be specified that at least one probe temperature is detected directly by means of a temperature sensor. One or more temperature sensors can be designed, for example, as thermocouples (e.g., by means of a thin metal wire on a film) or as thermistors. Alternatively, parasitic temperature sensors can be read, which, for example, are already present in the microcontroller or corresponding image sensor. The values ​​of multiple temperature sensors can also be averaged or combined according to calculation rules to achieve higher stability of the adjustment. This can be advantageous, as no (excessive) active readjustment has been initiated when only localized temperature changes are limited (which will only cause a small temperature-induced shift in the optics).

[0027] Alternatively or additionally, it may be specified that at least one probe temperature is detected indirectly. Indirect detection of the probe temperature can be achieved, for example, by calculation of the current electrical power loss of the electronic components based on a visualization system. Additionally or alternatively, the electronic activity level of the electrical components may also be taken into account for indirect detection of the probe temperature.

[0028] The corresponding probed temperature is preferably continuously detected by the stabilization system as the corresponding current temperature. Furthermore, the aforementioned current temperature change (based on the corresponding detected probed temperature) can be determined relative to a stored reference temperature. This reference temperature can preferably be matched / updated by the stabilization system, once the stabilization system, more precisely, a stabilization adjustment loop, intervenes in a closed-loop / open-loop control manner. In particular, this allows the optical system state to be actively matched to the new reference temperature, thereby maintaining stability of the optical system state at that new reference temperature (i.e., even if temperature changes occur within the imaging system, they do not cause changes in the focus plane or zoom level that are perceptible to the surgeon).

[0029] The method may also specify the sensing of temperature-induced changes in the spatial position of at least one component of the imaging optics (e.g., a movable lens). For this purpose, the visualization system may include a position sensor capable of sensing such positional changes. Such temperature-induced movement within the optomechanical imaging system can thus trigger a temperature regulation algorithm that stabilizes the optical system's state. This is because the temperature can be detected, at least indirectly, via such positional changes.

[0030] Therefore, in other words, it can be stipulated that once at least one position threshold for the temperature-induced position change detected by the at least one sensor is exceeded, the at least one stabilization adjustment loop actively adjusts the focusing optics and / or the zoom optics. Temperature-induced here can be understood as the spatial position of the components being unintentionally changed based on temperature changes, particularly temperature changes exceeding a defined threshold.

[0031] In another advantageous embodiment of the invention, the corresponding adjustments to the focusing optics and / or zoom optics are made not prematurely, based on the current optical system state, particularly the current adjustment of the focusing optics and the currently set zoom level, with reference to the detected at least one current temperature change. Depending on which optical system state the imaging optics is in, the stabilization system intervenes in a closed-loop controlled manner under varying magnitudes of temperature changes to stabilize the current optical system state. This, for example, prevents frequent but unnecessarily early adjustments to the optics in a first system state, while in a second system state, the adjustments do not occur sufficiently early.

[0032] In particular, the at least one temperature threshold can be adjusted according to the current optical system state, thereby stabilizing the temperature by intervening when there are small temperature changes in the detected temperature or only when there are larger temperature changes.

[0033] In an advantageous embodiment of the invention, it can be specified that the at least one stabilization adjustment loop also operates when a new optical system state is not pre-defined by the visualization system itself or by the user as a predetermined target. In particular, this enables the stabilization system (by means of active autonomous adjustment) to continuously stabilize the previously set optical system state relative to temperature fluctuations.

[0034] Therefore, the state of the optical system can be continuously stabilized by the stabilization system; more precisely, the user does not perceive any open-loop control intervention of the stabilization system in the real-time images recorded by the at least one image sensor. Users of the visualization system, such as surgeons, can thus use the visualization system undisturbed.

[0035] In another advantageous embodiment of the invention, it can be specified that, in the event of exceeding the at least one temperature threshold and / or the at least one position threshold, the at least one stabilization adjustment loop drives at least one actuator of the focusing optics and / or the zoom optics. This allows for a corresponding and early active readjustment of the zoom optics and / or the focusing optics.

[0036] In particular, the actuator can be a stepper motor.

[0037] The at least one stabilization control loop can drive the corresponding actuator, particularly via a separate corresponding control loop. The actuator can then be controlled in a closed-loop manner by means of the separate control loop.

[0038] In a preferred design of the visualization system, a stabilization system (e.g., via a corresponding stabilization adjustment loop) drives at least two actuators of the zoom optics, particularly at least two stepper motors, and at least one actuator of the focusing optics. For example, the stabilization system can intervene in an open-loop control manner in at least two separate adjustment loops for adjusting the zoom optics and at least one additional adjustment loop for the focusing optics, thereby adjusting the corresponding actuators controlled in a closed loop by the corresponding adjustment loops to compensate for detected temperature changes that cause changes in the system state. One of the adjustment loops of the stabilization system can also simultaneously act in an open-loop control manner on both actuators of the zoom optics, for example, in the case where the zoom optics are constructed by means of two movable lens pairs that can move toward or away from each other.

[0039] As described above, a corresponding (sub)stabilization control loop, as part of a higher-level stabilization system, can also drive multiple actuators, which can also be coupled with the same optical function: thus, the zoom optics can include, for example, two optical lens groups movable from each other. In such a case, both of these optical lens groups can be driven by corresponding coupled stabilization control loops to compensate for temperature effects.

[0040] Here, different adjustment paths A and B (for a current optical system state) can be stored for the two lens groups respectively (i.e., zoom group 1: A µm / K, zoom group 2: B µm / K). Additionally, it is advantageous that the corresponding actuators (as explained above) can be operated by different sub-stabilization adjustment loops, i.e., multiple different sub-stabilization adjustment loops can be driven by means of a higher-level stabilization adjustment loop. Such an adjustment architecture can be understood in the sense of the invention as a single large overall stabilization adjustment loop, whose individual sub-adjustment loops can compensate for different temperature-induced disturbance parameters so as to stabilize the optical system state relative to temperature changes as desired. Thus, for example, one of the individual stabilization adjustment loops—particularly the one stabilizing the focusing optics—can also be configured to additionally drive the zoom optics. Conversely, a stabilization adjustment loop—particularly the one stabilizing the zoom optics—can also be configured to additionally drive the focusing optics.

[0041] Specifically, it can drive corresponding actuators to adjust focusing optics and / or zoom optics along the optical z-axis of imaging optics. It can be specified that the at least one stabilization adjustment loop drives the corresponding actuator via a separate corresponding adjustment loop, by means of which the actuator can be adjusted in a closed-loop control manner.

[0042] The stabilization control loop, and particularly the corresponding sub-control loops, can also be designed such that multiple control loops act simultaneously on a single actuator. For example, a visualization system can be designed parfocally, so that the focus does not change with zoom. In such a design, it may be necessary for the zoom sub-control loop of the stabilization control loop to also act on the actuator for focusing, so that this control loop can cause simultaneous adjustment of the focusing optics and the zoom optics. This may be necessary, for example, when the focus has changed due to tolerances or other human error, even though the system was originally designed parfocally. The zoom control loop can also act on the focus actuator in such a way that the second sub-control loop responsible for focusing does not detect a change in focus, for example, because the temperature change detected in the focal region is still below a certain threshold.

[0043] In an advantageous embodiment of the invention, it can be specified that once the at least one current temperature change of the detected temperature exceeds a temperature threshold that is still permissible for the current optical system state, the stabilization system adjusts the focusing optics and / or zoom optics in an open-loop controlled manner. Preferably, this is done independently of corresponding target values ​​previously set by the user or by a visualization system for adjusting the focusing optics and / or the zoom optics.

[0044] In this case, there may be no corresponding adjustment parameters for the focusing optics and / or zoom optics, such as the final preset focal length or the final preset optical zoom level. As a result, the stabilization system can also intervene with respect to the stabilization of the optical system state when there are no new instructions from the user or the visualization system for adjusting the focusing optics and / or the zoom optics.

[0045] In an advantageous variation of the method, the stabilization system can be specified to open-loop control adjust the focusing optics and / or zoom optics based on a corresponding temperature model. Here, the stabilization system may deviate, in particular, from a pre-defined target value (either by the user or by the system itself) to stabilize the current optical system state relative to the detected at least one current temperature change. The corresponding temperature model can model the necessary temperature-dependent adjustments of the focusing optics (e.g., ΔFL(T, ΔT, FL, ZL)) or zoom optics (e.g., ΔZL(T, ΔT, FL, ZL)), for example, as a function of the current detected temperature T, the detected change in the detected temperature ΔT (where the positive or negative change in ΔT can be taken into account), the current focal length FL, and / or the current zoom level ZL. It should be mentioned that the magnitude of the focal length FL determines the spatial position of the resulting focal plane (i.e., a plane that is clearly imaged onto the image sensor) along the optical axis. Therefore, the focal plane must coincide with the area being observed in order for the surgeon to obtain a clear image.

[0046] Therefore, preferably, the temperature model here takes into account the current state of the optical system (FL, ZL), in particular the current focal length FL of the focusing optics and / or the current zoom level ZL of the zoom optics.

[0047] Another advantageous embodiment of the invention specifies that the stabilization system—preferably based on a previously described temperature model or another temperature model—calculates suitable compensatory adjustments to the zoom optics and / or focusing optics based on the detected at least one current temperature change, particularly a corresponding suitable adjustment path Δz along an optical z-axis or a previously described optical z-axis. Thus, for example, a suitable adjustment path Δz can be determined for any detected temperature change, on which the focusing optics and / or zoom optics must be actively readjusted accordingly.

[0048] Based on the calculated adjustments, the stabilization system can regenerate corresponding drive signals for adjusting the zoom and / or focusing optics (particularly by intervening in the respective individual adjustment loops). In this way, the current optical system state can be stabilized in a temperature-dependent manner.

[0049] In another advantageous design, the method may specify that the stabilization system takes into account the detected value of the current detection temperature T and adjusts the at least one temperature threshold ΔT. max(T), the stabilization system intervenes in an open-loop controlled manner from the at least one temperature threshold (e.g., as a result of adjusting the reference temperature). This adjustment is preferably made after the stabilization system has already intervened in an open-loop controlled manner. The temperature-induced adjustment of the temperature threshold and / or reference temperature can be mainly achieved by the stabilization system intervening sometimes early and sometimes late, depending on the current position of the detected temperature. Therefore, the adjustment is adaptive here, based on the temperature that actually exists in the detection region. In particular, the corresponding temperature model (ΔFL(T, ΔT, FL, ZL), ΔZL(T, ΔT, FL, ZL)) can be adjusted accordingly based on the detected value of the detected temperature T. Therefore, different drive signals can be generated by the corresponding stabilization control loop based on the currently detected temperature, even with the same relative temperature change ΔT (relative to the currently stored reference temperature).

[0050] The claimed method may further include detecting the current change ΔT of the probe temperature in at least two spatially distinct probe regions, preferably within the imaging optics. This has the advantage of increasing the probability of detecting the current change in probe temperature as early as possible, thereby enabling readjustment as early as possible. If, for example, the change in probe temperature is detected only in one spatial probe region, there is a risk that (e.g., due to thermal inertia) the temperature change in the spatial probe region (where the actual cause of the heating resides) cannot be detected accurately or early enough, and readjustment of the focusing optics and / or zoom optics may be performed too late. Preferably, the corresponding current probe temperature T is additionally detected in at least two spatially distinct probe regions.

[0051] Additionally or alternatively, it can be specified that the at least one current temperature change ΔT is used as an input parameter for the at least one stabilization control loop, such that the stabilization control loop of the stabilization system, particularly the corresponding stabilization control loop, is triggered by, in particular, only by temperature changes. This minimizes the possibility of other non-thermal factors causing undesirable active adjustments to the zoom optics and / or focusing optics. Specifically, the stabilization control loop, particularly the corresponding stabilization control loop, is not triggered by changes in the current target value used for the optical system state.

[0052] As already mentioned, the corresponding temperature threshold (based on which the corresponding stabilization control loop of the stabilization system intervenes in open-loop control) can be related to the optical system state and / or at least one (i.e., particularly multiple) associated current detection temperature (which is measured in the detection region). Thus, the stabilization system can intervene in open-loop control, sometimes more strongly / earlier and sometimes less strongly / earlier, as needed.

[0053] For example, a small depth of field (DOF) can be produced when setting a high zoom ratio. In this case, once the current position of the focal plane has changed significantly from the current DOF due to temperature—for example, by 1.0 mm—adjustment must be applied. This is because if adjustment is only applied after, for example, a 2 mm change in the focal plane position, the current live image seen by a surgeon will become blurry because temperature stabilization has not been implemented in time. This is considered unconditionally to be avoided.

[0054] In contrast, a large working distance and a small zoom level result in a large field of view and a relatively large depth of field. Therefore, it is meaningful that the small temperature-induced drift of the focal plane is not immediately compensated for by the stabilization system through early adjustment of the focal length.

[0055] In contrast, if the described triangulation scheme is used to determine the world coordinates of an object within the camera's real-time image in such a situation (e.g., for navigation or measurement purposes), this is particularly prone to errors regarding temperature-induced fluctuations in the focal length and optical zoom level of the focusing optics. Therefore, it can be advantageous in such cases to reduce the at least one temperature threshold, from which the system initiates adjustments to the imaging optics.

[0056] In other words, it can be specified that at least one temperature threshold is adjusted according to the current operating mode of the visualization system (navigation / measurement / real-time video imaging under conditions of large working spacing and small zoom level).

[0057] If the visualization system is designed to be parfocal, then the zoom and focusing optics can be adjusted independently. In such a case, temperature drift acting on the imaging optics always has the same effect, regardless of the zoom level chosen. Therefore, if active adjustment (readjustment) of the focusing optics is necessary at high zoom levels, then this temperature stabilization / compensation will also be necessary at lower zoom levels. However, regarding navigation implemented with a visualization system, this means that if a high zoom level is initially set, once the zoom level is decreased, the absolute error in position determination automatically increases (e.g., from 1.5 mm initially to 20 mm later). Therefore, compared to high zoom levels, at low zoom levels, temperature-induced drift of the focusing optics has a stronger impact on the determined absolute position. Regarding the desired temperature stabilization, this means that at high zoom levels, temperature-induced path drift of the focal plane becomes more problematic; while at low zoom levels, if navigation or measurement of the path in the field of view is performed using a visualization system (especially automatically), the loss of accuracy is even more problematic. However, the adjustment path required for temperature stabilization of the focusing optics is the same in both cases in the parfocal design of the visualization system (i.e., it is independent of the current zoom level).

[0058] In one design, the current optical system state can be stabilized only indirectly by adjusting the at least one temperature threshold. This adjustment can, for example, be due to an externally initiated change in the system state. Thus, the system stabilizes itself and autonomously, and the adjustment matches the changed system state. The externally initiated change in the system state can, for example, be a desired change to the focusing optics and / or zoom optics.

[0059] Alternatively or additionally, it may be specified that the current optical system state is stabilized by actively adjusting the current settings of the focusing optics and / or zoom optics, particularly due to the detection of an exceedance of the at least one temperature threshold.

[0060] In both cases, the stabilization system may intervene because the at least one temperature threshold ΔT(T) is temperature-dependent (and is precisely adjusted by the stabilization system) and the current detected temperature T has changed, so that the previously detected current temperature change now exceeds the adjusted temperature threshold ΔT(T).

[0061] To address the objectives mentioned at the outset, this invention proposes the features of the claims for a visualization system. Specifically, according to the invention, in a visualization system of the type described at the outset, the imaging optics are housed within a dustproof housing, and the at least one detection area is located within the housing. This provides the advantage that the temperature detector is positioned close to the source causing the temperature rise, thereby enabling rapid detection of the temperature rise. Particularly preferred is that the at least one temperature detector is positioned close to the focusing optics.

[0062] The dustproof nature of the housing further allows for external cleaning via a sterilization mechanism, while preventing liquids from entering the interior of the visualization system. Specifically, the housing can be specified to be airtight and / or metallic.

[0063] The at least one temperature sensor can detect, for example, the at least one current temperature change (which is generated within the housing, for example, due to electrical power loss). Additionally or alternatively, it may be specified that heat generated within the housing (e.g., due to electrical power loss) can be detected at least indirectly or directly by the temperature sensor.

[0064] In the sense of this invention, a temperature detector can be understood not only as a general temperature sensor, but also as a parasitic temperature sensor—as it is often implemented in electronic components—or as a (preferably electronic) detector that estimates temperature changes based on invoked information (e.g., the current activity level of electronic components, such as image sensors or actuators or ICs (integrated circuits), for example by means of calculation, and thereby allows temperature changes to be detected indirectly.

[0065] Additionally, according to the present invention, the visualization system includes a stabilization system with at least one stabilization adjustment loop, which can actively stabilize the current optical system state of the visualization system based on the measured and / or indirectly detected at least one current temperature change. This, for example, can prevent excessive displacement of the focusing optics and / or zoom optics due to thermal effects (which would adversely affect the operation of the system).

[0066] Preferably, the visualization system, and in particular its stabilization system, is configured to perform the methods according to the present invention, and in particular as described above and / or as claimed.

[0067] In the visualization system requiring protection, it may also be advantageously specified that the at least one temperature detector is disposed within the housing adjacent to the optical lens of the imaging optics, for example, disposed on a lens mount.

[0068] Alternatively or additionally, it may be specified that the at least one temperature detector is disposed within the housing at at least one location where the thermal expansion of the optomechanical components of the imaging optics (which, for example, is determined empirically and / or simulated, particularly by means of the finite element method (FEM)) significantly affects the position and / or orientation of the focusing optics, more precisely, the position and / or orientation of the imaging optics with respect to the optical z-axis. Because these points are particularly critical in terms of stabilizing the optical system's state, the stabilization system can intervene sufficiently early in a closed-loop control manner if significant temperature changes occur at these locations.

[0069] Alternatively or additionally, the at least one temperature detector may be disposed at at least one location within the housing, at which the thermal expansion of the optomechanical components of the imaging optics significantly affects the orientation of the zoom optics about the optical z-axis of the imaging optics.

[0070] In another advantageous embodiment of the invention, the visualization system may include at least one stepper motor configured (particularly via a mechanical spindle) to adjust the focusing optics and / or zoom optics. Thus, for example, the current focal length of the focusing optics and / or the zoom optics can be actively readjusted as needed by means of detected temperature changes; more preferably, such readjustment is so that the user of the visualization system does not perceive any change in the real-time video image.

[0071] Preferably, at least two stepper motors are designed for adjusting the zoom optics and at least one stepper motor is designed for adjusting the focusing optics.

[0072] For example, it can be specified that a classic lens made of glass is moved along the optical z-axis or an optical z-axis by means of a corresponding stepper motor. The stepper motor drives the mechanical spindle, where unavoidable mechanical backlashes still allow for tolerances of a few micrometers, thus achieving an accuracy of a few micrometers when adjusting the corresponding lens along the z-axis.

[0073] In particular, each stepper motor in the stepper motor can be coupled (particularly via its own regulating circuit) to the at least one stabilization regulating circuit, particularly the corresponding stabilization regulating circuit, so that the stabilization system can drive the corresponding stepper motor in an open-loop control manner.

[0074] In an advantageous embodiment of the visualization system, it can be specified that the visualization system has at least one control unit for (particularly by means of at least one stepper motor) driving and thereby adjusting the focusing optics and / or zoom optics. Here, the stabilization system is configured to stabilize the current optical system state by means of the control unit. Thus, a regulating loop is generated for temperature stabilization of the optical system state (however, not for temperature regulation).

[0075] Preferably, even if neither the user nor the visualization system is seeking a change in the system state or intending to predetermine a change in the system state by means of a new objective for the system state, the stabilization system stabilizes the optical system state by means of the control unit.

[0076] Advantageously, in one embodiment of the visualization system, it can be specified that an artificial, preferably electronically implemented hysteresis is designed into the stabilization system, particularly as previously explained in detail. By setting an artificial / electronic hysteresis, it can be particularly ensured, as already mentioned, that a minimum adjustment path is followed when adjusting the respective focusing optics / zoom optics, which is advantageous for achieving high precision during adjustment, especially when using stepper motors. The artificial hysteresis can here be designed, particularly based on at least one (preferably variable) temperature threshold.

[0077] Preferably, the artificial hysteresis in the stabilization system is designed such that the intervention of the stabilization system in the event of temperature changes (the intervention stabilizing the current optical system state) is implemented without causing image jitter perceptible to the user in the images acquired by the visualization system. This results in significantly improved operational characteristics for the user, such as a surgeon, regarding the visualization system. The images acquired by the visualization system can be, for example, real-time video images, or, for example, within the scope of stereoscopic observation methods.

[0078] Additionally or alternatively, visualization systems of the type described at the outset, particularly those already claimed or mentioned, are provided with the features of claim 18. Specifically, therefore, to achieve the aforementioned objective, according to the invention, a visualization system, particularly a stabilization system of the visualization system, is configured to perform the methods already mentioned or claimed. This advantageously allows the aforementioned advantages of the method to be realized.

[0079] The invention will now be further described with reference to various embodiments, but the invention is not limited to these embodiments. Further improvements to the invention can be obtained from the following description of preferred embodiments in conjunction with the general specification, claims, and drawings. Attached Figure Description

[0080] In the following description of different preferred embodiments of the invention, elements that are functionally consistent with each other also acquire consistent reference numerals in different configurations or shapes. In the figures:

[0081] Figure 1 A schematic diagram of the visualization system according to the present invention is shown;

[0082] Figure 2 The time curve for detecting temperature is shown, which is in Figure 1 The imaging optics of the visualization system are automatically detected inside their housings;

[0083] Figure 3 Show Figure 1 A schematic diagram of the stabilization adjustment loop of the visualization system;

[0084] Figure 4 Show Figure 1 A schematic diagram of the system architecture of the visualization system's stabilization system; and finally...

[0085] Figure 5 This illustrates typical application scenarios where applications can be made. Figure 1 The visualization system according to the present invention. Detailed Implementation

[0086] Figure 1 The visualization system 1 according to the present invention is shown, which is as follows: Figure 5 As shown, it forms part of a robotic system 26, by which neurosurgical procedures can be performed. The entire visualization system 1—which includes the components described in claim 13—is mounted on the movable arm of the robotic system 26 and can therefore be positioned at different working intervals relative to the patient's head and thus relative to the surgical area 8. Here, the surgeon can view, as a real-time image, on a display screen 46 using the image sensor 6 of the visualization system 1.

[0087] To generate different views of the surgical area 8 during surgery, the visualization system 1 includes: an adjustable zoom optics 3, which can set the current optical zoom level 17; and an adjustable focusing optics 4, which can determine: on which current focal plane 5 the imaging optics 2 is focused, for which see... Figure 1 The structure of the imaging optics 2. The focusing optics 4 here includes two optical lenses 29, one of which—which serves as the focusing lens 36—can be moved along the optical z-axis by means of the stepper motor 20 shown, so as to adjust the focal length 23.

[0088] The zoom optical device 3 includes two zoom structure components, each including multiple optical lenses 29 and adjustable by actuators 19 in the form of corresponding stepper motors 20.

[0089] In addition Figure 1 As can be seen, the imaging optics 2 is designed for stereoscopic observation, having two parallel optical channels 47a and 47b, which terminate in corresponding image sensors 6a and 6b. Both optical channels share a focusing optics 4, while adjustable zoom optics 3 are designed in each of the corresponding channels 47a / 47b, each adjustable independently by means of two separately matched actuators 19. The individual images generated by the two image sensors 6a and 6b can be used to produce a stereoscopic view of the surgical area 8. Objective lenses 33 / 34 are provided between the corresponding image sensors 6a / 6b and the corresponding zoom optics 3, in each of the two optical channels 47a and 47b. Actuators 19 for adjusting the zoom optics 3 at the lower part of the second optical channel 47b are located in… Figure 1 The text is not shown for clarity.

[0090] Each of the optical channels 47a and 47b has a corresponding temperature detector 27, which is positioned at different locations within a housing 28 that generally dustproofs the imaging optics 2. Figure 1 In the example, these temperature detectors 27 are designed in the form of corresponding temperature sensors 15, which are capable of directly sensing and measuring the corresponding detection temperature 12 within the corresponding detection area 13. However, alternatively, it is also possible to detect, for example, only indirectly, i.e., non-sensory, a single detection temperature among these detection temperatures 12. For this purpose, the corresponding temperature detector 27 can be configured, for example, to estimate the local change in detection temperature 12 based on the detected activity level of the electronic components generating heat loss power, so as to indirectly detect the temperature change. The temperature detectors 27 positioned at different locations within the imaging optics 2 and the corresponding detection areas 13 detected by them are described below. Figure 1 The image is shown as a dashed ellipse, in which the temperature detector 27 is naturally not placed in the corresponding imaging optical path so as not to interfere with the corresponding optical imaging. However, all these detection areas 13 are located (in...) Figure 1 (As shown by the dashed line) Inside the housing 28, the imaging optics 2 are isolated from the outside world.

[0091] As mentioned at the beginning, significant temperature changes may occur for various reasons, which are relevant to the use of visualization system 1 (see [link to visualization system 1]). Figure 5This can lead to the current optical system state—including the current optical zoom level 17 and the current spatial position of the focal plane determined by the focusing optics 4 (wherein the corresponding optical zoom level 17 may even deviate slightly between the two optical channels 47a and 47b)—changing in an undesirable manner. For example, it may happen that the position of the current focal plane shifts due to thermal drift within the imaging optics 2, causing the surgeon to no longer obtain a clear image of the surgical area 8, which could be very disruptive. To prevent such a situation and in particular to enable the neurosurgeon to focus on the original surgery without having to manually adjust the visualization system 1, which has a stabilization system 9, the stabilization system can actively stabilize such temperature-induced fluctuations in the optical system state by means of a stabilization adjustment loop 10. Here, the corresponding probe temperature 12 is continuously detected by the stabilization system 9 (directly or at least indirectly).

[0092] exist Figure 1 The system 1 shown herein has a plurality of such stabilization regulation loops 10, wherein, Figure 3 An example is shown of one of these adjustment loops 10: starting from the current temperature 25 (which is continuously detected as a detection temperature 12 within a detection area 13 monitored by one of the temperature detectors 27), comparator 41 compares this current measurement value with the current reference temperature 40 (= stored / currently saved value, which is used as a reference point for the adjustment loop). Through this comparison, the stabilization system 9 thus detects the current temperature change 11 relative to the current reference temperature 40, and thereby calculates the new positions of the focusing optics 4 and the zoom optics 3 for the optical channels 47a / 47b (where the temperature detectors 27 are located) in calculation step 42.

[0093] If, for example, a significant temperature change 11 relative to the current reference temperature 40 is detected in the region of the commonly used focusing optics 4, then the stabilization system 9 can not only intervene in the focusing optics 4 in a closed-loop control and accordingly actively adjust the focusing optics, but also supplementarily act in an open-loop control on the two zoom optics 3 of the two optical channels 47a, 47b (in Figure 3 (Only one such path is shown for a single lens 29). Figure 3 In the example shown, the stabilization system 9, or more precisely the stabilization adjustment loop 10 shown, thereby causes a corresponding change 43 in the position or setting of the focusing optics 4 and / or the zoom optics 3.

[0094] Here, the stabilization system 9 calculates the precise magnitude and direction of the corresponding active adjustment to be performed by the focusing optics 4 and / or the zoom optics 3 according to the corresponding temperature model. The corresponding temperature model used to determine the required active adjustment (e.g., ΔFL(T, ΔT, FL, ZL)) describes the temperature characteristics of the corresponding optics 3 / 4, more precisely, based on the reference temperature 40 (=T) used, the detected temperature change 11 (=ΔT), and the currently set zoom level (ZL) and the focal length (FL) of the focusing optics 4 (which gives the current position of the focal plane).

[0095] Therefore, in step 43, the focusing optics 4 and / or the zoom optics 3 are actively adjusted by the stabilization adjustment loop 10. Naturally, steps 42 and 43 only occur when the previously detected current temperature change 11 has actually exceeded the current temperature threshold 18.

[0096] Because the probe temperature 12 is continuously detected, the reference temperature 40 is also updated in step 44 (dashed arrow). This can be achieved, for example, by measurement 48 or alternatively by means of an updated estimate of the probe temperature 12. The reference can be applied in particular to the temperature detected at the moment of active adjustment of the imaging optics 2: if, for example, a temperature of 25°C is detected, which is already above the threshold 18 of 24°C, and active adjustment of the imaging optics 2 is subsequently implemented, then the new reference value can be adjusted to 25°C. In other words, preferably, the reference temperature 40 for the specific probe temperature 12 of the specific probe region 13 is updated whenever the associated stabilization control loop 10 / stabilization system 9 intervenes in the imaging optics 2 in an open-loop control manner.

[0097] The reference temperature 40 can be determined, for example, based on the temperature detected at the time of compensation, according to calculation rules. However, it can also be determined, for example, that an adjustment is made once if a certain first temperature threshold (e.g., T=23°C) is exceeded, and another adjustment is made only if a certain second temperature threshold (e.g., T=26°C) is exceeded.

[0098] Therefore, temperature stabilization in the sense of this invention can be achieved in two ways:

[0099] A) The at least one temperature threshold remains unchanged. If, for example, adjustment is implemented due to exceeding a first temperature threshold of 23.0°C and subsequently measured at 25.80°C, then adjustment is only reimplemented if the temperature increases further and reaches a second temperature threshold of 26°C. Thus, scheme A) specifies an immutable threshold, thereby stabilizing the system so that intervention is always performed at the same temperature.

[0100] B) However, the reference temperature can also be moved, for example, by means of temperature increments (see: Figure 2 In other words, the imaging optics are adjusted according to the currently measured temperature, for example, 25.8°C, and the temperature threshold is shifted upward by a fixed value, for example, 1.5°C, that is, to 27.3°C as the upper threshold and 24.3°C as the lower threshold. Therefore, this scheme B) specifies an actively carried threshold, whereby the temperature (from which the stabilization system intervenes in closed-loop control) can continuously change as long as the stabilization system intervenes. The corresponding temperature threshold shift value can be derived from at least one temperature currently detected by the stabilization system 9.

[0101] In addition Figure 3 As can be seen: the stabilization adjustment loop generates a corresponding drive control signal 49, which is used to adjust the zoom optics 3 and / or the focusing optics 4 (in Figure 3 (Only one of these signals 49 is shown as an example). In the example shown, the stabilization system 9, or more precisely the stabilization adjustment loop 10 shown, intervenes in a separate adjustment loop 22, which adjusts one of the lens actuators 19 so that the lens 29 moves a determined distance Δz1.

[0102] The stabilization adjustment loop 10 can, in step 43, for example, pass control parameters 50 for adjusting the corresponding lens position to the appropriate adjustment loop 22, thereby causing the actuator 19 to cause a corresponding adjustment of the lens 29. This can indeed happen noticeably if neither the visualization system 1 nor the user has pre-defined a new vision system state as a predetermined goal. Naturally, even if neither the robotic system 26 nor the user wants to set an alternative focal plane, the stabilization system 9 can still autonomously respond to the detected current temperature change 11 and actively adjust the focusing optics 4, especially considering the current optical system state, in order to preventively suppress temperature-induced drift in the optical system state. This proactively stabilizes the image, allowing the surgeon to focus on the surgical procedure.

[0103] The challenge in this adjustment scheme is that the surgeon should not feel disturbed: the stabilization system 9 continuously and thus interferingly adjusts the zoom optics 3 and / or the focusing optics 4. For this reason, the stabilization adjustment loop 10 is equipped with artificial hysteresis, so that the visualization system 1 can be in different optical system states at the same temperature, depending on how the current detection temperature 12 is reached, i.e., whether it is reached due to a temperature increase or a temperature decrease.

[0104] This approach can, for example, be well based on Figure 2Implementation: The time curve of the detected temperature 12, detected by the temperature sensor 15 using the visualization system 1, is visible there. The stabilization system 9 detects the current temperature change 11 at regular intervals as the difference between the currently detected temperature 12 and the currently stored reference temperature 40. As long as the continuously detected temperature change 11 ΔT remains within the boundaries defined by the two temperature thresholds 38 and 39, the stabilization system 9 does not intervene.

[0105] However, after time t1 has exceeded the upper temperature threshold 38, the stabilization system 9 thereby stabilizes the optical system state unchanged due to the temperature change 11 that occurred before the intervention, thus stabilizing the optical system state again. The adjustment of the focusing optics 4 and / or the zoom optics 3 caused by the intervention of the stabilization system 9 is thus... Figure 2 The varying shaded lines are used to indicate this. Therefore, exceeding the temperature threshold 18 is understood here as exceeding the corresponding temperature boundary 38 / 39: this can occur in a positive or negative direction, as can be well understood according to… Figure 2 As understood. According to the design scheme, the temperature thresholds of 38 and 39 can also be located at different distances from the reference temperature of 40 (= asymmetrical temperature intervals).

[0106] As can be seen here, the stabilization adjustment loop 10 has a hysteresis 14. If we compare the two moments A and C: although the same detection temperature 12 exists / is detected at these two moments, the two optics 3 and 4 are in different settings. In other words, point A is reached within the two boundaries 38 and 39 by a slight temperature increase, while point C is reached after the temperature drops from moment B and after exceeding the upper temperature threshold 38.

[0107] Conversely, at time t2, the currently detected temperature 12 falls below the lower temperature threshold 39, and the stabilization control loop 10 then intervenes again in a closed-loop control manner to re-stabilize the optical system state. The resulting altered settings for the two optics 3 and 4 are shown again by different shaded lines. Furthermore, it can be seen that when the stabilization control loop 10 intervenes in a controlled manner / by adjusting optics 3 and / or 4, the stored reference temperature 40 and the positions of the upper and lower temperature thresholds 38 and 39 are always adjusted accordingly. Therefore, the stabilization control loop 10 has, for example, intervened at time t2 at a detection temperature 12 that the stabilization control loop had not intervened during the time period t0 to t1. In other words, temperature thresholds 38 and 39 are selected here based on the currently stored reference temperature 40, respectively. Here, the system can also match the size of the temperature interval defined by the two temperature thresholds 38 and 39 (in which the stabilization adjustment loop 10 does not intervene) based on the height of the currently saved reference temperature 40 (and thus determine whether to intervene earlier or later according to the requirements of the application and / or the imaging optics 2 used).

[0108] Figure 4 A feasible implementation of the stabilization system 9 according to the invention is shown: the stabilization system includes a control unit 31, implemented by means of a microcontroller 45, which is configured to: calculate a new position of the focusing optics 4 or the zoom optics 3 based on a plurality of corresponding probe temperatures 12 detected by means of temperature sensors 15.1, 15.2, and 15.3 (calculation step 42). Here, the microcontroller 45 also considers a current temperature threshold 18. The current temperature threshold is also adjusted by the control unit 31, as well as the corresponding current reference temperature 40, based on the current optical system state and on at least one of the three different probe temperatures 12.

[0109] The microcontroller 45 implements multiple stabilization regulation loops 10, which may, for example, be similar to... Figure 3 The control unit 31 / microcontroller 45 is configured in an open-loop manner, intervening in the respective individual regulation loops 22 via corresponding drive signals 49, so that the respective actuators 19 are operated by the regulation loops. In this way, the control unit 31 can, as Figure 1 As shown, when needed, the two structural components of the zoom optics 3 and the common focusing optics 4 are actively adjusted, thereby ultimately stabilizing the zoom level 17, the focal length 23, and thus the position of the focal plane.

[0110] In summary, to improve the operation of the visualization system 1 (which includes an imaging optics 2 with an adjustable zoom optics 3 and an adjustable focusing optics 4), it is proposed that: at least one detection temperature 12 be detected directly or indirectly (e.g., by estimation) within the imaging optics 2 by means of at least one temperature detector 27, and whenever the currently detected temperature change 11 with respect to the detection temperature 12 exceeds a temperature threshold 18, the focusing optics 4 and / or the zoom optics 3 be actively adjusted by means of a stabilization system 9 including one or more stabilization adjustment loops 10 (see [link to documentation]). Figure 1 ).

[0111] List of reference numerals

[0112] 1. Visualization System

[0113] 2 Imaging Optical Devices

[0114] 3 zoom optics

[0115] 4. Focusing Optics

[0116] 5 focal planes

[0117] 6 Image Sensors

[0118] 7. Objects of observation

[0119] 8 surgical areas

[0120] 9 Stabilization System

[0121] 10 Stabilization Regulation Loop

[0122] 11 Temperature Change

[0123] 12 Temperature Detection

[0124] 13 Detection Areas

[0125] 14 Lag

[0126] 15 Temperature Sensors

[0127] 16 electronic components

[0128] 17 zoom levels

[0129] 18 Temperature Threshold

[0130] 19 actuators

[0131] 20 stepper motor

[0132] 21 Z-axis

[0133] 22 Regulating Loop

[0134] 23 focal length

[0135] 24 Adjustment Path

[0136] 25. Current detected temperature

[0137] 26 Robot Systems

[0138] 27 Temperature Detector

[0139] 28 housing

[0140] 29 lenses

[0141] 30 lens mount

[0142] 31 control unit

[0143] 32 Thermistor

[0144] 33 Objective Lens 1

[0145] 34 Objective Lens 2

[0146] 35 electric motor

[0147] 36-focusing lens

[0148] 37 Timeline

[0149] Temperature threshold above 38

[0150] Temperature threshold at 39

[0151] 40 reference temperature

[0152] 41 comparator

[0153] 42. Calculate the new position of the focusing optics / zoom optics.

[0154] 43 Change position

[0155] 44. Update the detected probe temperature (as the current measurement value / as the reference temperature used for regulating the loop).

[0156] 45 microcontrollers

[0157] 46 displays

[0158] 47 optical channels

[0159] Measurement of 48 12

[0160] 49 drive control signals

[0161] 50 control parameters

[0162] 15.1 Temperature Sensor 1

[0163] 15.2 Temperature Sensor 2

[0164] 15.3 Temperature Sensor 3

[0165] 19.1 Actuator 1

[0166] 19.2 Actuator 2

[0167] 19.3 Actuator 3

Claims

1. A method for temperature stabilization of the current optical system state of a visualization system (1), the visualization system including an imaging optics (2), the imaging optics comprising: - Adjustable zoom optics (3) for determining the current optical zoom level (17), and - Adjustable focusing optics (4) for determining the current spatial position of the focal plane (5), and including: - At least one image sensor (6). - wherein at least one image of the object (7) observed by the visualization system (1) is acquired by the at least one image sensor (6), and -In this method, the current optical system state is stabilized relative to temperature fluctuations within the imaging optics (2), the current optical system state including the current optical zoom level (17) and the current spatial position of the focal plane (5). Its features are, - By means of a stabilization system (9) including at least one stabilization regulation loop (10), at least one current temperature change (11) of the probe temperature (12) in at least one probe area (13) within the visualization system (1) is continuously, directly or indirectly detected, and - Once at least one temperature threshold (18) for the at least one current temperature change (11) is exceeded, the at least one stabilization control loop (10) actively adjusts the focusing optics (4) and / or the zoom optics (3), and To avoid image jitter in the at least one acquired image, the at least one stabilization adjustment loop (10) is designed to have artificial hysteresis (14).

2. The method according to claim 1, wherein, The at least one stabilization adjustment loop (10) automatically initiates different adjustments of the focusing optics (4) and / or zoom optics (3) based on artificial hysteresis (14) according to the current optical system state and the direction of the detected current temperature change (11).

3. The method according to claim 1, -Where, the artificial lag is determined with respect to the corresponding lens position, and / or -in, The artificial lag is automatically adjusted by the stabilization system (9) based on the currently selected zoom level (17) and / or based on the current position of the focal plane (5).

4. The method according to any one of claims 1 to 3, wherein, - Direct sensing via temperature sensor (15) and / or -indirectly Detect the temperature (12); and / or -Continuously detect the corresponding probe temperature (12) as the corresponding current temperature (25); and / or - Determine the temperature change (11) relative to the stored reference temperature (40).

5. The method according to any one of claims 1 to 3, wherein, The corresponding adjustments to the focusing optics (4) and / or the zoom optics (3) are performed at different times depending on the current state of the optical system and the detected at least one current temperature change (11).

6. The method according to any one of claims 1 to 3, wherein, The at least one stabilization adjustment loop (10) works even when no new optical system state is given by the visualization system (1) itself or by the user as a specified target.

7. The method according to any one of claims 1 to 3, wherein, In the event that the at least one temperature threshold (18) and / or at least one position threshold is exceeded, the at least one stabilization adjustment loop (10) drives at least one actuator (19) of the focusing optics (4) and / or the zoom optics (3).

8. The method according to any one of claims 1 to 3, wherein, - Once the at least one current temperature change (11) of the detected temperature (12) exceeds the phase-matched temperature threshold (18) that is still permissible for the current optical system state, the stabilization system (9) adjusts the focusing optics (4) and / or the zoom optics (3) in an open-loop control.

9. The method according to any one of claims 1 to 3, wherein, The stabilization system (9) adjusts the focusing optics (4) and / or the zoom optics (3) in an open-loop control based on the corresponding temperature model so as to stabilize the current state of the optical system relative to the detected at least one current temperature change (11).

10. The method according to any one of claims 1 to 3, wherein, The stabilization system (9) calculates suitable compensatory adjustments to the zoom optics (3) and / or the focusing optics (4) based on the detected at least one current temperature change (11), and - This generates corresponding drive signals (49) for adjusting the zoom optics (3) and / or the focusing optics (4).

11. The method according to any one of claims 1 to 3, wherein, The stabilization system (9) takes into account the detected value of the current probe temperature (12) and adjusts accordingly: -The at least one temperature threshold (18), from which the stabilization system (9) intervenes in an open-loop controlled manner, and / or - The corresponding temperature model.

12. The method according to any one of claims 1 to 3, -in, Detect the current change ΔT of the probe temperature (12) in at least two spatially distinct probe regions (13), and / or - wherein the at least one current temperature change (11) is used as an input parameter of the at least one stabilization regulation loop (10), such that the stabilization regulation loop (10) of the stabilization system (9) is triggered by the temperature change (11).

13. The method according to any one of claims 1 to 3, wherein, Current optical system status: -Indirectly through adjustments to the at least one temperature threshold (18) caused by externally initiated changes in the system state and / or - By actively adjusting the current settings of the focusing optics (4) and / or the zoom optics (3). And thus stabilized.

14. The method according to claim 1, characterized in that, The visualization system is a medical visualization system (1).

15. The method according to claim 1, characterized in that, The object (7) is the surgical area (8).

16. The method according to claim 1, characterized in that, The artificial delay is implemented electronically.

17. The method according to claim 2, wherein, The at least one stabilization adjustment loop (10) automatically initiates different adjustments of the focusing optics (4) and / or zoom optics (3) based on artificial hysteresis (14) according to the current optical system state and according to the direction of the detected current temperature change (11), regardless of whether a new target value for adjusting the focusing optics (4) and / or zoom optics (3) is pre-given from outside the at least one stabilization adjustment loop (10).

18. The method according to claim 3, characterized in that, The artificial lag is determined based on the corresponding lens position, so that the visualization system (1) can still be in different system states under the same temperature conditions.

19. The method according to any one of claims 1 to 3, wherein, The probe temperature is detected by calculating the current electrical loss power of the electronic component (16) based on the visualization system (1).

20. The method according to claim 4, wherein, Once the stabilization system (9) intervenes in the closed-loop control or open-loop control, the reference temperature (40) is adjusted / updated.

21. The method according to claim 5, wherein, The corresponding adjustments to the focusing optics (4) and / or the zoom optics (3) are not performed earlier than the current adjustment of the focusing optics (4) and the currently set zoom level (17) with respect to the detected at least one current temperature change (11).

22. The method according to claim 5, wherein, Therefore, the at least one temperature threshold (18) is adjusted according to the current optical system status.

23. The method according to claim 5, wherein, The corresponding adjustments to the focusing optics (4) and / or the zoom optics (3) are performed at different times depending on the current state of the optical system and the detected at least one current temperature change (11), such that temperature stabilization is intervened to stabilize at small temperature changes in the detected temperature (12) or only to stabilize at large temperature changes.

24. The method according to claim 6, wherein, Even when no new optical system state is pre-defined by the visualization system (1) itself or by the user as a specified target, the at least one stabilization adjustment loop (10) operates, so that the optical system state set once is continuously stabilized by the stabilization system (9) relative to temperature fluctuations.

25. The method according to claim 6, wherein, Even when no new optical system state is pre-given by the visualization system (1) itself or by the user as a specified target, the at least one stabilization adjustment loop (10) operates without user intervention and / or without the user perceiving the intervention of the open-loop control of the stabilization system (9) in the real-time image recorded by the at least one image sensor (6).

26. The method according to claim 7, wherein, The actuator (19) is a stepper motor (20).

27. The method according to claim 7, wherein, In the event that the at least one temperature threshold (18) and / or at least one position threshold is exceeded, the at least one stabilization adjustment loop (10) drives at least one actuator (19) of the focusing optics (4) and / or the zoom optics (3) to adjust the focusing optics (4) and / or the zoom optics (3) along the optical z-axis (21) of the imaging optics (2).

28. The method according to claim 7, wherein, The at least one stabilization control loop (10) drives the corresponding actuator (19) via a separate corresponding control loop (22), and the actuator (19) can be controlled in a closed loop by means of the separate corresponding control loop.

29. The method according to claim 8, wherein, Once the at least one current temperature change (11) of the detected temperature (12) exceeds the phase-matched temperature threshold (18) that is still permissible for the current optical system state, the stabilization system (9) adjusts the focusing optics (4) and / or the zoom optics (3) in an open-loop controlled manner, regardless of the corresponding target values ​​previously set by the user or by the visualization system (1) for the adjustment of the focusing optics (4) and / or the zoom optics (3).

30. The method according to claim 8, wherein, No target actual values ​​for the corresponding adjustment parameters of the focusing optics (4) and / or the zoom optics (3) are presented here.

31. The method according to claim 30, wherein, The corresponding adjustment parameter is the final preset focal length (23) or the final preset optical zoom level (17).

32. The method according to claim 8, wherein, Once the at least one current temperature change (11) of the detected temperature (12) exceeds the phase-matched temperature threshold (18) that is still permissible for the current optical system state, the stabilization system (9) adjusts the focusing optics (4) and / or the zoom optics (3) in an open-loop control. --Irrelevant to the corresponding target values ​​previously set by the user or by the visualization system (1) for the adjustment of the focusing optics (4) and / or the zoom optics (3), - No target actual values ​​for the corresponding adjustment parameters of the focusing optics (4) and / or the zoom optics (3) are presented here. - This allows the stabilization system (9) to intervene with respect to the stabilization of the optical system state even if there are no new instructions from the user or the visualization system (1) for adjusting the focusing optics (4) and / or for adjusting the zoom optics (3).

33. The method according to claim 9, wherein, The stabilization system (9) adjusts the focusing optics (4) and / or the zoom optics (3) in an open-loop control based on the corresponding temperature model and deviates from the corresponding target value given at the end, so as to stabilize the current optical system state relative to the detected at least one current temperature change (11).

34. The method according to claim 9, wherein, The corresponding temperature model models the necessary temperature-dependent adjustment of the focusing optics (4) or the necessary temperature-dependent adjustment of the zoom optics (3).

35. The method according to claim 9, wherein, The temperature model described here takes into account the current state of the optical system.

36. The method according to claim 9, wherein, The temperature model here takes into account the current focal length FL of the focusing optics (4) and / or the current zoom level ZL of the zoom optics (3).

37. The method according to claim 10, wherein, The stabilization system (9) calculates the appropriate adjustment path Δz (24) of the zoom optics (3) and / or the focusing optics (4) along the optical z-axis (21) based on the detected at least one current temperature change (11) using a temperature model, and thereby generates corresponding drive signals for intervening in the respective individual adjustment loops (22) for adjusting the zoom optics (3) and / or the focusing optics (4) in order to thereby stabilize the current optical system state in relation to temperature.

38. The method according to claim 11, wherein, The stabilization system (9) takes into account the detected value of the current probe temperature (12) and adjusts according to the detected value of the probe temperature (12) after the stabilization system (9) has intervened in an open-loop control manner: -The at least one temperature threshold (18), from which the stabilization system (9) intervenes in an open-loop controlled manner, and / or - The corresponding temperature model.

39. The method according to claim 12, wherein, The current change ΔT of the detection temperature (12) is detected in at least two spatially different detection regions (13) within the imaging optics (2), and the current detection temperature (12) is also detected.

40. The method according to claim 12, wherein, The at least one current temperature change (11) is used as an input parameter of the at least one stabilization adjustment loop (10) such that the corresponding stabilization adjustment loop (10) of the stabilization system (9) is triggered only by the temperature change (11), but not by the change of the current target value for the optical system state.

41. The method according to claim 13, wherein, Current optical system status: - The current settings of the focusing optics (4) and / or the zoom optics (3) are stabilized by actively adjusting them due to the detected exceedance of the at least one temperature threshold (18).

42. The method according to claim 13, wherein, The stabilization system (9) intervenes to stabilize the current optical system state because the at least one temperature threshold (18) is temperature-dependent and the currently detected temperature T has changed, so that the previously detected current temperature change (11) now exceeds the adjusted temperature threshold (18).

43. Visualization system (1) The visualization system includes an imaging optics device (2), which includes: - Adjustable zoom optics (3) for determining the current optical zoom level (17), and - Adjustable focusing optics (4) for determining the current spatial position of the focal plane, - At least one image sensor (6) for acquiring at least one image of the object (7) observed by the visualization system (1), and - At least one temperature detector (27) configured to directly sense and / or indirectly sense at least one current temperature change (11) of the probe temperature (12) within at least one probe area (13). Its features are, - The imaging optics (2) are disposed within a dustproof housing (28), and the at least one detection area (13) is located within the housing (28). The visualization system (1) includes a stabilization system (9) with at least one stabilization adjustment loop (10), which actively stabilizes the current optical system state of the visualization system (1) based on the measured and / or indirectly detected current temperature change (11), and - An artificial lag (14) is designed in the stabilization system (9). - The visualization system (1) is configured to perform the method according to any one of claims 1 to 42.

44. The visualization system (1) according to claim 43. -in, The at least one temperature detector (27) is disposed within the housing (28) adjacent to the optical lens (29) of the imaging optics (2), and / or - The at least one temperature detector is disposed at at least one position within the housing (28), at which the thermal expansion of the optomechanical components of the imaging optics (2) significantly affects the position and / or orientation of the focusing optics (4) and / or the zoom optics (3) about the optical z-axis (21) of the imaging optics (2), respectively.

45. The visualization system (1) according to claim 43 or 44, wherein, The visualization system (1) - Includes at least one stepper motor (20), which is configured to adjust the focusing optics (4) and / or the zoom optics (3).

46. ​​The visualization system (1) according to claim 43 or 44, wherein, The visualization system (1) has at least one control unit (31) for driving and thereby adjusting the focusing optics (4) and / or the zoom optics (3), and the stabilization system (9) is configured to stabilize the current optical system state by means of the control unit (31).

47. The visualization system (1) according to claim 43 or 44, wherein, Artificial hysteresis (14) is designed based on at least one temperature threshold (18).

48. The visualization system (1) according to claim 43, wherein, The visualization system is designed as part of a robotic system (26) and / or as a medical visualization system (1).

49. The visualization system (1) according to claim 43, wherein, The object (7) is the surgical area (8).

50. The visualization system (1) according to claim 43, wherein, The artificial delay is implemented electronically.

51. The visualization system (1) according to claim 43, wherein, The stabilization system (9) is configured to perform the method according to any one of claims 1 to 42.

52. The visualization system (1) according to claim 44, wherein, The at least one temperature detector (27) is mounted on the lens mount (30).

53. The visualization system (1) according to claim 45, wherein, The stepper motor (20) is configured to adjust the focusing optics (4) and / or the zoom optics (3) via a mechanical spindle.

54. The visualization system (1) according to claim 45, wherein, At least two stepper motors (20) are designed to adjust the zoom optics (3), and at least one stepper motor (20) is designed to adjust the focusing optics (4).

55. The visualization system (1) according to claim 45, wherein, Each stepper motor (20) is coupled to the at least one stabilization regulation loop (10), so that the stabilization system (9) can drive the corresponding stepper motor (20) in an open-loop control manner.

56. The visualization system (1) according to claim 45, wherein, Each stepper motor (20) is coupled to the corresponding stabilization control circuit (10) via its own control circuit (22), so that the stabilization system (9) can drive the corresponding stepper motor (20) in an open-loop control manner.

57. The visualization system (1) according to claim 46, wherein, The visualization system (1) has at least one control unit (31) for driving and thereby adjusting the focusing optics (4) and / or zoom optics (3) by means of at least one stepper motor (20).

58. The visualization system (1) according to claim 46, wherein, The stabilization system (9) is configured to stabilize the current optical system state by means of the control unit (31), even if neither the user nor the visualization system (1) happens to be pursuing a change in the system state or pre-given a change in the system state by means of a new target for the system state.

59. The visualization system (1) according to claim 47, wherein, Artificial hysteresis (14) is designed based on at least one variable temperature threshold (18).

60. The visualization system (1) according to claim 47, wherein, Artificial hysteresis (14) is designed based on at least one variable temperature threshold (18) such that the intervention of the stabilization system (9) to stabilize the current optical system state is implemented in the case of temperature change (11) while avoiding image jitter perceptible to the user in the image recorded by the visualization system (1).

Citation Information

Patent Citations

  • Projector and method of controlling projector

    CN104853126A

  • Automatic focusing method and related optical imaging system

    CN116908993A