Medical observation device with a control unit and use of an input module

The integration of a multi-axis input module in medical observation devices addresses the challenge of compact design and intuitive operation, enabling efficient image processing and control within the device, facilitating hands-free operation and simplified data handling.

DE102015121017B4Active Publication Date: 2025-12-04KARL STORZ SE & CO KG
View PDF 17 Cites 0 Cited by

Patent Information

Application Number
DE102015121017
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2015-12-03
Publication Date
2025-12-04
Estimated Expiration
2035-12-03

AI Technical Summary

Technical Problem

Existing medical observation devices, such as endoscopes and exoscopes, face challenges in achieving a compact design while providing extended functionality, particularly in image magnification and intuitive operation, often requiring complex mechanisms and separate controls for image acquisition, processing, and display units.

Method used

A medical observation device with a multi-axis input module that integrates image acquisition, processing, and display units, allowing for simultaneous control of image parameters and playback functions through a single input module, enabling compact design and intuitive operation without the need for separate controls.

Benefits of technology

The solution enables easy, error-free operation with extended functionality, allowing for varied image magnification and simplified data processing within the device, reducing the need for complex optical zoom and separate computing technology, and ensuring hands-free operation for surgeons.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Medical observation device (10) comprising the following: - an image acquisition unit (18) with at least one image sensor (26), preferably a stereo image acquisition unit with two image sensors, - a playback unit (16) designed to play back image data provided by the image acquisition unit (18), - an image processing unit (20) for image processing processes, and - an operating unit (22) with a multi-axis input module (50) designed as a one-hand input module and featuring an actuating element (52, 90, 104) that can be manipulated by an operator and provides several degrees of freedom (80, 82, 84, 86; 80, 82, 98, 100) for inputs, wherein the image acquisition unit (18) is configured to provide recording images (58), wherein the display unit (16) is configured to display display images (60), where image acquisition parameters and playback parameters can be controlled simultaneously via the input module (50), and wherein the input module (50) is coupled to the image acquisition unit (18), the playback unit (16) and the image processing unit (20) in order to vary image acquisition parameters on the image acquisition unit (18) and to vary playback parameters on the playback unit (16) and / or the image processing unit (20).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present disclosure relates to a medical monitoring device comprising an image acquisition unit, a display unit, an image processing unit, and an operating unit. The disclosure further relates to the use of a multi-axis input module.

[0002] For the purposes of this disclosure, observation devices may include endoscopes, exoscopes, and similar optical instruments. Preferably, these are optical instruments equipped with image sensors to generate a digital image of an object to be observed. Such instruments are typically designed as so-called eyepieceless instruments. In other words, these instruments do not include a conventional, purely optical beam path between the objective lens and a user's eye.

[0003] Instead, eyepiece-less instruments regularly include playback units in the form of screens, video glasses (head-mounted displays), or similar devices. This can offer several advantages. For example, multiple playback units can easily be connected, all of which can use the same image signal.

[0004] Eyepiece-less instruments designed for stereoscopic imaging are also known. Such instruments typically feature two image sensors positioned adjacent to each other and offset by a defined distance or angle.

[0005] Image sensors can generally be coupled with suitable input beam optics. In this way, a desired optical image can be achieved.

[0006] The present disclosure relates in particular to observation devices with compact image acquisition units. For both endoscopes and exoscopes, small dimensions are of paramount importance, especially at the distal end of the instruments. In the case of endoscopes, this applies particularly to the cross-section or diameter of the distal end. Endoscopes are typically designed to be inserted into body orifices. To minimize the burden on patients, small dimensions are desirable. The distal end of an endoscope is generally understood to be the end furthest from the user or observer. A proximal end opposite the distal end is generally understood to be the end closest to the user or observer.

[0007] An exoscope can also be generally referred to as a microscope. Exoscopes are typically designed to observe a target object from outside the body at a defined working distance, which can range from approximately 25 to 75 cm. However, even with exoscopes, the aim is to make the image acquisition units, lenses, and generally the distal (farthest from the observer) end of the instrument compact. This provides, for example, a surgeon with the unobstructed field of view possible. Even when an exoscope is positioned at a specific working distance from an object (such as a surgical site to be observed), the accessibility of the surgical site should still be ensured as much as possible.

[0008] The desired compactness often means that endoscopes and exoscopes without eyepieces forgo complex mechanisms for changing the focal length (optical zoom). However, there are conceivable applications where only a portion of the object field captured at a given focal length is of interest. With both endoscopes and exoscopes, however, the working distance often cannot be varied arbitrarily. Due to their compact size, optical instruments such as endoscopes or exoscopes can be operated manually. Nevertheless, there are various applications where the instrument is fixed to a stand or similar holding device. This is particularly relevant when a virtually shake-free image is desired. Furthermore, fixing the instrument has the advantage of freeing up both hands of the surgeon or assistant for other tasks.

[0009] With eyepiece-less instruments, particularly eyepiece-less exoscopes or endoscopes, it is possible to position image sensors very close to the instrument's objective lens. Since no (optical) eyepiece is required, it is unnecessary to route an optical beam path through the instrument or a significant portion of it. In other words, an image of the object being observed can be captured near the distal end of the instrument and converted into electrical signals, from which image data can be derived. This typically necessitates the inclusion of certain data processing capabilities within the instrument itself. This can include at least limited computing power. Furthermore, buffer memory and similar components may be incorporated.

[0010] An eyepiece-less instrument typically also has an interface through which image data can be supplied to a display unit or an (external) image processing unit. This image data can be raw data. However, the image data can also be processed or manipulated within the instrument itself.

[0011] No conventional eyepiece is provided through which an observation beam path is directly visible to a human eye (e.g., that of a surgeon). In an eyepieceless instrument as described in this disclosure, optical signals from the observation field are converted or transformed into image data, which are then again converted into optical signals, for example, for display on a screen.

[0012] An exoscope as defined in the present disclosure is known by way of example from DE 10 2013 110 543 A1. The previously known exoscope is designed as a stereo exoscope and includes stereo optics for recording a stereo image.

[0013] From DE 10 2011 078 967 A1, an observation device in the form of a microscope is known, comprising a surgical microscope. Furthermore, the microscope has a screen on which accessible device functions can be displayed. A rotary-push control is provided for selecting and activating the displayed device functions. The rotary-push control has two actuation axes, namely a rotary axis for rotational actuation and a translational axis for push-action.

[0014] From US 6 222 906 B1, an X-ray diagnostic system is known, comprising an X-ray source for generating X-rays, a flat-panel detector for detecting the X-rays, and a display device, wherein the system defines an area on the flat-panel detector in which pixel data is captured, wherein means are provided for capturing a patient area that is read out, and wherein the display device can display different pixel areas with different magnifications depending on a display mode.

[0015] From EP 1 972 260 A1, an endoscopy system is known, comprising an image generation function for generating a moving image and a still image of an observation object according to an output signal of an image recording device, and a magnification function for generating an electronically magnified image of the observation object in response to a magnification operation, wherein the endoscopy system displays images of the observation object as a picture-in-picture function, and wherein the endoscopy system provides a moving image of a first resolution and a still image of a magnified resolution.

[0016] KLETT [ed.]: Teaching materials on: Evaluating planning processes - Stuttgart 21. ISBN 978-3-12-104119-0. Stuttgart, Leipzig: Ernst Klett Verlag, 2014, contains a section (Google Earth Tutorial. Section 1.3: Control / Navigation in Google Earth and important keyboard commands; 1.: Control / Navigation using the mouse) which deals with the operation of Google Earth with a standard computer mouse.

[0017] Against this background, the invention aims to provide an observation device, particularly a medical observation device, that is easy and error-free to operate and allows for a compact design of at least one image acquisition unit of the observation device. Preferably, the observation device should nevertheless have extended functionality, in particular the ability to select and vary the magnification of the image of the object field. Furthermore, the operating unit is preferably functionally coupled to the observation device in such a way that intuitive operation of at least some functions relating to image acquisition and some functions relating to image reproduction is enabled.In other words, the preferred operating logic allows an operator to easily interact with images captured by the image acquisition unit and images displayed by the playback unit without consciously realizing it. From the operator's perspective, it is preferably irrelevant whether, for example, they directly interact with the optics of the image acquisition unit or influence the signal processing or data processing related to the captured images by operating the control unit.

[0018] Preferably, the control unit allows the image acquisition unit to be coupled with the image processing unit and the playback unit, at least with regard to operation, which functionally connects the subsystems and enables, so to speak, a unified / integral control of the coupled system.

[0019] Furthermore, the invention is based on the objective of specifying advantageous uses of an input module in an operating unit for an observation device, wherein the input module, from the operator's point of view, preferably allows a coupling of subsystems of the observation device, so that the operator can act integrally on the image acquisition unit, the display unit and the image processing unit of the observation device via only one input module.

[0020] The object of the invention is achieved by a medical observation device according to claim 1 and by the use of a multi-axis input module designed as a one-hand input module according to claim 15.

[0021] According to exemplary embodiments, the disclosure relates to an observation device, in particular a medical observation device, which has the following features: - an image acquisition unit with at least one image sensor, preferably a stereo image acquisition unit with two image sensors, - a playback unit designed to reproduce image data provided by the image acquisition unit, - an image processing unit for image processing processes, and - a control unit with a multi-axis input module, wherein the control unit is designed to provide captured images of a predefined number of captured pixels, wherein the playback unit is designed to display images of a predefined to display the specified number of playback pixels, whereby the number of recording pixels increases- greater than or equal to the number of display pixels, where image pixels can be extracted from the playback pixel set of the recording pixel set, where, in order to provide views with different magnifications, Subsets of the captured pixel set can be selected to determine the playback pixels. to form a quantity, where image capture parameters and playback parameters can be controlled via the input module, and wherein the input module for controlling at least one image acquisition parameter can be coupled to the image acquisition unit.

[0022] As disclosed, the multi-axis input module of the control unit allows for simple, integrated operation of the monitoring device. It is initially irrelevant whether an operator (such as a technician or an assistant) interacts with the image acquisition unit, the image processing unit, or the display unit through an input. Since the input module is designed as a multi-axis module, the image acquisition unit, the display unit, and / or the image processing unit can be acted upon simultaneously or almost simultaneously. The result of such an input is immediately visible to the operator through a change in the displayed image. It is irrelevant whether the change in the displayed image was triggered by an interaction with the image acquisition unit, the image processing unit, or the display unit.The connection between the input module and the image acquisition unit can be direct or indirect. This connection can be functional or structural in nature.

[0023] The playback parameter could be, for example, a currently selected magnification (zoom factor). The playback parameter could also relate to the current position of a displayed image within a provided global image frame. To control such playback parameters, the input module can act directly or indirectly on the image processing unit and / or the playback unit. The image acquisition parameter could relate to the current position or distance of a focal plane, or more generally, a focus parameter. For example, the image acquisition unit is equipped with a focus drive. Accordingly, the input module can be directly or indirectly coupled to the image acquisition unit to control the focus drive. The image acquisition parameter could also relate to the illumination of the currently observed object field.Furthermore, the image capture parameter can relate to the activation of filters, apertures, mirrors, or similar functions.

[0024] In an exemplary embodiment, which is the subject of a preferred embodiment, the input module can further be coupled to the image acquisition unit for controlling at least one playback parameter. According to this embodiment, image processing thus takes place at least partially within the optical instrument itself or its image acquisition unit. The playback parameter relates, for example, to a magnification factor (zoom factor). If a desired magnification factor or image section can be generated by selectively choosing defined sets or subsets of the image pixels, the image acquisition unit itself can also be used for image processing to achieve the desired playback parameters. Similarly, an image position can be changed by shifting or repositioning a portion of the image pixels within the area provided by the image pixels.

[0025] In other words, according to this design, the optical instrument itself, or at least its image acquisition unit, is at least partially equipped for image processing. This can include providing views with different magnifications as well as digitally "shifting" a section of the image. This measure has the advantage of reducing the amount of data exchanged between the image acquisition unit and an external image processing or display unit. This can accelerate image processing and the provision or display of the desired image data.

[0026] Thus, a (partial) image processing unit can be assigned to the image acquisition unit or the optical instrument. According to this configuration, image processing can be treated as a distributed task, namely partly in an internal (partial) image processing unit and partly in an external (partial) image processing unit – each from the instrument's perspective. The internal (partial) image processing unit can be a sub-module of the image acquisition unit. It is also conceivable to provide a separate internal (partial) image processing unit alongside the image acquisition unit in the instrument.

[0027] The image acquisition unit of the observation device is preferably designed as an eyepiece-less image acquisition unit. In other words, the operator does not have a purely optical observation beam path available. Instead, for example, an optical system is provided with at least one image sensor coupled to its "eyepiece." Preferably, the image acquisition unit does not have an optical zoom. In this way, the image acquisition unit can be designed to be very compact. In particular, the image acquisition unit can be designed as part of an optical instrument, such as an exoscope or endoscope. Preferably, the image acquisition unit is arranged at the distal end of the optical instrument. Furthermore, the image acquisition unit is preferably equipped with or coupled to an illumination module.

[0028] Preferably, the playback unit is designed for the immediate (instantaneous or near-instantaneous) display of captured images. In a preferred embodiment, the image acquisition unit is designed as a stereo image acquisition unit. Accordingly, the playback unit is then preferably also equipped for displaying stereoscopic images. For this purpose, the playback unit can be configured, for example, to display two (stereo) channels. An observer or operator can, for example, perceive the image provided by the playback unit spatially by using suitable aids (3D glasses or the like). Other variants are conceivable, such as the provision of autostereoscopic displays. It is understood that, in addition to stereoscopic display, a (volumetric) 3D display is also conceivable in principle.

[0029] However, this revelation is not about the representation of models, but about an immediate reproduction (live reproduction) of an observed object field.

[0030] The image processing unit can, in principle, be designed as a central unit. However, according to at least some exemplary embodiments, it is intended that the image processing unit be designed as a distributed image processing unit. In other words, the image processing unit can comprise modules, at least one of which is coupled to or contained within the image acquisition unit. In other words, the optical instrument equipped with the image acquisition unit can also be designed for processing or manipulating captured (raw) image data. For example, it is conceivable that the at least one image sensor provides a continuous or quasi-continuous stream of captured image data, with the selection or derivation of a playback image data stream, or at least a stream of pre-processed image data, already taking place within the optical instrument.This has the advantage that no complex (separate) computing technology is required between the image acquisition unit and the display unit. However, it is certainly conceivable that corresponding image processing modules are provided that are not directly assigned to the image acquisition unit. Such image processing modules can be assigned to the display unit. It is also conceivable, however, to provide separate image processing modules that are assigned to a computer.

[0031] Preferably, the multi-axis input module can be directly or indirectly coupled to the image acquisition unit, the display unit, and / or the image processing unit in order to control the various components of the observation device. Therefore, it is not necessary to provide separate operating modules for the image acquisition unit, the display unit, and possibly even the image processing unit to control the desired functions.

[0032] The aforementioned components can each be interconnected via discrete lines. However, it is also understood that a shared bus line can be used. Other communication methods or network topologies between the components are conceivable. It is understood that at least some of the components can also communicate wirelessly.

[0033] Preferably, the number of pixels in the display corresponds to the native resolution of the display unit. If the image acquisition unit is equipped with an image sensor comprising a plurality of individual sensors, resulting in a total number of pixels in the image that is greater than the number of pixels in the display, magnification can be easily provided by reading out each adjacent pixel of the section when viewing a magnified portion of the image. Conversely, a (reduced) overview view can be used if, instead of every adjacent pixel, approximately every second or every fourth adjacent pixel is used to derive the display image from the image. Intermediate steps are understood to be possible.For example, an image sensor can be used that provides a 4K resolution (4096 × 2160 pixels) or a comparable resolution, with playback taking place at an HD resolution (e.g. Full HD 1920 × 1080 pixels or HD ready 1280 × 720 pixels).

[0034] According to an exemplary embodiment of the observation device, the input module is coupled to the image acquisition unit and the image processing unit to influence the image acquisition unit by varying image acquisition parameters and the image processing unit by varying playback parameters. The input module is preferably operable in at least a first operating mode and a second operating mode. In the first operating mode, direct control of image acquisition and playback parameters is possible, while in the second operating mode, control of peripheral functions is enabled. The coupling can be direct or indirect. A further unit can be arranged between the image acquisition unit and the image processing unit.

[0035] In this way, further peripheral functions can be controlled by the input module. These could include, for example, menu navigation or similar functions. Furthermore, the input module can be used to influence the image orientation (rotation). Accordingly, the input module can act on an actuator assigned to the image acquisition unit, which is designed to rotate at least one image sensor around an axis perpendicular to the image sensor surface.

[0036] According to a further embodiment of the monitoring device, the input module is designed as a one-handed input module, wherein the input module has an actuating element that can be manipulated by an operator and provides several degrees of freedom for inputs, in particular at least one translational direction, at least one rotational direction, and at least two further degrees of freedom or directions of movement, which are configured as thrust directions or pivot directions. The one-handed input module can be operated with just one hand. This ensures that at least one other hand of the operator remains free.

[0037] Preferably, the input module does not only have two degrees of freedom in the form of a rotational direction for a rotary movement and a translational direction for a push movement. Instead, it is preferred if at least two further degrees of freedom are available, which are preferably oriented perpendicular to each other and perpendicular to the translational direction.

[0038] According to a further embodiment of the monitoring device, the actuating element is designed in a puck-like or knob-like form, wherein the actuating element is coupled with sensors to detect pulling / pushing movements along a longitudinal axis of the actuating element, rotational movements about the longitudinal axis, and shear movements in a plane oriented perpendicular to the longitudinal axis, or pivoting movements about pivot axes oriented perpendicular to the longitudinal axis. Preferably, the actuating element provides a hand rest or palm rest. Thus, the operator can easily place their hand on the actuating element and grasp it, at least partially, with their fingers. It is understood that embodiments of the actuating element are conceivable in which the operator only grasps it with their fingers without placing their palm on it.

[0039] According to a further embodiment of the monitoring device, the actuating element is coupled to at least one sensor designed as a displacement or force transducer. Preferably, the actuating element is coupled to a plurality of sensors for multiaxial detection of deformations or movements.

[0040] Various types of sensors are conceivable. For example, the sensors could be optical sensors capable of detecting the movement of the actuator. Optical sensors in computer mice are a good example of this.

[0041] However, it is also conceivable to design the actuating element itself as immovable. Instead, sensors can be provided that can detect (minimal) deformations of the actuating element. In other words, an operator can manipulate the actuating element, for example by compressing, pulling, twisting, and / or bending it, with the resulting deformations being detected by suitable sensors. Strain gauges or similar sensors could be used for this purpose, for example.

[0042] Preferably, two, three, or more sensors are used to provide a corresponding number of degrees of freedom or to detect and distinguish a corresponding number of defined actuations. It is understood that the sensors can be designed to detect several movements simultaneously (combined actuation movements). This can, for example, include simultaneously pulling or pushing combined with rotating the actuating element. In this way, additional functions can be controlled with just one actuating element.

[0043] The input module may include additional input elements besides the actuator, such as buttons, pushbuttons, scroll wheels, or the like. However, it is preferred if the actuator itself is not equipped with any further input elements. These can instead be arranged in the vicinity of the actuator. This allows the actuator to be operated "blindly," without requiring visual contact. Nevertheless, in some exemplary embodiments, confirmation buttons or switches directly on the actuator are conceivable for confirming operator input.

[0044] According to a further embodiment of the observation device, the actuating element is designed as a four-axis actuating element, wherein actuation of the first actuating axis defines a magnification and a size associated with the magnification of an area of ​​the playback images in the recording images, wherein actuation of the second actuating axis defines a focus setting, wherein actuation of the third actuating axis causes a movement of the area covered by the playback images within an area covered by the recording images in a first direction of movement, and wherein actuation of the fourth actuating axis causes a movement of the area covered by the playback images within the area covered by the recording images in a second direction of movement, which is inclined to the first direction of movement. Accordingly, the actuating element has four degrees of freedom, to which the actuating axes are assigned.

[0045] Preferably, the first direction of movement and the second direction of movement are oriented perpendicular to each other.

[0046] The focus adjustment can, in particular, vary or shift the focal plane. For this purpose, optical components of the image acquisition unit are typically moved. The image acquisition unit then has a focus drive. Furthermore, the focus adjustment can affect the depth of field. Actuating the first control axis, for example by pushing or pulling, causes a (digital) enlargement or reduction of the image section displayed by the playback unit. Actuating the third or fourth control axis causes a movement of the currently displayed image section within a given image plane. It is understood that such movement is not possible if the area currently displayed by the playback unit corresponds to the area provided by the image acquisition unit.

[0047] The area covered by the playback images can also be called the playback area. The area provided by the recording images can also be called the recording area.

[0048] According to an exemplary further development, the first actuation axis provides a translational direction, the second actuation axis provides a rotational direction whose axis is parallel to the translational direction, and the third and fourth actuation axes each provide a thrust direction, for detecting a lateral deflection perpendicular to the translational direction, or a pivot direction, for detecting a lateral inclination about axes oriented perpendicular to the translational axis. It is understood that a combination of a pivot direction and a thrust direction is also conceivable.

[0049] In this way, a multitude of functions can be controlled by just one operating element that can be operated with one hand.

[0050] According to a further embodiment of the observation device, the number of recording pixels is an integer multiple of the number of playback pixels, preferably four times, and more preferably eight times, the number of playback pixels. For example, the number of playback pixels is 1280 × 720 (HD), preferably 1920 × 1080 (Full HD). Accordingly, the number of recording pixels can be approximately two, four, or even eight times these values, preferably maintaining the aspect ratio (e.g., 16:9 or 4:3).

[0051] According to a further embodiment, the image processing unit is configured to provide the display unit with a display-ready set of pixels that can be represented without interpolation. Preferably, this includes a definition of the display pixel set in which each display pixel corresponds to one pixel of the acquisition pixel set or to a defined average of a set of pixels (e.g., 2 × 2 or 4 × 4) of the acquisition pixel set. In other words, the viewing device allows lossless or near-lossless digital zoom at least at some magnification levels. It is understood that intermediate levels are also conceivable where interpolation is necessary. It is also understood that, in the case of high magnification, the section of the acquisition area to be magnified may have fewer pixels than the display area, so that "upscaling" to the format of the display area then takes place.Therefore, at least some magnification levels can include a lossy digital zoom.

[0052] Nevertheless, this design eliminates the need for a complex optical zoom in the image capture unit. The digital zoom has the further advantage that even when varying the magnification or the image section currently displayed by the playback unit, the lighting conditions and contrast properties of the overall image remain constant. This, in turn, simplifies the design of the image capture unit.

[0053] According to a further embodiment of the observation device, the image acquisition unit is designed to capture image data from a raw data pixel set that is larger than the recording pixel set, wherein the raw data pixel set corresponds to the total acquisition area of ​​the image sensor, and wherein the recording pixel set is selected as a subset of the raw data pixel set. This embodiment has the advantage that a peripheral region of the total acquisition area does not need to be selected for providing the recording area. Adverse optical effects, such as distortions, contrast deviations, blurring, or the like, frequently occur in the peripheral region of image sensors. Therefore, it is advantageous to forgo further processing of this area.

[0054] A further advantage of the aforementioned design can arise when using an image acquisition unit designed for stereo capture, which provides two corresponding image sensors. If the total capture area of ​​at least one of the two image sensors is larger than the area selected as the capture area for each sensor, the lateral distance between the two half-images that ultimately form the stereo image can be varied. This can be advantageous for stereoscopic display. No mechanical or optical manipulation is required to vary the offset between the half-images. Rather, the respective capture area can be shifted accordingly within the total capture area.

[0055] According to a further embodiment of the observation device, the operating unit is designed to provide haptic feedback at the input module, particularly when reaching limit values ​​or extreme values ​​of parameter ranges that can be controlled via the input module.

[0056] In this way, the input module can, for example, feature a so-called force feedback function. It is conceivable to incorporate vibration sensors or similar actuators into the input module and, in particular, to couple them with the operating element. Haptic feedback has the advantage that the feedback can be transmitted via the operator's sense of touch, directly to the hand with which the operator operates the input module. In this way, there is no significant visual and / or auditory distraction.

[0057] Haptic feedback can be used, for example, to signal to the operator that they have reached a maximum zoom level. Another example of haptic feedback is reaching the edge of the recording area when "moving" the playback area within the recording area.

[0058] According to a further embodiment of the observation device, the image processing unit is configured to generate overview images representing an area that essentially corresponds to the area encompassed by the set of pixels captured. The overview images have a smaller number of pixels than the set of pixels displayed. The overview images can be displayed by the display unit at least temporarily in parallel with the display images, and the overview images partially overlap the display images. In this way, a picture-in-picture function can be achieved, thus simplifying visual navigation. The overview images can be semi-transparent. It is understood that the overview images do not need to be displayed continuously. For example, they can be displayed only when the operator is currently entering data at the control module.This might involve moving the playback area or changing the zoom level. In these situations, it is advantageous to display the overview image.

[0059] It goes without saying that separate input elements, such as buttons, switches or the like, may be provided on the input module to show and hide the overview image as needed.

[0060] According to a further development of the aforementioned design, the playback unit is configured to highlight a section in the displayed overview images that corresponds to an area within the recording pixel set encompassed by the playback pixel set. This section moves within the overview images when the control element moves the area covered by the playback pixel set within the area covered by the recording pixel set. This further simplifies positioning.

[0061] According to a further embodiment of the monitoring device, at least the image acquisition unit and the input module of the control unit are autoclavable. This allows for simple sterilization of these components. This is particularly advantageous in medical settings.

[0062] Regarding the input module, in at least some exemplary embodiments, the detection of actuation movements is achieved by detecting deformations or changes in the actuating element. Accordingly, the input module, which includes the actuating element, can be designed as an integral unit and preferably has only a few components that can move independently of each other. In this way, the input module is particularly robust and suitable for various sterilization processes.

[0063] Another design or operating mode of the monitoring device involves assigning an action, particularly a function to be controlled, to multiple degrees of freedom or axes of actuation of the actuating element. For example, a zoom function can be controlled both by twisting (using the rotational direction) and by a push / pull movement (using the translational direction). This enables redundant operation. It is conceivable to assign the degrees of freedom to the function with a defined hierarchy or prioritization, ensuring that operation remains unambiguous and intuitive. This could, for instance, involve changing the assignment over time. Furthermore, it is conceivable to implement coarse and fine adjustments in this way, with one degree of freedom assigned to coarse adjustment and another to fine adjustment.This can affect functions such as the zoom or focus drive. Generally, the different degrees of freedom can vary in terms of the sensitivity of the adjustment / operation.

[0064] Another configuration or operating mode of the monitoring device involves defining preferred functions, whereby assigned actions are recorded and evaluated with correspondingly high priority. Lower-priority (secondary) actions that are not currently assigned to preferred functions can be ignored. In other words, certain functions can be locked, so that actions initiated via the corresponding degrees of freedom do not result in the corresponding actions. This can simplify certain actions, as unintentional activation of other functions can be avoided. For example, in certain operating modes, the zoom function can be reliably decoupled from the focus drive or from a shift in the image area.

[0065] Regarding the use, the disclosure, according to exemplary embodiments, further relates to the use of a multi-axis input module, in particular a one-hand input module, in an operating unit of a medical observation device for controlling image acquisition parameters and playback parameters, wherein the observation device has an image acquisition unit for providing recording images of a predefined recording pixel quantity and a playback unit for displaying playback images of a predefined playback pixel quantity, wherein the input module has a plurality of actuation axes, one of which actuation axis is used to select a magnification mode and at least two actuation axes are usable for moving an area corresponding to the playback pixel quantity, taking into account a current magnification mode, within an area corresponding to the recording pixel quantity.

[0066] Preferably, the observation device is further developed according to at least one of the aspects described here. Preferably, the input module is designed according to at least one of the aspects mentioned here.

[0067] It is understood that the features of the invention mentioned above and those to be explained below can be used not only in the combinations specified, but also in other combinations or on their own, without leaving the scope of the present invention.

[0068] Further features and advantages of the invention will become apparent from the following description of several preferred embodiments with reference to the drawings. The drawings show: Fig. 1 a schematic side view of an embodiment of an observation device; Fig. 2 a perspective top view of an image acquisition unit designed in the form of an exoscope; Fig. 3 another perspective view of the arrangement according to Fig. 2 in a modified orientation; Fig. 4 a perspective top view of a design of a one-handed input module; Fig. 5 a perspective top view of a further embodiment of a one-handed input module; Fig. 6 a perspective view of a further design of a one-handed input module; Fig. 7 a schematic representation of a photographic image; Fig. 8 a schematic representation of a reproduction image; Fig. 9 a schematic representation of a playback image covering an area corresponding to a recording image area; Fig. 10 a schematic representation of a playback image superimposed on a recording image for illustrative purposes, wherein a playback image area covers a part of the recording image area; Fig. 11 a further representation according to Fig. 10, wherein the playback image covers a playback area within the recording area of ​​the recording image, the pixel count of which is smaller than the pixel count of the playback area; Fig. 12 another representation of a recording image, in which a total recording area is indicated which is larger than a recording area of ​​the recording image; Fig. 13 a schematic representation of an input module and a playback image superimposed on a recording image to illustrate a position control; Fig. 14 another one, on Fig. 13. Illustrative representation to demonstrate a zoom function; Fig. 15 a schematic simplified representation of an input module and an image acquisition unit to illustrate a focus adjustment; and Fig. 16 Another schematic comparison of a captured image and a displayed image to illustrate a picture-in-picture function.

[0069] Fig. Figure 1 shows a schematic representation of an exemplary configuration of an observation device 10, designed according to at least some aspects of the present disclosure. The observation device 10 comprises an optical instrument 12. The optical instrument is designed as an exoscope by way of example. Alternative embodiments are conceivable in which the optical instrument is designed as an endoscope. The optical instrument 12 is mounted on a tripod or stand 14 by way of example, which can also be referred to as a holding arm. Accordingly, the optical instrument 12 has a fixed orientation with respect to an object to be observed, such as a body part or an organ of a patient.

[0070] The observation device 10 further comprises a display unit 16, which includes at least one display or screen 24. Both the optical instrument 12 and the display unit 16 can be designed as stereoscopic devices. Accordingly, the optical instrument 12 can be configured to capture right and left half-images, with the display unit 16 being configured to display the right and left half-images in the desired manner to create a stereoscopic (spatial) impression when viewed. As a rule, each half-image comprises a complete representation of the observed object, whereby there may be an offset or offset angle between the representations of the right and left half-images. In this way, the spatial impression can be created. The display unit 16 can further comprise so-called 3D glasses, HMD (head-mounted display) glasses, and similar devices.

[0071] The optical instrument 12 includes an image acquisition unit 18. By way of example, the image acquisition unit 18 is integrated into the optical instrument 12 and preferably arranged at its distal end. Furthermore, the observation device 10 comprises an image processing unit 20. The image processing unit 20 can, in principle, be designed as a central image processing unit or as a decentralized (distributed) image processing unit. This is illustrated by way of example. Fig. 1. An embodiment in which the image processing unit 20 comprises sections 20-1 and 20-2. The (partial) image processing unit 20-1 is assigned to the optical instrument 12. The (partial) image processing unit 20-2 is shown separately as an example and is implemented here as a separate component. It is understood that the (partial) image processing unit 20-2 can also be at least partially integrated (at least structurally) into the display unit 16.

[0072] In general, the image processing unit 20 is interposed between the image acquisition unit 18 and the playback unit 16 in order to process and prepare image data provided by the image acquisition unit 18 in order to supply it to the playback unit 16 for playback.

[0073] The image acquisition unit 18 comprises at least one image sensor 26, which is designed to observe a defined object plane 28 and to convert the captured optical signals into electrical (data) signals. A second image sensor (in Fig. (1 not explicitly shown) allowed for a stereoscopic representation. A field of view of the image sensor 26 is in Fig. 1 with 30 indicated. The object plane 28 is, in the case of the optical instrument 12, which is implemented as an exoscope, according to Fig. 1. The image sensor 26 is spaced apart, in particular from a lens of the image sensor 26. An exoscope is typically used with an object distance (working distance) of approximately 250 mm to approximately 750 mm. The image sensor 26 includes, for example, a CCD sensor.

[0074] The in Fig. The optical instrument 12 shown in Figure 1 is not designed to be inserted into body orifices or other narrow passages. However, according to alternative embodiments, the observation device 10 includes an instrument 12 designed as an endoscopic instrument and configured for insertion into body orifices.

[0075] The image acquisition unit 18 also includes an illumination unit 32. The illumination unit 32 can be integrated into the instrument 12. However, it is also conceivable to connect external light sources to the instrument 12 in order to provide illumination for the object plane 28 in the area of ​​the image acquisition unit 18.

[0076] Furthermore, an erection unit or image erection device 34 is associated with the image acquisition unit 18. The image erection device 34 is, for example, a motor-driven or manually operated erection device that rotates at least one image sensor 26 about the longitudinal axis of the lens, or the optical axis. With two image sensors, as in the present example, both image sensors 26-1 and 26-2 are rotated together about an axis perpendicular to the stereo base, with the axis running centrally between the image sensors. In this way, the orientation (rotational orientation) of the captured image can be influenced.

[0077] Furthermore, the optical instrument 12 comprises a shaft 40. A handle housing 42 is formed at the proximal end of the shaft 40, which faces away from the distal end. The optical instrument 12 is also designed as a handheld instrument. Accordingly, the instrument 12 can be grasped and guided by the handle housing 42. Nevertheless, the rigid mounting on the stand (support arm) 14 is advantageous for a variety of applications.

[0078] Furthermore, the optical instrument 12 has an interface 44, located approximately at its proximal end, which is designed primarily as a data and communication interface. Image data can be transferred via interface 44. The optical instrument 12 can also be supplied with control commands via interface 44, which are generated, for example, by the operating unit 22 and / or transmitted by the external (partial) image processing unit 20-2.

[0079] The in Fig. Figure 1, representing an image processing unit 20 as a distributed unit, comprises, for example, a first processing module 46 and a second processing module 48. The first processing module 46 is assigned to the instrument 12 and coupled to the image acquisition unit 18. The second processing module 48 is designed as an external or separate processing module.

[0080] The observation device 10 further comprises an operating unit 22, which is described in more detail below. The operating unit 22 can be coupled directly or indirectly to the image acquisition unit 18, the image processing unit 20 and / or the playback unit 16.

[0081] The control unit 22 includes, for example, an input module 50, which is preferably designed as a one-handed input module. The input module 50 includes an actuating element 52, preferably a one-handed actuating element. The actuating element 52 is shaped approximately like a puck, a ball, a button, or a disc. Preferably, the actuating element 52 has an extension that allows an operator to grasp the actuating element 52 with their hand, similar to a computer mouse. In this respect, the Fig. The actuating element 52 of the input module 50 shown in Figure 1 has a diameter of at least 30 mm, preferably at least 40 mm, and more preferably at least 50 mm. This allows the actuating element 52 to be gripped and actuated reliably and predictably, even when wearing gloves. By way of example, the input module 50 may have, in addition to the actuating element 52, further actuating elements 54 in the form of pushbuttons or the like. This allows for the implementation of additional functions.

[0082] In Fig. Figure 1 further illustrates that the lines designated 56-1, 56-2, 56-3 and 56-4 can, in principle, communicate with each other, either directly or indirectly. It is understood that at least some of the lines in Fig. The lines 56-1, 56-2, 56-3, and 56-4 shown in Figure 1 can be implemented as wireless connections. Furthermore, it is also conceivable that the components of the observation device 10 connect to a common communication switch, resulting in a star topology. Other configurations, such as bus systems or the like, are also possible.

[0083] As an example, display 24 of the playback unit 16 shows a representation of a patient's organs. The playback unit 16 is designed to display a playback image 60, which is based on a recording image (in Fig. (1 not shown separately) is based on the image provided by the image acquisition unit 18. The display image 60 can be superimposed, at least partially and at least temporarily, with an overview image 62, for example, in the manner of a picture-in-picture display. The overview image 62 illustrates, by way of example, a total area that can be captured by the image acquisition unit 18, whereby the display image 60 shows the total area or parts thereof, depending on the selected magnification. In this respect, the overview image 62 aids in orientation and navigation.

[0084] Based on the Fig. 2 and Fig. Section 3 illustrates in more detail an exemplary design of an optical instrument 12 configured as an exoscope. The [instrument] in the Fig. 2 and Fig. The optical instrument shown in section 3 corresponds in its basic structure to the optical instrument 12 according to... Fig. 1.

[0085] The optical instrument 12 has a shaft 40, at the distal end of which a receiving head 64 is formed. The receiving head 64 houses the image acquisition unit 18, or at least parts thereof. At a proximal end of the shaft 40, facing away from the distal end, a handle housing 42 is formed, which can house further components of the optical instrument 12.

[0086] Fig. Figure 3 illustrates that the optical instrument 12 can be designed as a stereoscopic instrument. Accordingly, the image acquisition unit 18 has a first image sensor 26-1 and a second image sensor 26-2 in the area of ​​the imaging head 64. Thus, there are two imaging beam paths. A first imaging beam path is assigned a first imaging optic 66-1. A second imaging optic 66-2 is assigned to a second imaging beam path. Furthermore, in Fig. 3 a lighting optic designated 68 is arranged, which is assigned to the lighting unit 32.

[0087] In an exemplary configuration, interface 44 ( Fig. 1) of the optical instrument 12 is further configured to couple a light guide or an external light source. Accordingly, the illumination unit 32 (see Fig. 1) not be designed as active lighting. Rather, the lighting unit 32 can comprise light guides that pass through the shaft 40 between the proximal end and the distal end and that terminate in the lighting optics 68.

[0088] Various exemplary configurations of input modules 50, which can be used with the operating unit 22, are described below based on the Fig. 4, Fig. 5 and Fig. 6 illustrated in more detail. It goes without saying that individual aspects of one of the in the Fig. 4, Fig. 5 and Fig. The input modules shown in 6 (50) can also be applied to the other input modules.

[0089] A first design of an input module 50 designed for one-handed operation is in Fig. Figure 4 shows that the input module 50 comprises a main actuating element 52, which is shaped approximately like a puck. The actuating element 52 is mounted on a base 72 of the input module 50. Furthermore, other (secondary) actuating elements 54 are provided by way of example, such as switches, pushbuttons, or the like. Finally, in Fig. 4 with 74 designates a communication interface through which control signals can be output, which can be generated by actuating the actuating elements 52, 54.

[0090] Preferably, the input modules 50 presented in this disclosure are designed as multi-axis input modules, more preferably as four-axis input modules. An exemplary assignment of motion axes or actuation axes to the input module 50 is given in Fig. 4 illustrates. Fig. Figure 5 shows an alternative assignment.

[0091] In Fig. A translational direction is illustrated by a double arrow labeled 80. A rotational direction 82, which describes a rotational movement about the axis of the translational direction 80, is indicated by a curved double arrow labeled 82. Accordingly, the actuating element 52 can be actuated translationally (pulling and pushing). In addition, rotational actuation is also possible (turning).

[0092] Other areas of activity are in Fig. 4 is labelled with 84 and 86, respectively, which are indicated by double arrows. The actuation directions 84 and 86 can also be referred to as thrust directions. The thrust directions 84 and 86 define a plane in which the actuating element 52 is displaceable perpendicular to the translation direction 80. In particular, the actuating element 52 can be deflected at least partially laterally to generate a thrust signal.

[0093] As an example, the axes of a coordinate system defined by the directions of actuation 80, 84, 86 are labelled X (see 86), Y (see 84), and Z (see 80). It is understood that this assignment primarily serves illustrative purposes. Variations are readily conceivable. A person skilled in the art can easily perform any necessary mental transformations. To enable movements using the degrees of freedom or directions of movement 80, 82, 84, 86, the actuating element 52 is mounted on the base 72 so that it is movable, at least within limits. For example, optical sensors can be provided to detect the deflections and assign them to the respective axes.

[0094] Preferably, the input modules 50 presented in this disclosure are designed as input modules with haptic feedback. This allows feedback to be provided to an operator who actuates the input module 50. For example, the haptic feedback is generated by a vibration motor or vibration generator 88, which is associated with the input module 50, in particular with the actuating element 52. The haptic feedback can, for example, signal the reaching of limit values ​​or extreme values. In this way, an operator can be informed that certain ranges or limit values ​​must not be exceeded.

[0095] It is also conceivable to provide a plurality of vibration generators 88, which are assigned to at least some of the actuation directions or axes 80, 82, 84, 86. In this way, even finer, more precise feedback can be provided.

[0096] Fig. Figure 5 illustrates an alternative exemplary embodiment of an input module 50 for an operating unit 22, which is used in the observation device 10 according to Fig. 1 is usable. The input module 50 comprises a disc-shaped or cylindrical actuating element 90, which can be designed in a fundamentally similar way to the actuating element 52. The actuating element 90 is received on a base 92 and connected to the base 92 via a shaft 94. With regard to the axes of movement or the actuating axes, this is determined by the Fig. 5 illustrated input module 50 compared to the one based on the Fig. The illustrated design has been modified. As already mentioned in Fig. As shown in Figure 4, a translation direction 80 and a rotation direction 82 are provided, where the rotation direction 82 describes rotational movements about the translation direction 80. Instead of the shear directions 84, 86 (see Figure 4), the following directions are used: Fig. 4) includes the design according to Fig. Five pivot directions 98, 100, which describe a respective bending or pivoting of the actuating element 90 about the X-axis or the Y-axis. A corresponding signal, which describes, for example, a displacement in a two-dimensional space, can also be generated via such an actuating movement.

[0097] The actuating element 90 according to Fig. 5 is rigidly mounted on the base 92. In other words, the actuating element 90 is not movably mounted on the base 92. However, the actuating element 90 is deflectable or movable in sections, since, in particular, the shaft 94 is not infinitely rigid. In this way, defined deformations can be generated on the shaft 94. These deformations can be, for example, compressions, elongations, bending, or torsions. Such deformations can be detected by sensors 96, preferably by a plurality of such sensors. For example, the sensors 96 can be designed as strain gauges. Thus, even minimal deformations on the shaft 94 can be detected and assigned to the actuation directions 80, 82, 98, 100. The actuating element 90 according to Fig. 5 can be coupled with a suitable vibration generator 88 to provide haptic feedback.

[0098] The based on the Fig. The illustrated embodiment of the input module 50 is integrally designed, as the actuating element 90 is firmly connected to the base 92. This makes the input module 50 particularly robust. This simplifies cleaning processes, especially disinfection or sterilization processes. Thus, the input module 50 can be easily sterilized in an autoclave.

[0099] Fig. Figure 6 illustrates a further embodiment of an input module 50 designed for one-handed operation, which can be used with the control unit 22. The input module 50 has an actuating element 104, which is similar to the one already described in the Fig. The actuating element illustrated in Figure 4 is fundamentally similar in design. Furthermore, the input module 50 comprises a base 108 on which a hand rest 106 is formed. A plurality of further actuating elements 54, in particular pushbuttons, switches or the like, are also provided on the base 108.

[0100] With reference to the Fig. 7 and the Fig. Section 8 explains the basic functions of the image acquisition unit 18 and the playback unit 16 in more detail. Fig. Figure 7 shows a recording image 58, which can be captured and made available by the image acquisition unit 18. Fig. Figure 8 shows a playback image 60 that can be displayed by the playback unit 16. It is subsequently assumed that the recording images 58 and the playback images 60 correspond to one image channel of a stereoscopic representation comprising two image channels, or to a (single) image channel of a non-stereoscopic representation. An extension to stereoscopic data is readily conceivable.

[0101] The image 58 according to Fig. 7 has a plurality of pixels 110. A pixel set of the captured image 58 is represented by n. a The dimensions of the image 58 are shown in Fig. 7 with w a and h a The width of the image 58 is denoted by w. a denotes and comprises a defined number of pixel columns c a The height of the image 58 is given by h a denotes and comprises a defined number of pixel rows r a .

[0102] The image 58 covers an image area 112. The image area 112 corresponds approximately to the area of ​​the object plane 28 (cf. Fig. 1), which can generally be detected with the image sensor 26 (see, however, the further explanations in connection with Fig. 12).

[0103] The in Fig. The displayed image 60 has a plurality of pixels 120. The number of pixels in the displayed image 60 is n. b The dimensions of the playback image 60 are in Fig. 8 with w b and h b denoted by w, where w is a width b and a height with h b is designated. The width w b includes a defined number of pixel columns c b The height h b comprises a defined number of pixel rows r b The 120 pixels of the playback image 60 define a playback area 122.

[0104] The pixel quantities n a and n bare preferably defined such that the pixel set n a of the recording area 112 an integer multiple of the pixel set n b of the playback area 122. For example, the playback area 122 is implemented as an HD area (1280 × 720 pixels) or as a Full HD area (1920 × 1080 pixels). Accordingly, the recording area 112 can, for example, comprise two, three, four, six, or even eight times the pixels of the playback area 122.

[0105] The aspect ratio (c a :r a ) of the recording area 112 preferably corresponds to the aspect ratio (c b :r b ) of playback range 122.

[0106] The checkered or boxed representation used to display the recording images 58 or the playback images 60 illustrates corresponding pixel quantities n. a or n b A comparison of Fig. 7 with the Fig. Figure 8 accordingly shows that the playback area 122 representable by the playback image 60 corresponds only to a sub-area of ​​the recording area 112 if the (detail) resolution or pixel density is maintained, i.e., if a contiguous area of ​​the pixels 110 of the recording area 112 is to be represented in the playback area 122. Accordingly, the dimensions w b , h e of the reproduction area 122, relative to the object plane 28, smaller than the dimensions w a , h a of the potentially available recording area 112.

[0107] Fig. Figure 9 illustrates a playback mode in which the playback image 60 reproduces the entire recording area 112 of the recording image 58. Accordingly, the playback area 122 essentially corresponds to the recording area 112. However, the pixel density is significantly lower, since only a limited number of pixels 120 are available in the playback area 122. In other words, only about every second or every fourth pixel 110 of the recording area 112 is used for playback in the playback area 122. It is understood that a corresponding average of neighboring pixels can also be used to determine the number of pixels n. a of the recording area 112 into the pixel set n b to transfer the display area 122. Accordingly, the display in Fig. 9 more coarsely rasterized than the representation in Fig. 7. In Fig. 9 places c a ' and h a ' one of the initial values ​​c a and h aThe derived number of columns or rows represents the values ​​of c. b and h b are equivalent to.

[0108] Fig. Figure 10 shows a display mode in which the playback image 60 is used to display only a section of the recorded image 58. In comparison to the Fig. 9 shows the playback image 60 in Fig. 10 does not cover the entire recording area 112. In other words, the dimension of the playback area is 122 c. b , r b smaller than dimension c a , r a of recording area 112. In comparison to the representation according to Fig. 9 are shown in the representation according to Fig. Ten more pixels, or all pixels in the selected section of the recording area 112, are displayed in the playback area 122. Depending on the selected magnification, a 1:1 reproduction of at least a subset of the pixels 110 of the recording area 112 in the playback area 122 is possible. Fig. Figure 9 shows an overview without magnification. Fig. Figure 10 shows a medium magnification level where a section of the recorded image 58 is reproduced in the playback image 60, the section being chosen at this magnification level such that a contiguous subset of the pixels 110 of the recording area 112 forms the pixels 120 of the playback area 122; compare also the illustration in Fig. 16, in which the recording image 58 and the playback image 60 are shown separately for better illustration.

[0109] Fig. Figure 11 illustrates a further magnification level, in which an even smaller section 126 of the recording area 112 is displayed in the playback area 122. The section 126 extends over a defined number of pixels n in the recording area 112. c , defined by a defined number of pixel columns c c and a defined number of pixel rows r cis defined. The pixel set n c The area of ​​section 126 is smaller than the pixel set n. b , which can be displayed in the playback area 122 (see the representation of section 126 in Fig. 11, where, for illustration purposes, the larger (reproduction) pixel set n b the smaller (sensor) pixel count n c (is superimposed). In other words, multiple playback pixels can correspond to one capture pixel. Accordingly, interpolation or computational "upscaling" takes place to create a representation based on the limited number of pixels n. c the pixels 120 (number of pixels n b ) of the playback image 60 to be derived.

[0110] In this way, a higher magnification can be achieved than, for example, in the magnification mode according to... Fig. 10, whereby the enlargement is no longer lossless. Fig. Figure 10 shows a lossless magnification. Depending on the ratio between the number of pixels n aof the recording area 112 and the number of pixels n b The playback range 122 can have at least two lossless playback stages or image scales (see overview in Fig. 9 and magnification in Fig. 10) or even three, four or more lossless magnification scales are provided.

[0111] It goes without saying that suitable intermediate stages can also be represented, if desired. Corresponding interpolations are conceivable. If a representation is desired that goes beyond the one in Fig. If the magnification shown in Figure 10 (1:1 representation) is exceeded, interpolation methods must be used. However, it has been shown that the resulting reproduction images 60 are sufficiently detailed if the defined number of pixels n bThe playback area, which is assumed to be sufficiently large, is approximately Full HD. A 1:1 representation (one-to-one representation) occurs when the number of pixels in the selected area 122 in the recording area 112 corresponds exactly (or at least essentially) to the number of pixels in the playback area 122.

[0112] Fig. Figure 12 illustrates a further exemplary embodiment, which in particular concerns the image acquisition unit 18 or the at least one image sensor 26. Fig. Figure 12 illustrates, by way of example, a captured image 58 and a selected playback image 60 within the captured image 58. The at least one image sensor 26 can, in principle, be configured to capture image data in a total capture area 130 that is larger than the capture area 112 of the captured image 58. In particular, a frame can be formed that overlaps the capture area 112. By way of example, the total capture area 130 comprises a raw data pixel set n r , which are larger than the pixel set n a of the recording area 112.

[0113] The recording area 112 can be selected within the total recording area 130 such that an integer ratio between the number of pixels n a of the recording area 112 and the number of pixels n bof the playback area 122 is preserved. A further advantage can be to deliberately choose the recording area 112 to be smaller than the total capture area 130 in order to avoid disturbing effects that can frequently occur in the edge areas of image sensors 26.

[0114] Another advantage of the based on the Fig. The illustrated configuration shown in Figure 12 can be advantageous, for example, with regard to stereoscopic image processing and display. The portion of the total acquisition area 130 that forms the recording area 112 of the image sensor 26 can be shifted, at least within narrow limits. This can be advantageous for adjusting or fine-tuning the image acquisition unit 18. Furthermore, when using two image sensors 26 that capture two half-images for stereoscopic display, a desired image distance between the half-images can be set by shifting the recording areas 112 within the total acquisition area 130. In this way, adjustment and fine-tuning can be performed using software. Ideally, complex mechanical or optical adjustment work can be avoided.

[0115] Based on the Fig. 13, Fig. 14 and Fig. Figure 15 illustrates an advantageous assignment of actuation axes of the input module 50 for controlling image acquisition parameters or playback parameters.

[0116] Fig. Figure 13 shows a playback image 60, which comprises a playback area 122 that is selected as a subset of the recording area 112 of the recording image 58. The playback area 122 can be shifted within the limits defined by the recording area 112; see arrows labeled X and Y in Figure 13. Fig. 13. This thrust movement can be effected, for example, via the thrust directions 84 and 86 of the input module 50. A corresponding displacement can also be controlled via the pivot directions 98 and 100; see also [reference to be added]. Fig. 5. Shifted playback areas are in Fig. 13 labeled with 140, 142.

[0117] Fig. Figure 14 illustrates a zoom function in which differently sized areas of the recorded image 58 are selected to define the playback area 122, on the basis of which the playback image 60 is derived.

[0118] A smaller section is labeled 150. This smaller section magnifies the resulting image. A larger section is labeled 152. Section 152 reduces the size of the image during playback. A double arrow labeled 154 illustrates the scaling of the playback area 122 to create different magnification levels.

[0119] The scaling can be effected by actuating the input module 50 in the translation direction 80, i.e. by pushing or pulling the actuating element 52.

[0120] Fig. Figure 15 illustrates a focus adjustment that is generally in addition to the shift according to Fig. 13 and in addition to the size adjustment according to Fig. 14 can be achieved with the input module 50. For example, the image acquisition unit 18 includes a focus drive or focus adjustment. The field of view 30, or the concept-related opening angle of the field of view 30, is not readily variable in those configurations that do not include optical zoom. However, the distance of a focal plane (also: plane of focus) 160, 162, 164 from the image acquisition unit 18 can be varied with sufficiently sharp rendering in order to focus on objects at different distances from the image acquisition unit 18. In other words, for example, either an object located in the foreground or an object located in the background can be selectively focused. A corresponding shift of the plane of focus is possible in Fig. 15 is indicated by a double arrow labeled 166. For this purpose, focusing lenses in the optical instrument are moved via the focus drive. The movement is controlled via the input module 50.

[0121] The focus adjustment can be made, for example, by actuating in the direction of rotation 82. For this purpose, the actuating element 52 can be rotated about its longitudinal axis.

[0122] It goes without saying that alternative designs are also conceivable, in which, for example, the size adjustment can be effected by turning the actuating element 52 and the focus plane can be adjusted by pulling or pushing the actuating element 52.

[0123] The based on the Fig. 13, Fig. 14 and Fig. The 15 illustrated functions all include defined adjustment ranges. If limit values ​​or extreme states are reached, haptic feedback can be provided at input module 50 to signal this to the operator. This can occur, for example, when moving the cutout according to... Fig. 13 signaling the reaching of the edge of the recording area 112. In the Fig. The function shown in Figure 14 can, for example, be indicated by haptic feedback that the selected playback range 122 corresponds to the recording range 112 and consequently no smaller zoom level is possible. Conversely, it can be indicated that an extreme magnification (extremely small playback range 122) is selected and that further magnification is not possible.

[0124] Similarly, when adjusting the focus plane according to Fig. 15. Feedback will be given when a minimum or maximum distance is reached.

[0125] Fig. Figure 16 illustrates another exemplary function that the observation device can provide. As described above, it shows Fig. 16. By way of example, a recording image 58 and a playback image 60 are shown, which is generated based on a section of the recording image 58 that defines a playback area 122. The playback image 60 covers the playback area 122. According to at least some embodiments, it is conceivable to display an overview image 62 at least temporarily in the playback image 60, which at least partially overlays the playback area 122. This can be done, for example, as a picture-in-picture display. Preferably, the overview image 62 covers the entire recording area 112, albeit in a coarse-resolution representation. In this way, a visual orientation aid can be provided to the operator. Preferably, a section 172 is also displayed in the overview image 62, which serves as a position indicator. The section 172 indicates the position of the selected playback area 122 in the recording area 112 of the recording image 58.

[0126] It is conceivable to display overview image 62 at least when one of the [unclear] in the Fig. 13, Fig. 14 or Fig. The 15 functions shown are used. If required, the overview area 62 can also be displayed and hidden at the touch of a button. The overview area 62 can be made at least partially transparent to make an underlying area of ​​the playback area 122 at least partially visible.

[0127] The based on the Fig. 13, Fig. 14 and Fig.The 15 illustrated functions show that the input module 50 can be used to control image capture parameters and playback parameters. This can be done simultaneously. An image capture parameter is, for example, the current position of the focus plane. A playback parameter is, for example, a currently selected magnification level or the current position of the selected image section (playback area) within the generally available capture area.

[0128] It is understood that the recording image 58, which is depicted in several of the figures shown here, does not necessarily have to be visibly available. Rather, the recording image 58 can exist in the form of a corresponding data embodiment. For example, it is conceivable that the recording area is read out constantly at a selected repetition rate and is potentially available. Thus, the image acquisition unit 18 can provide a recording data stream which can be used completely or partially to derive desired playback images.

Claims

[1] Medical observation device (10) comprising the following: - an image acquisition unit (18) with at least one image sensor (26), preferably a stereo image acquisition unit with two image sensors, - a playback unit (16) designed to play back image data provided by the image acquisition unit (18), - an image processing unit (20) for image processing processes, and - an operating unit (22) with a multi-axis input module (50) designed as a one-hand input module and featuring an actuating element (52, 90, 104) that can be manipulated by an operator and provides several degrees of freedom (80, 82, 84, 86; 80, 82, 98, 100) for inputs, wherein the image acquisition unit (18) is configured to provide recording images (58), wherein the display unit (16) is configured to display display images (60), where image acquisition parameters and playback parameters can be controlled simultaneously via the input module (50), and wherein the input module (50) is coupled to the image acquisition unit (18), the playback unit (16) and the image processing unit (20) in order to vary image acquisition parameters on the image acquisition unit (18) and to vary playback parameters on the playback unit (16) and / or the image processing unit (20). [2] Observation device (10) according to claim 1, wherein the input module (50) is operable in at least a first operating mode and a second operating mode, wherein in the first operating mode direct control of image acquisition parameters and playback parameters is enabled, and wherein in the second operating mode control of peripheral functions is enabled. [3] Observation device (10) according to claim 1 or 2, wherein the degrees of freedom (80, 82, 84, 86; 80, 82, 98, 100) comprise at least one translation direction (80), at least one rotation direction (82) and at least two further degrees of freedom configured as thrust directions (84, 86) or pivot directions (98, 100). [4] Observation device (10) according to one of the preceding claims, wherein the actuating element (52, 90, 104) is designed in a puck-like or knob-like manner, wherein the actuating element (52, 90, 104) is coupled with sensors (96) to detect a pulling / pushing movement along a longitudinal axis (Z) of the actuating element (52, 90, 104), a rotational movement about the longitudinal axis (Z), and shear movements in a plane (X, Y) oriented perpendicular to the longitudinal axis (Z) or pivot movements about pivot axes (X, Y) oriented perpendicular to the longitudinal axis (Z). [5] Observation device (10) according to one of the preceding claims, wherein the actuating element (52, 90, 104) is coupled with at least one sensor (96) designed as a displacement sensor or force sensor, preferably with a plurality of sensors for multiaxial detection of deformations or movements. [6] Observation device (10) according to one of the preceding claims, wherein the actuating element (52, 90, 104) is designed as a four-axis actuating element, wherein actuation of the first actuating axis (80) defines a magnification and a size associated with the magnification of an area (122) of the playback images (60) in the recording images (58), wherein actuation of the second actuating axis (82) defines a focus setting, wherein actuation of the third actuating axis (84) causes a movement of the area (122) covered by the playback images (60) in an area (112) covered by the recording images (58) in a first direction of movement (X), and wherein actuation of the fourth actuating axis (86) causes a movement of the area covered by the playback images (60) in the area (112) covered by the recording images (58) in a second direction of movement (Y) which is inclined to the first direction of movement (X). [7] Observation device (10) according to claim 6, wherein the first actuating axis provides a translation direction (80), wherein the second actuating axis provides a rotation direction (82) whose axis is parallel to the translation direction (80), and wherein the third actuating axis and the fourth actuating axis each provide a thrust direction (84, 86) for detecting a lateral deflection perpendicular to the translation direction, or a pivot direction (98, 100) for detecting a lateral inclination about axes oriented perpendicular to the translation direction. [8] Observation device (10) according to one of the preceding claims, wherein the playback unit (16) is configured to display playback images (60) of a predefined set of playback pixels (n b ) to represent, where the number of recording pixels (n) a ) greater than or equal to the number of display pixels (n) b ) is, where image pixels (120) of the display pixel set (n) b ) the number of recording pixels (n a ) are removable, where, to provide views with different magnifications, subsets of the captured pixel set (n) a ) are selectable to determine the number of playback pixels (n b to form, and where the number of recording pixels (n) a ) in particular an integer multiple of the number of playback pixels (n b ) is, where the number of recording pixels (n) a ) preferably four times, more preferably eight times the number of playback pixels (n b ) amounts. [9] Observation device (10) according to claim 8, wherein the image processing unit (20) is configured to provide the display unit (16) with an interpolation-free displayable set of display pixels (n) b to provide. [10] Observation device (10) according to claim 8 or 9, wherein the image acquisition unit (18) is configured to record image data of a raw data pixel set (n r ) to capture pixels larger than the number of pixels captured (n a ) is, where the raw data pixel quantity corresponds to a total acquisition area (130) of the image sensor (26), and where the acquisition pixel quantity (n a ) is selected as a section of the raw data pixel set (nr). [11] Observation device (10) according to one of claims 8 to 10, wherein the operating unit (22) is configured to provide haptic feedback at the input module (50), in particular when limit values ​​or extreme values ​​of parameter ranges are reached which can be controlled via the input module (50). [12] Observation device (10) according to one of claims 8 to 11, wherein the image processing unit (20) is configured to generate overview images (62) representing an area that is substantially defined by the number of recording pixels (n a ) encompassed area (122), wherein the overview images (62) have an overview pixel set that is smaller than the playback pixel set (n) b ) is selected, and wherein the overview images (62) can be displayed by the playback unit (16) at least temporarily in parallel with the playback images (60), wherein the overview images (62) partially cover the playback images (60). [13] Observation device (10) according to claim 12, wherein the display unit (16) is configured to highlight a section area (172) in the overview images (62) shown, which is defined by the number of display pixels (n b) encompassed area (122) within the set of recording pixels (n a ) highlights, and wherein the section area (172) moves in the overview images (62) when the control element is activated by the playback pixel quantity (n b ) area covered by the number of pixels captured (n a ) covered area (112) is moved. [14] Observation device (10) according to one of the preceding claims, wherein at least the image acquisition unit (18) and the input module (50) of the control unit (22) are autoclavable. [15] Use of a multi-axis input module (50) designed as a one-hand input module, which is designed as a one-hand input module and has an actuating element (52, 90, 104) that can be manipulated by an operator and has several degrees of freedom (80, 82, 84, 86;80, 82, 98, 100) for inputs, in an operating unit (22) of a medical observation device (10) for the simultaneous control of image acquisition parameters and playback parameters, which has an image acquisition unit (18) for providing acquisition images (58) and a playback unit (16) for displaying playback images (60), wherein the input module (50) has a plurality of actuation axes, wherein image acquisition parameters and playback parameters can be controlled simultaneously via the input module (50), and wherein the input module (50) can be coupled to the image acquisition unit (18), the playback unit (16) and the image processing unit (20) in order to act on the image acquisition unit (18) to vary image acquisition parameters and on the playback unit (16) and / or the image processing unit (20) to vary playback parameters.

Citation Information

Patent Citations

  • Programmable camera control unit with updatable program

    CA2605071C

  • microscope

    DE102011078967A1

  • Device for capturing an image of an object field on a human or animal body

    DE102013110543A1

  • mechanisms for control buttons and other interface devices

    DE20014425U1

  • haptic FEEDBACK JOYSTICK

    DE60131839T2