Automatic configuration of a surgical microscopy system based on an overview image

Abstract

In various examples of the disclosure, an object, e.g. a surgical instrument, is searched for in an overview image, wherein the overview image is searched using an environment camera of a surgical microscopy system. Then a robotic stand of the surgical microscopy system is controlled in such a way that the object is arranged in the field of view of a microscope camera of the surgical microscopy system. An assistance function, for example a self-centring, is then performed on the basis of a microsope image.

Description

[0001] DESCRIPTION

[0002] AUTOMATIC CONFIGURATION OF A SURGICAL MICROSCOPY SYSTEM BASED ON AN OVERVIEW IMAGE

[0003] TECHNICAL FIELD

[0004] Various examples of the disclosure relate to techniques for automatically configuring a surgical microscopy system to image an object.

[0005] BACKGROUND

[0006] Medical surgical microscopy systems (also called robotic visualization systems or surgical visualization systems) with a robotic stand for positioning a microscope are known from the state of the art, see e.g. DE 10 2022 100 626 A1.

[0007] The robotic stand can be controlled manually. However, techniques are also known in which the robotic stand is controlled automatically, e.g., to enable auto-centering and / or auto-focusing on a specific object such as a surgical instrument (also referred to as a surgical set or surgical tool). A user command triggers a positioning process, which controls the robotic stand and / or an objective lens of the microscope. Such auto-centering techniques are known, for example, from US 10,456,035 B2.

[0008] Situations have been observed where a user command requests a microscope camera configuration to image a specified object, but the object cannot be found, so the configuration cannot be executed. In this case, user expectations and actual system behavior are discrepant. SUMMARY

[0009] Therefore, there is a need for improved techniques for the automatic control of surgical microscopy systems. In particular, there is a need for improved techniques related to the automatic configuration of the surgical microscopy system for imaging a subject.

[0010] This problem is solved by the features of the independent claims. The features of the dependent claims define embodiments.

[0011] The following describes aspects related to the automatic configuration of a surgical microscopy system with a robotic stand and a microscope carried by the robotic stand. Such automatic configuration can be provided in conjunction with an assistance function to support a surgeon. The configuration is carried out in such a way that a microscope camera of the microscope is arranged to image the object. This ensures that the object is positioned within the field of view of the microscope camera. The assistance function can then be executed based on an evaluation of a microscope image captured by the microscope camera, since the object is depicted in the microscope image.

[0012] A computer-implemented method for controlling a surgical microscopy system is disclosed. The surgical microscopy system includes a robotic stand. The surgical microscopy system also includes a microscope. The microscope is supported by the robotic stand. The surgical microscopy system further includes a field-of-view camera. The field-of-view camera is supported by the robotic stand. The field-of-view camera has a first field of view. The first field of view is larger than a second field of view of a microscope camera of the microscope.

[0013] The first visual field typically encompasses the second visual field, ie the second visual field depicts an area that is also depicted by the first visual field.

[0014] The method includes receiving a user command. The user command requests a configuration of the microscope camera for imaging an object. This configuration can be requested explicitly or implicitly. For example, the user command could request auto-centering on the object. However, the user command could also request a measurement of the object based on an image of the object in a microscope image captured by the microscope camera.

[0015] In response to receiving the user command, it is optionally possible to control the microscope camera to capture an initial microscope image. It is then possible to search for the object in the initial microscope image. If the object is found in the initial microscope image, an assistance function based on the initial microscope image can be executed. Further steps can then be omitted.

[0016] However, it may also happen that the object is not found in the initial microscope image, or that the method does not provide for capturing the initial microscope image. In such cases, the method may further include controlling the surroundings camera to capture an overview image.

[0017] The overview image has a significantly lower magnification than the microscope image. Therefore, the first field of view of the overview camera is also larger than the second field of view of the microscope camera.

[0018] The method then includes searching for the object in the overview image. Once the object is found in the overview image, the method includes providing a control command for the robotic stand. This control command causes the microscope to move such that the object is subsequently positioned in the second field of view of the microscope camera.

[0019] The microscope camera can then be controlled to capture a microscope image, and the assistance functionality can then be executed based on this microscope image. Due to the previous control of the robotic stand and the associated movement of the microscope, it can be assumed that this captured microscope image depicts the object. For example, the assistance functionality can be executed based on an image of the given object in the microscope image. It would be conceivable, for example, for the assistance functionality to be executed based on a localization of the given object in the microscope image. For example, the object could be measured. The object could also be precisely localized, followed by auto-centering of the second field of view to a reference point determined based on such a localization of the object.

[0020] From the above, it is clear that in some examples, the surrounding camera is only activated under certain conditions, namely when the object is not found in the initial microscope image. In other variants, however, it would also be conceivable that the surrounding camera is always activated first to search for the object in the overview image. In other words, capturing the initial microscope image is optional.

[0021] A data processing device is disclosed. The data processing device is configured to control a surgical microscopy system. The data processing device comprises a processor. The processor is configured to load and execute program code from a memory. Executing the program code causes the processor to execute the method described above for controlling a surgical microscopy system.

[0022] A surgical microscopy system is also disclosed which comprises such a data processing device.

[0023] The features set forth above and features described below may be used not only in the corresponding explicitly set forth combinations, but also in further combinations or in isolation, without departing from the scope of the present invention.

[0024] BRIEF DESCRIPTION OF THE FIGURES FIG. 1 schematically illustrates a surgical microscopy system according to various examples.

[0025] FIG. 2 schematically illustrates different fields of view in connection with a microscope and a field camera of an exemplary surgical microscopy system.

[0026] FIG. 3 is a flowchart of an exemplary method.

[0027] DETAILED DESCRIPTION

[0028] The above-described properties, features and advantages of this invention, as well as the manner in which they are achieved, will become clearer and more clearly understood in connection with the following description of the embodiments, which are explained in more detail in connection with the drawings.

[0029] The present invention is explained in more detail below using preferred embodiments with reference to the drawings. In the figures, identical reference numerals designate identical or similar elements. The figures are schematic representations of various embodiments of the invention. Elements shown in the figures are not necessarily drawn to scale. Rather, the various elements shown in the figures are depicted in such a way that their function and general purpose will be understood by those skilled in the art. Connections and couplings between functional units and elements shown in the figures can also be implemented as an indirect connection or coupling. A connection or coupling can be implemented wired or wirelessly. Functional units can be implemented as hardware, software, or a combination of hardware and software.

[0030] Techniques related to operating surgical microscopy systems are described below. The techniques described enable the automatic configuration of one or more components of the surgical microscopy system. This allows the surgical microscopy system to be brought into a state in which a specific object, e.g., a surgical instrument, is imaged by a microscope camera of the microscope of the surgical microscopy system in such a way that an assistance function is enabled based on a corresponding microscope image. The object is thus positioned such that it is located within the field of view of a microscope camera.

[0031] As described above, the object can be, for example, a surgical instrument. General examples of the object include surgical instruments, fingers, an inspection instrument, a micro-inspection instrument, a pointing instrument (e.g., with one or more machine-readable markers), and a confocal endomicroscope. General examples of surgical instruments include: scalpel, forceps, scissors, needle holders, clamps, suction devices, trocars, coagulators, electrocautery, refractors, drills, spreaders, osteotomes, sutures, knot pushers, periosteal elevators, hemostats, lancets, drains, suture cutters, spatulas, and ultrasonic aspirators.

[0032] FIG. 1 schematically illustrates aspects relating to an exemplary surgical microscopy system 80. The surgical microscopy system 80 serves to microscopically image an examination area during a surgical procedure. For this purpose, a patient 79 is placed on an operating table 70. The site 78 is shown with a surgical instrument 78.

[0033] The surgical microscopy system 80 includes a robotic stand 82 supporting a positionable head section 81. The robotic stand 82 can have different degrees of freedom depending on the variant. Robotic stands 82 are known that have six degrees of freedom for positioning the head section 81, i.e., translation along each of the x-axis, y-axis, and z-axis, and rotation about each of the x-axis, y-axis, and z-axis. The robotic stand 82 can have a handle 82a, as shown in FIG. 1.

[0034] The head section 81 comprises a microscope 84, which has optical components 85, such as an illumination lens, an objective lens, a zoom lens, etc. In the example shown, the microscope 84 also comprises a microscope camera 86 (here a stereo camera with two channels; however, a mono lens would also be conceivable), with which images of the examination area can be captured and displayed, for example, on a screen 69. Therefore, the microscope 84 is also referred to as a digital microscope. A field of view 123 of the microscope camera 86 is also shown.

[0035] In the example of FIG. 1, the microscope 84 also includes an eyepiece 87 with an associated field of view 122. For example, the detection beam path can be split using a beam splitter, allowing both an image to be captured by the camera 86 and viewing through the eyepiece 87. It is not necessary in all variants for the microscope 84 to have an eyepiece. Purely digital microscopes 84 without an eyepiece are also possible.

[0036] In the example of FIG. 1, the head section 81 of the surgical microscopy system 80, which is carried by the stand 82, also includes a field camera 83. While the field camera 83 is shown integrated into the microscope 84 in the example of FIG. 1, it would be possible for it to be arranged separately from the microscope 84. The field camera can be a CCD camera, for example. The field camera can also have a depth resolution. Alternatively or in addition to the field camera, it would also be conceivable for other assisting sensors to be present, e.g. a distance sensor (such as a time-of-flight camera or an ultrasonic sensor or a sensor with structured illumination). A field of view 121 of the field camera 83 is shown in FIG. 1.

[0037] The surgeon thus has several options for viewing the examination area: via the eyepiece 87, via the microscope image captured by the camera 86, or via an overview image captured by an environmental camera 83. The surgeon can also view the examination area directly (without magnification).

[0038] Next, aspects related to visual fields 121, 122 and 123 are discussed.

[0039] FIG. 2 illustrates aspects related to the various fields of view 121, 122, and 123. FIG. 2 shows the field of view 121 of a field camera of the surgical microscopy system 80. Overview images therefore depict a relatively large area. Also shown are the field of view 122 of the eyepiece and the field of view 123 of the camera 86 of the microscope 84. Sometimes the field of view 123 of the microscope 84 can be enlarged or reduced if zoom functionality is provided (not shown in FIG. 2).

[0040] In FIG. 2 it can be seen that the field of view 121 of the surrounding camera includes the field of view 122 of the eyepiece and the field of view 123 of the camera 86 of the microscope 83.

[0041] As a general rule, the field of view 121 of the surround camera may comprise at least one of the field of view 122 of the eyepiece 87 or the field of view 123 of the camera 86.

[0042] As a general rule, the various fields of view 121, 122, 123 can have different arrangements relative to one another. Figure 2 is only exemplary with regard to arrangement, relative size, etc.

[0043] FIG. 2 also shows boundary lines 125 for four sectors of the field of view 121 of the surround camera. Generally, the shape of such sectors is variable (e.g., rectangular, radial). The number of sectors can also vary.

[0044] Referring again to FIG. 1: The various components of the surgical microscopy system 80, such as the robotic stand 82, the microscope 84 or one or more other components such as the environment camera 83, are controlled by a processor 61 of a data processing device 60.

[0045] Processor 61 can be implemented, for example, as a general-purpose central processing unit (CPU) and / or as a field-programmable logic device (FPGA) and / or as an application-specific integrated circuit (ASIC). Processor 61 can load and execute program code from a memory 62.

[0046] The processor 61 can communicate with various components of the surgical microscopy system 80 via a communication interface 64. For example, the processor 61 can control the stand 82 to move the head section 81 relative to the operating table 70, for example, translationally and / or rotationally. The processor 71 can, for example, control optical components 85 of the microscope 84 to change a zoom and / or focus (focal length). Images from the peripheral camera, if present, could be read out and evaluated.

[0047] Furthermore, the data processing device 60 includes a user interface 63. Commands from a surgeon or, in general, a user of the surgical microscope system 80 can be received via the user interface 63. The user interface 63 can have various configurations. For example, the user interface 63 can include one or more of the following components: handles on the head part 81; foot switch; voice input;

[0048] Input via a graphical user interface; etc. It would be possible for the user interface 63 to provide graphical interaction via menus and buttons on the monitor 69.

[0049] Techniques are described below that allow for an automatic configuration for imaging a predefined object—such as a surgical instrument—using the surgical microscopy system 80. Such a configuration may, for example, include alignment to the surgical instrument. This alignment is required to provide assistance functionality. The assistance functionality requires one or more microscope images that depict the object. Therefore, the object must be positioned within the field of view 123 of the microscope camera 86.

[0050] Various examples are based on the realization that a user command requesting the assistance functionality is sometimes received in a situation where the corresponding object is not visible in the microscope image (e.g., because the user is not viewing the microscope image but looking through the eyepiece). The user command is thus triggered in a situation where the scene observed by the surgical microscopy system does not match the user's perception. In this case, the assistance functionality (e.g., auto-positioning, auto-focusing, auto-alignment, or the measurement of an instrument in the microscope image) cannot be executed in reference implementations.

[0051] Techniques that avoid such problems are described below. Figure 3 is a flowchart of an exemplary method. The method of Figure 3 relates to techniques related to configuring a surgical microscopy system to image a given object in response to a user command.

[0052] The method of FIG. 3 can be executed by a processor of a data processing device, for example, by processor 61 of data processing device 60 of surgical microscopy system 80 from the example of FIG. 1. For this purpose, the processor can load program code from a memory and then execute it.

[0053] The scenario in FIG. 3 is based on the realization that some surgical microscopy systems have several different fields of view available, for example in connection with the microscope camera and the eyepiece. Such a situation was described in connection with FIG. 2. This can lead to situations in which a surgical instrument is in the surgeon's optical field of view but not in the detection range of the microscope camera. This means that even if the surgeon sees the surgical instrument (e.g. through the eyepiece or by direct observation without the aid of the surgical microscopy system) and wants to activate an assistance function that requires an image of the surgical instrument in the microscope image (e.g. centering on the instrument tip or measuring a staple distance), the surgical instrument will not be found in the images captured by the camera.In reference implementations, this leads to an error; there is then a discrepancy between the surgeon's expectation (“assisting function should work”) and the actual action (“nothing happens”).

[0054] To avoid such problems, the example in FIG. 3 uses an overview image captured by a field camera. The field camera has a larger field of view than the microscope camera, but typically a lower spatial resolution. Nevertheless, an initial positioning of the instrument in the field of view of the microscope camera can be achieved using overview images captured by the field camera. This initial positioning typically does not have to be particularly precise; it is sufficient if the surgical instrument is depicted in the microscope images. A user command is received in box 3005. The user command can request an assistance functionality. The user command thus implicitly or explicitly requests the configuration of the microscope camera to image a specified object, e.g., an instrument.The user command is received by a user interface. The user command can, for example, request auto-alignment or auto-focusing on the object.

[0055] It would also be conceivable for the user command to not explicitly request the configuration of the microscope camera to image a given object, but only implicitly. For example, it would be possible for the user command to request the measurement of an opening of a specific surgical instrument. This requires that the corresponding surgical instrument be positioned within the field of view of the microscope camera so that a microscope image can be captured that depicts the surgical instrument to be measured. The user command can request an assistance function that relies on an image of the object in the microscope image.

[0056] An exemplary user interface 63 was discussed above in connection with the surgical microscopy system 80 in FIG. 1. For example, the user command can be a voice command. The user command could be, for example, "auto-centering." The user command could also be "auto-focus" or "auto-orientation," to name just a few examples. Different ways of receiving the user command are possible. For example, the user command could be received not only as a voice utterance, but also as a keystroke, for example, on a foot control panel. The user command could also be received via input in a graphical user interface on a computer.

[0057] In particular, when the user command is received via a user interface that is not supported by the stand (e.g., via a foot pedal or a graphical user interface button on a monitor located next to the stand) or when it is received via a voice recognition interface, there is a possibility that the user will issue the user command at a time when the user is not viewing the microscope image. For example, the user may be directly viewing the examination area. This means that at the time the user command is issued, the user may not be aware that the field of view of the microscope camera or the field of view of the eyepiece does not image the corresponding surgical instrument.

[0058] A microscope image is captured in box 3010. For this purpose, the microscope camera of the microscope is controlled (compare microscope camera 87 of microscope 84 in the example of FIG. 1). As already discussed above in connection with FIG. 2, the microscope camera typically has a comparatively small field of view, namely, in particular, a field of view that is smaller than the field of view of an eyepiece or a field camera, if present.

[0059] In box 3015, the object identified by the user command, for example, a surgical instrument, is then searched for in the microscope image from box 3010. If the object is already positioned in the field of view of the microscope camera, the object is found in box 3015, meaning it is visible in the microscope image. Then, box 3020 is executed. There, an assistance function based on the microscope image is executed (e.g., auto-centering or auto-focusing, or measuring the object).

[0060] Scenarios may occur where the object is not found in the microscope image in box 3015. This means that the object is not positioned in the (typically central) area of ​​the scene imaged by the microscope camera. Therefore, the object is not visible in the initially acquired microscope image (first iteration 3041 of box 3010).

[0061] In such a case, the surround camera is controlled in box 3025 to capture an overview image. The surround camera is controlled to check whether the object is positioned in the peripheral area of ​​the scene, which is imaged by the surround camera but not by the microscope camera.

[0062] Then, in box 3030, it can be determined whether the object is visible in the overview image. For example, it can be determined whether the object is located in the peripheral area, i.e., in the area of ​​the scene covered by the field of view of the surround camera, but not by the field of view of the microscope (in FIG. 2, this is the area that lies outside field of view 123 but within field of view 121). Generally speaking, the object is searched for in the overview image.

[0063] In some examples, it would be possible to limit the search area for the object in the overview image. This means that not the entire field of view of the peripheral camera is evaluated. This could, for example, allow surgical instruments lying on a sterile tray to be excluded from consideration in connection with Box 3030.

[0064] Box 3030 may include object recognition (ie, determining whether an object is visible “yes / no” – without determining exactly where the object is located; sometimes referred to as object detection) and, if appropriate, object localization (ie, determining exactly where the object is located).

[0065] There are different techniques for detecting an object. For example, a machine-learned algorithm can be used that outputs a detection flag (e.g., "object detected" vs. "object not detected").

[0066] There are different techniques for locating the object in the overview image. For example, motion information could be used.

[0067] Motion information could, for example, be determined based on a sequence of overview images. For example, optical flow could be determined between successive overview images of the sequence of overview images, and then regions with significant optical flow could be taken into account. Alternatively or additionally, pre-trained machine-learned models could be used. For example, a machine-learned model could be used that receives both an overview image as input and an optical flow image. Based on such techniques, a particularly reliable and robust determination of whether a given object is in the field of view of the environment camera can be made. The object can also be localized.

[0068] If the object is not found, an error is raised in box 3035. Otherwise, box 3040 is executed.

[0069] In box 3040, a control command is provided for the robotic stand to move the microscope so that the object is positioned within the field of view of the microscope camera. This means that a rough alignment is performed in box 3040 so that the surgical instrument is subsequently visible in a microscope image, which is captured in a further iteration 3041 of box 3010.

[0070] To determine a corresponding control command for the robotic tripod, the specified object can be localized in the overview image (for example, if this has not already been done in box 3030). Based on the localization, a movement trajectory for the robotic tripod can be determined, for example, so that the object is subsequently in the field of view of the microscope camera.

[0071] Such localization does not need to be performed with particularly high precision. For example, localization could be performed with a spatial resolution that roughly corresponds to the extent of the area captured by the field of view of the microscope camera. For example, four sectors were discussed in connection with FIG. 2. For example, a rough positioning could be performed with respect to these sectors, which is sufficient to subsequently achieve a rough arrangement within the field of view of the microscope camera. Thus, sector localization can be performed.

[0072] In summary, the method in FIG. 3 makes it possible to first capture an overview image using the field camera to locate one or more surgical instruments for assistive functions. This overview image from the field camera is then evaluated to determine whether one or more surgical instruments are located there. The robotic stand is then controlled to move the detected one or more surgical instruments into the field of view of the microscope camera. The actual assistance functionality can then be performed, e.g., based on a particularly precise localization of the one or more surgical instruments, which is possible using the microscope image.

[0073] Using the method from FIG. 3, different workflows can be implemented. Two example workflows are described next for illustration. (i) In a first example workflow, the surgeon works outside the field of view of the microscope camera and activates - via foot control panel or voice control - the auto-centering of the field of view of the microscope camera on the tips of the surgical instruments used, compare box 3005. Then, in box 3010, it is determined that the tips of the surgical instruments are not detected by the microscope camera, i.e., the tips of the surgical instruments must be outside the field of view of the microscope camera, compare box 3015. An overview image captured by the surroundings camera is then evaluated.For example, motion information could be determined for different sectors, such as four sectors as discussed in connection with FIG. 2. A rough localization of the surgical instruments in the overview image is performed, and activity of the surgical instruments in a sector is detected. Subsequently – see box 3040 – the robotic stand is controlled such that the microscope is moved so that the detected surgical instruments are positioned in the field of view of the microscope camera. It is then possible to localize the tips of the surgical instruments using the microscope camera (see box 3010). Such localization can be performed during the rough positioning movement or during a movement interruption. Once the tips of the surgical instruments are precisely positioned, auto-centering can then be performed (see box 3020).

[0074] (ii) In a second exemplary workflow, the surgeon works outside the detection range of the microscope camera and then activates the measurement of distances using the tips of surgical instruments via a foot control panel or voice control (see Box 3005). Since the tips cannot be detected with the microscope camera (see Box 3015), one or more overview images from the field camera are evaluated (see Box 3025, Box 3030). The surgical microscope is then roughly positioned by controlling the robotic stand until the tips of surgical instruments are positioned in the field of view of the microscope camera. The movement stops, and then a new microscope image is captured with the microscope camera in which the microscope tips are visible (Box 3015). The actual assistance functionality can then continue (see Box 3020).This includes, for example, providing an acoustic and / or visual signal to the surgeon that a second measurement point for the additional tip can be set. The second tip position is then determined and a distance between the two tips is output based on the determined positions.

[0075] Various modifications of FIG. 3 are conceivable. For example, a scenario was described above in which a microscope image is first acquired (see box 3010), and then a check is made to determine whether the surgical instruments are already visible in the field of view of the microscope image (see box 3015). In various examples, it would be conceivable for an overview image to be acquired immediately in box 3025, and only then, when it is determined that the surgical instruments are already roughly centered, for a microscope image to be acquired in order to perform precise positioning. This means that the first iteration 3041 of box 3010 and box 3015 is optional.

[0076] The features set forth above and features described below may be used not only in the corresponding explicitly set forth combinations, but also in further combinations or in isolation, without departing from the scope of the present invention.

[0077] For example, various aspects related to imaging with respect to a surgical instrument were described above. However, as a general rule, it would be conceivable to also consider other objects, such as characteristic anatomical features of the patient.

[0078] Furthermore, aspects were described above in which the field camera is attached to the tripod head and can thus be positioned by the robotic tripod. However, scenarios are also conceivable in which the field camera is not attached to the tripod head, but is arranged stationary in relation to the patient. The field camera could also be arranged separately from the robotic tripod and can be moved, e.g. on a separate swivel arm or on a swivel arm of a surgical light. In such a case, the relative positioning of the field of view of the microscope camera in relation to the patient can still be determined based on overview images acquired by the field camera, if the robotic tripod head is positioned at the same time. Corresponding techniques are available in the prior art and need not be explained here.

[0079] Furthermore, various aspects related to a robotic stand were described above. It is not absolutely necessary for the surgical microscopy system to have a robotic stand. The surgical microscopy system could also have a partially robotic stand or a manual stand.

Claims

PATENT CLAIMS 1. A computer-implemented method (3000) for controlling a surgical microscopy system (80) having a robotic stand (82), a microscope (84) carried by the robotic stand (82), and an environmental camera (83) carried by the robotic stand (82), wherein the environmental camera (83) has a first field of view (121) that is larger than a second field of view (123) of a microscope camera (86) of the microscope (84), the method comprising: - receiving (3005) a user command requesting a configuration of the microscope camera (86) for imaging an object (78), - after receiving the user command: Control (3025) the environment camera (83) for capturing an overview image, - Search (3030) for the object (78) in the overview image, - if the object (78) is found in the overview image, providing (3040) a control command for the robotic stand (82) to move the microscope (84) so ​​that the object (78) is positioned in the second field of view (123) and then controlling (3010) the microscope camera (86) to capture a microscope image, and - based on the microscope image: Execution (3020) of an assistance functionality.

2. A computer-implemented method according to claim 1, wherein the method comprises: - in response to receiving the user command: controlling (3010) the microscope camera (86) to capture an initial microscope image, and - Searching (3015) for the object in the initial microscope image, wherein the surroundings camera (83) is selectively controlled to capture the overview image when the object (78) is not found in the microscope image.

3. Computer-implemented method according to claim 1 or 2, wherein the object (78) is selected from the following group: Microinspection instrument; confocal endomicroscope; surgical instrument; or finger.

4. A computer-implemented method according to any one of the preceding claims, wherein the user command requests an auto-alignment of the second field of view (123) to the object (78).

5. Computer-implemented method according to one of the preceding claims, wherein the user command requests autofocusing of the microscope camera (86) on the object (78).

6. A computer-implemented method according to any one of the preceding claims, wherein the user command is received via a speech recognition interface or via a physical user interface that is not carried by the robotic stand.

7. A computer-implemented method according to any one of the preceding claims, wherein the method further comprises: - based on the overview image: Localize the object in the overview image and, based on the localization, determine a movement trajectory for the robotic tripod so that the object is positioned in the central area.

8. Data processing device (60) for controlling a surgical microscopy system (80), wherein the data processing device (60) comprises a processor (61) configured to load and execute program code from a memory (62), wherein the execution of the program code causes the processor (61) to perform the following steps: - receiving (3005) a user command requesting a configuration of a microscope camera (86) of the surgical microscopy system (80) for imaging an object (78), - after receiving the user command: controlling (3025) an environmental camera (83) of the surgical microscopy system (80) to capture an overview image, - Search (3030) for the object (78) in the overview image, - if the object (78) is found in the overview image, providing (3040) a control command for a robotic stand (82) of the surgical microscopy system (80) to move the microscope (84) so ​​that the object (78) is positioned in a field of view (123) of the microscope camera (86) and then controlling (3010) the microscope camera (86) to capture a microscope image, and - based on the microscope image: Execution (3020) of an assistance functionality.

9. Data processing device (60) according to claim 8, wherein the execution of the program code causes the processor (61) to carry out the method according to one of claims 1 to 7.

10. Surgical microscopy system (80) comprising the data processing device (60) according to claim 8 or 9.

Images