Surgical microscope system and corresponding system, method and computer program product

Abstract

To provide a system, a method, and a computer program for controlling a recording device of a surgical endoscope system, and a corresponding surgical endoscope system.SOLUTION: A system of the present invention includes one or more processors 114, an interface 112 joined to the processors 114, and one or more storage devices 116 as an option. The system is configured to acquire input data from one or more sensors or actors of a surgical endoscope system through the interface 112. The system is configured to detect start or end of surgery on the basis of the input data. The surgery is accompanied by use of the surgical endoscope system. The system is configured to supply a control signal to a recording device of the surgical endoscope system through the interface 112 on the basis of the detected start or end of the surgery.SELECTED DRAWING: Figure 1a

Description

[Technical Field]

[0001] The present example relates to a system, a method and a computer program for controlling a recording device of a surgical microscope system and a corresponding surgical microscope system. [Background technology]

[0002] In efforts to improve the quality of surgical procedures, a major focus has been on recording surgical procedures with cameras that can be integrated into surgical microscopes. In some countries, such as Singapore, such video recording is mandatory for all surgeries. For example, ophthalmic surgery, and more specifically cataract surgery, is increasingly being performed, but delays can occur due to recording handling, as the surgeon may manually start and stop recording using a foot switch or with the assistance of a nurse. Summary of the Invention [Problem to be solved by the invention]

[0003] An improved concept for controlling the recording of a surgery may be desired. [Means for solving the problem]

[0004] This need is addressed by the subject matter of each independent claim.

[0005] Embodiments of the present disclosure are based on the discovery that the state of a surgical microscope system including a surgical microscope can be analyzed to determine whether the surgical microscope is being used for a surgical procedure or whether the surgical microscope is not currently in use. For example, the vertical height of the surgical microscope above the ground or above the patient can indicate that the surgical microscope system is in use. Additionally or alternatively, a parallelogram section of the arm of the surgical microscope system can have an active orientation that places the surgical microscope in a first position (e.g., above the patient) (indicating that the surgical microscope is in use) and a parked orientation that places the surgical microscope in a second position away from the patient (indicating that the surgical microscope system is not in use). Additionally or alternatively, image sensor data from the imaging sensor of the surgical microscope can be used to determine whether the captured image sensor data is in focus (indicating that the surgical microscope is in use) or whether the patient is visible in the captured image sensor data (indicating that the surgical microscope is in use). Based on the detection, recording can be controlled (i.e., automatically started and / or stopped). Using this method, delays can be avoided and operating room efficiency and turnover can be improved, resulting in more patients being saved per day.

[0006] An embodiment of the present disclosure provides a system for controlling a recording device of a surgical microscope system. The system includes one or more processors and an interface. The system is configured to receive input data from one or more sensors or actors of the surgical microscope system via the interface. The system is configured to detect the start or end of a surgery based on the input data. The surgery involves use of the surgical microscope system. The system is configured to provide a control signal to a recording device of the surgical microscope system via the interface based on the detected start or end of the surgery. The input data can be used to detect the start or end of a surgical procedure, which can trigger activation or deactivation of recording performed by the recording device.

[0007] In various embodiments, the input data includes information regarding the position of an arm of a surgical microscope system. The system may be configured to detect the start or end of a surgical procedure based on the information regarding the position of the arm. The position of the arm may indicate whether the surgical microscope is in use.

[0008] In an embodiment, the surgical microscope of the surgical microscope system is attached to an arm of the surgical microscope system. Information about the position of the arm may include information about the vertical position of the surgical microscope. The system may be configured to detect the start or end of a surgery based on information about the vertical position of the surgical microscope. For example, the start of a surgical procedure may be detected when the surgical microscope is moved to a lower vertical position (e.g., closer to the surgical site), and the end of a surgical procedure may be detected when the surgical microscope is moved to a higher vertical position. In other words, the system may be configured to detect the start of a surgery after the vertical position of the surgical microscope is lowered below a threshold value. The system may be configured to detect the end of a surgery after the vertical position of the surgical microscope is raised above a threshold value.

[0009] In some cases, the surgical microscope may be temporarily moved out of the way, i.e., above the threshold, before resuming surgery. In such cases, a timer may be used to ensure that recording is not stopped during that time. For example, the system may be configured to detect the end of surgery when the surgical microscope remains above the threshold for at least a predetermined time interval.

[0010] To obtain a higher degree of confidence, not only the vertical height but also the usage status of the surgical microscope system may be analyzed. Generally, surgical microscopes have a shallow depth of field. When the surgical microscope is not in use, the object being observed by the microscope becomes out of focus, which can indicate that the surgical microscope is not in use (at least temporarily). In other words, the input data may include image sensor data of the imaging sensor of the surgical microscope. The system may be configured to detect the end of surgery when the surgical microscope remains above a threshold and the image sensor data is out of focus for at least a predetermined time interval. The image sensor data can increase confidence that the surgical microscope is not currently in use.

[0011] In various embodiments, the arm of the microscope system includes a parallelogram section. The information about the position of the arm can include information about the orientation of the parallelogram section of the arm. The system can be configured to detect the start or end of surgery based on the information about the orientation of the parallelogram section of the arm. For example, the parallelogram section of the arm can be moved between an active position / orientation and a retracted position / orientation.

[0012] Generally, there are (at least) two ways to determine the position of the arm. In some embodiments, sensor data from a sensor in the arm determines the position of the surgical microscope (and thus the orientation of the arm). For example, one or more sensors or actors of the surgical microscope system may comprise a positioning sensor for determining the position of the arm (and thus the position of the surgical microscope). The system may be configured to obtain information about the position of the arm from the positioning sensor. Alternatively, the arm may be a robotic arm. In this case, the state of the robotic arm may reflect the position of the robotic arm and thus the position of the surgical microscope. In other words, the arm may be a robotic arm. The system may be configured to obtain information about the position of the arm from a control circuit of the robotic arm.

[0013] In various embodiments, the input data includes image sensor data from an imaging sensor of a surgical microscope of a surgical microscope system. The system may be configured to detect the start or end of surgery based on the image sensor data. Various aspects of the image sensor data can be used to determine whether the surgical microscope is currently in use and, therefore, the start and / or end of a surgical procedure.

[0014] For example, the system may be configured to detect the presence of a patient in the imaging sensor data. The system may be configured to detect the start or end of a procedure based on the presence of a patient in the imaging sensor data. For example, the start of a procedure can be detected when the patient becomes visible in the imaging sensor data, and the end of a procedure can be detected when the patient disappears from the imaging sensor data.

[0015] Alternatively or additionally, (ambient) lighting may be analyzed to detect the start or end of a surgical procedure. For example, during surgery, lighting may be focused on the patient, leaving other parts of the room less illuminated. Outside of surgery, the lighting in the room may be more homogenous. In other words, the input data may include information about the lighting used in the environment of the surgical microscope system. The system may be configured to detect the start or end of a surgery based on information about the lighting used in the environment of the surgical microscope system.

[0016] The start and end of surgery are used to control the recording device. Thus, the system may be configured to provide a control signal to start recording performed by the recording device when the start of surgery is detected. The system may be configured to provide a control signal to stop recording performed by the recording device when the end of surgery is detected. Thus, recording can be started and / or stopped automatically.

[0017]

[0010] Embodiments of the present disclosure further provide a surgical microscope system including the above-described system, one or more sensors or actors for providing input data, and a recording device. Thus, the surgical microscope system can provide automatic control of the recording device. Additionally, the surgical microscope system can include at least one of a surgical microscope, an arm attached to the surgical microscope, and an optical imaging sensor.

[0018] An embodiment of the present disclosure further provides a method for controlling a recording device of a surgical microscope system. The method includes obtaining input data from one or more sensors or actors of the surgical microscope system. The method includes detecting a start or end of a surgery based on the input data. The surgery involves use of the surgical microscope system. The method includes providing a control signal to a recording device of the surgical microscope system based on the detected start or end of the surgery.

[0019] An embodiment of the present disclosure further provides a computer program comprising program code for performing the method when the computer program is run on a processor.

[0020] Some examples of apparatus and / or methods will now be described, by way of example only, with reference to the accompanying figures, in which: [Brief explanation of the drawings]

[0021] [Figure 1a] FIG. 1 is a block diagram of one embodiment of a system for controlling a recording device of a surgical microscope system. [Figure 1b] FIG. 1 is a schematic diagram of one embodiment of a surgical microscope system. [Figure 1c] FIG. 1 is a more detailed schematic diagram of one embodiment of a surgical microscope system. [Figure 1d] FIG. 1 is a more detailed schematic diagram of one embodiment of a surgical microscope system. [Figure 2] 1 is a flowchart of a method for controlling a recording device of a surgical microscope system. [Figure 3a] 1 is a schematic diagram of a surgical microscope system in an active position and a retracted position. [Figure 3b] 1 is a schematic diagram of a surgical microscope system in an active position and a retracted position. [Figure 4] 1 is a schematic diagram of a system comprising a microscope and a computer system. DETAILED DESCRIPTION OF THE INVENTION

[0022] Various examples will now be described more fully with reference to the accompanying drawings, which illustrate several examples in which the thickness of lines, layers and / or regions may be exaggerated for clarity.

[0023] FIG. 1a shows a block diagram of one embodiment of a system 110 for controlling a recording device 120 of a surgical microscope system 100. The system includes one or more processors 114 and an interface 112 coupled to the one or more processors. Optionally, the system further includes one or more storage devices 116, also coupled to the one or more processors. Generally, the functionality of the system 110 is provided by the one or more processors in cooperation with the interface and / or the one or more storage devices. The system is configured to receive input data from one or more sensors or actors of the surgical microscope system via the interface. The system is configured to detect the start or end of a surgery based on the input data. The surgery involves use of the surgical microscope system (e.g., of a surgical microscope 140 of the surgical microscope system). The system is configured to provide a control signal to a recording device of the surgical microscope system via the interface based on the detected start or end of the surgery.

[0024] Embodiments of the present disclosure relate to systems, methods, and computer programs for controlling a recording device 120 of a surgical microscope system 100 that includes a surgical microscope 140. Generally, a microscope is an optical instrument suitable for inspecting small objects that cannot be inspected by the human eye (alone). For example, a microscope can provide an optically magnified image of a sample. In modern microscopes, the optically magnified image is often provided to a camera or to an imaging sensor, such as the optical imaging sensor 142 of the microscope 140 shown in FIG. 1b. The surgical microscope 140 may further include one or more optical magnification components, such as an objective lens (i.e., a lens), used to magnify the view of the sample.

[0025] There are many different types of microscopes. When used in medicine or biology, the object observed by the microscope may be, for example, a sample of organic tissue placed in a petri dish or present in a part of a patient's body. In an embodiment, the microscope is a surgical microscope, i.e., a microscope used during a surgical procedure. Such a system is shown, for example, in Figures 1b to 1d. Figure 1b shows a neurosurgical microscope system comprising a neurosurgical microscope. Figures 1c and 1d show a surgical microscope used in ophthalmology (i.e., the diagnosis and treatment of eye diseases). Thus, the object observed by the microscope and shown in the image data may be a sample of organic tissue from a patient.

[0026] The system 110 described above is suitable for use with a surgical microscope system 100. Figure 1b shows a schematic diagram of one embodiment of the surgical microscope system 100. In Figure 1b, a neurosurgical microscope system is shown. The surgical microscope system 100 comprises the system 110, one or more sensors or actors 132, 134, 142 for providing input data, and a recording device 120. The surgical microscope system comprises a surgical microscope 140 (a neurosurgical microscope in Figure 1b), an arm 130 attached to the surgical microscope, and an optical imaging sensor 142 of the surgical microscope (which is one of the one or more sensors for providing input data). The surgical microscope system 100 shown in FIG. 1b comprises several optional components, such as a base unit 102 (comprising the system 110) with a (rotating) stand, one or more displays 150, an arm 130 (robotic or manual) that holds the microscope 140 in place and is coupled to the base unit 102 and the microscope 140, and a steering wheel 160 attached to the microscope 140. In other words, the surgical microscope 140 of the surgical microscope system may be attached to the arm 130 of the surgical microscope system. One or more of the displays 150 may be part of the microscope 140, for example as an auxiliary or eyepiece display. In the context of this application, the term "surgical microscope system" is used to cover system parts that are not part of the actual microscope (including the optical components) but are used in conjunction with the microscope, such as a display and an illumination system.

[0027] FIGS. 1c and 1d show another type of surgical microscope system, a surgical microscope system used in ophthalmology. FIGS. 1c and 1d show a (more detailed) schematic diagram of one embodiment of a surgical microscope system used in ophthalmology. In FIGS. 1c and 1d, a surgical microscope 140 (also referred to as an "optics carrier") is shown along with a parallelogram portion 136 of the surgical microscope system's arm. The surgical microscope system of FIGS. 1c and 1d further includes a display / video monitor 150 with an optional monitor arm 152, a base unit 102, a foot brake 104, and handrails 106. The surgical microscope system 100 of FIG. 1c includes control units 118a and 118b for controlling the system 110 and / or for controlling the camera and video. An interface 112 is also shown, which may provide connections (electrical, video, etc.). The surgical microscope system of FIGS. 1c and 1d also includes a speaker 108, which is part of the base unit 102.

[0028] Generally, the system is configured to detect the start or end of surgery based on input data from one or more sensors or actors. Accordingly, the system is configured to obtain, e.g., receive or read, the respective input data from one or more sensors and actors. For example, the input data may be obtained by receiving the input data from one or more sensors or actors (e.g., via interface 112), by reading the input data from memory of one or more sensors or actors (e.g., via interface 112), or by reading the input data from storage device 116 of system 110 after the input data has been written to storage device 116 by, for example, one or more sensors or actors or by another system or processor.

[0029] In general, input data from different types of sensors and actors can be used to determine the start or end of surgery (i.e., a surgical procedure). At this time, the position and / or orientation of the arm 130 of the surgical microscope system can indicate that surgery is occurring. Accordingly, the system may be configured to obtain (at least a portion of) the input data from a positioning sensor 132 of the arm 130 (e.g., if the arm is an arm that is manually positioned by the surgeon), or, if the arm is a robotic arm, the system may be configured to obtain (at least a portion of) the input data from a control circuit 134 of the robotic arm (i.e., part of the actor system). In other words, one or more sensors or actors of the surgical microscope system may include a positioning sensor 132, such as a Hall-effect-based positioning sensor or a rotary encoder, for determining the position of the arm. The system may be configured to obtain information regarding the position of the arm from the positioning sensor 132. Alternatively, the system may be configured to obtain information regarding the position of the arm from the control circuit 134 of the robotic arm. In some embodiments, the imaging sensor 142 of the surgical microscope may be used to determine the start or end of a surgical procedure. Thus, the system may be configured to obtain input data, e.g., (at least a portion of) the image sensor data, from the imaging sensor 142 of the surgical microscope. The system may also analyze surgical lighting or ambient lighting to determine whether a surgical procedure has begun or ended. Thus, the system may be configured to obtain input data (at least a portion of) from a control circuit of a lighting system or to use the image sensor data of the imaging sensor 142 of the microscope 140.

[0030] Based on the input data, the system is configured to detect the start or end of use of the surgical microscope system, for example, a surgery (or surgical procedure) involving use of the surgical microscope of the surgical microscope system. In other words, the surgical microscope of the surgical microscope system may be used during surgery (at least most of the time). For example, the surgery may be performed using the surgical microscope, i.e., with the aid of the surgical microscope. Thus, the input data may (implicitly) indicate the use of the surgical microscope system during surgery. Here, the system may be used to detect markers that indicate that the surgical microscope (system) is being used for surgery, and thus markers that indicate the start and / or end of surgery. These markers may be implicit markers, i.e., may implicitly indicate the start and / or end of surgery. In other words, the input data may be analyzed to detect evidence of the start and / or end of surgery. In various examples, detecting the start and / or end of surgery may not be based on detecting manual activation and / or deactivation of recording. As indicated in the previous section, there are different markers that can be used (to detect the start and / or end of surgery).

[0031] One key landmark is the position and / or orientation of the arm of the surgical microscope system, and thus the position of the surgical microscope itself. Thus, the input data may include information regarding the position of the arm 130 of the surgical microscope system. For example, the information regarding the position of the arm may include information regarding the vertical and lateral orientation of the arm and / or information regarding the position of the surgical microscope attached to the arm. In other words, the information regarding the position of the arm may include information regarding the vertical and / or lateral position of the surgical microscope attached to the arm. This information may be used to detect the start or end of surgery. Thus, the system may be configured to detect the start or end of surgery based on the information regarding the position of the arm. For example, the start of surgery can be detected when the position of the arm (and thus the surgical microscope) is changed to a first position range, and the end of surgery can be detected when the position of the arm (and thus the surgical microscope) is changed to a second position range. For example, the first position range may indicate the start of surgery (or that surgery is in progress), e.g., due to the proximity of the first position range to the operating table, and the second position range may indicate the end of surgery (or that surgery is not being performed).

[0032] Two position ranges may be defined along the vertical position of the surgical microscope (i.e., its height above a reference level, such as the ground or the patient). In other words, the system may be configured to detect the start or end of surgery based on information about the vertical position of the surgical microscope. For example, if the surgical microscope is lowered (and thus moved closer to the patient / patient's surgical site), that position may indicate that surgery has begun or is in progress, and if the surgical microscope is placed in a higher vertical position (and thus moved further away from the patient / surgical site), that position may indicate that surgery has ended or is complete. Thus, the system may be configured to detect the start of surgery after the vertical position of the surgical microscope is lowered below a threshold (e.g., below a first lower threshold) and to detect the end of surgery after the vertical position of the surgical microscope is raised above a threshold (e.g., a second higher threshold). Thus, a vertical position of the surgical microscope below the (first lower) threshold may correspond to a first position range, and a vertical position above the (second higher) threshold may correspond to a second transition range.

[0033] In some cases, the surgeon may move the surgical microscope out of the way during a surgical procedure, for example, to perform a portion of the procedure where a full view of the surgical site is desired, or to access additional surgical tools or remove previously used tools. In such cases, it may be desirable to postpone the end of recording, since a single, continuous recording of the surgical procedure may be required. This may not be necessary if the imaging sensor of the surgical microscope is simply used to record the surgeon, as the recording would only show an out-of-focus image. However, recording is often performed using multiple cameras (including the imaging sensor of the surgical microscope), for example, to capture everything that is happening in the operating room. Thus, recording may not immediately end when the surgical microscope is moved away from the patient. Therefore, a timer may be used to delay detecting the end of the surgery until after the timer has expired. In other words, the system may be configured to detect the end of the surgery if the surgical microscope remains above a threshold for at least a predetermined time interval.

[0034] Other factors may also be considered. For example, as previously introduced, out-of-focus image sensor data provided by the imaging sensor of the surgical microscope can also indicate the end of surgery. Thus, the system may be configured to detect the end of surgery when the surgical microscope remains above a threshold and the image sensor data is out-of-focus for at least a predetermined time interval. The system may be configured to determine whether the image sensor data is out-of-focus, for example, by determining the contrast of the image sensor data and comparing the contrast to a threshold. Higher contrast typically indicates that the image sensor data is in focus. Alternatively, built-in features of the image sensor may be used.

[0035] As previously mentioned, the orientation of the arm, particularly the arm's parallelogram section, can also indicate whether surgery is currently being performed. Typically, the arm's parallelogram section is an arm section that allows vertical adjustment of the surgical microscope's position without changing the surgical microscope's angle (above the ground / patient). In many implementations, the parallelogram section includes a compression spring or hydraulic system that assists in changing the surgical microscope's position. Information about the arm's position can include information about the orientation of the arm's parallelogram section, and thus, information about the (vertical and / or horizontal) position of the surgical microscope attached to the arm. The system can be configured to detect the start or end of surgery based on information about the orientation of the arm's parallelogram section. For example, the parallelogram section can have an "active" orientation (during surgery), which can be at a first angle (or angle range) and / or vertical height (above the patient), and a "retracted" orientation, which can be at a second angle (or angle range) away from the patient and / or vertical height farther away from the patient / operating table (see FIGS. 3a and 3b). Thus, the position of the surgical microscope where the parallelogram section is in the active orientation may be within a first range of positions, and the position of the surgical microscope where the parallelogram section is in the retracted orientation may be within a second range of positions. The system may be configured to detect the start of surgery when the parallelogram section is transitioned to the active orientation, and to detect the end of surgery when the parallelogram section is in the retracted orientation (e.g., for at least a predetermined four time interval) (and / or the imaging sensor data is out of focus for at least a predetermined time interval).

[0036] In various embodiments, the input data includes image sensor data from an imaging sensor 142 of a surgical microscope of a surgical microscope system. For example, the system may be configured to acquire image sensor data from the optical imaging sensor 142 of the microscope. For example, the optical imaging sensor 142 may comprise an active pixel sensor (APS) or a charge-coupled device (CCD)-based imaging sensor, or may be a charge-coupled device (CCD)-based imaging sensor. For example, in an APS-based imaging sensor, light is recorded at each pixel using a pixel photodetector and an active amplifier. APS-based imaging sensors are often based on complementary metal-oxide-semiconductor (CMOS) or scientific CMOS (S-CMOS) technology. In a CCD-based imaging sensor, incident photons are converted into electronic charges at a semiconductor-oxide interface, which are then transferred between capacitive bins of the imaging sensor by the imaging sensor's control circuitry to generate an image.

[0037] The system may be configured to detect the start or end of surgery based on imaging sensor data (which may be generated by the imaging sensor of the surgical microscope and / or by one or more additional imaging sensors, e.g., cameras, located in the environment of the surgical microscope system). For example, in some embodiments, the imaging sensor data may indicate a patient on the operating table when the surgical microscope is placed over the patient during surgery, which is a reliable indicator that surgery is in progress or has begun. Thus, the system may be configured to detect the presence of the patient in the imaging sensor data. The system may be configured to detect the start or end of surgery based on the presence of the patient in the imaging sensor data. For example, the system may detect the start of surgery if or when the patient is (first) detected by the imaging sensor data, and the end of the surgical procedure if the patient is no longer detected or when the patient's removal from the operating table is detected.

[0038] Another landmark or indicator is the lighting in the operating room. During surgery, ambient light is typically reduced or switched off, and lighting is focused on the patient. Between surgeries, ambient light is switched on, for example, to allow the sterile cover of a surgical set to be replaced. Therefore, the system may be configured to analyze the lighting situation in order to detect the start or end of a surgery. In other words, the input data may include information about the lighting used in the environment of the surgical microscope system (e.g., the operating room). For example, image sensor data from an image sensor of the surgical microscope (or another image sensor, e.g., a camera with a field of view covering the surgical team) may include information about the lighting used in the environment of the surgical microscope system. Alternatively or additionally, the system may be configured to obtain (at least a portion of) the information about the lighting used in the environment of the surgical microscope system from control circuits of the surgical microscope system and / or the lighting system of the operating room. The system may be configured to detect the start or end of a surgery based on the information about the lighting used in the environment of the surgical microscope system. For example, the system may be configured to detect the start of a surgery if the information about the lighting used in the environment of the surgical microscope system indicates the reduction or switching off of ambient light and the focus of lighting on the patient. The system may be configured to detect the start of surgery when information regarding the lighting used in the environment of the surgical microscope system indicates that ambient light is switched on or increased and / or the lighting system of the surgical microscope system is reduced or switched off.

[0039] The system is configured to provide a control signal to a recording device of the surgical microscope system via the interface based on the detected start or end of the surgery. Generally, the control signal may be a digital signal, such as a digitally transmitted packet, or an analog signal, such as an analog current signal. The control signal may be suitable for triggering the recording device to start or stop recording. For example, different digital bit values ​​may be transmitted, or different analog voltages or currents may be applied to trigger the recording device to start or stop recording. The system may be configured to provide a control signal to start recording performed by the recording device when the start of the surgery is detected, and to provide a control signal to stop recording performed by the recording device when the end of the surgery is detected. Thus, the recording device may be configured to start or stop recording based on the control signal. The recording device may be configured to record imaging sensor data of an imaging sensor of the surgical microscope. Additionally (or alternatively), the recording device may be configured to record imaging sensor data of one or more additional imaging sensors (i.e., cameras) located in the environment of the surgical microscope system, for example, a camera having a field of view covering the entire surgical time and / or the entire surgical site. The recording device may store a separate digital file for each recording, the digital file containing the respective recording (eg, in a storage module).

[0040] The interface 112 may correspond to one or more inputs and / or outputs for receiving and / or transmitting information, which may be in digital (bit) values ​​according to a specified code, within a module, between modules, or between modules of different entities. For example, the interface 112 may comprise an interface circuit configured to receive and / or transmit information. In an embodiment, the one or more processors 114 may be implemented using any processing means, such as one or more processing units, one or more processing devices, processors operable by appropriately adapted software, computers, or programmable hardware components. In other words, the described functionality of the one or more processors 114 may equally be implemented in software running on one or more programmable hardware components. Such hardware components may comprise general-purpose processors, digital signal processors (DSPs), microcontrollers, etc. In at least some embodiments, one or more storage devices 116 may comprise at least one element of a group of computer-readable storage media, such as magnetic or optical storage media, e.g., hard disk drives, flash memory, floppy disks, random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electronically erasable programmable read-only memory (EEPROM), or network storage.

[0041] More details and aspects of the system and microscope system are set forth in relation to the proposed concepts or one or more examples described above or below (e.g., FIGS. 2-4). The system and microscope system may include one or more additional optional features corresponding to one or more aspects of the proposed concepts or one or more examples described above or below.

[0042] 2 shows a flowchart of a corresponding method for controlling a recording device of a surgical microscope system. The method includes obtaining 210 input data from one or more sensors or actors 132, 134, 142 (as shown in FIGS. 1a-1d) of the surgical microscope system. The method includes detecting 220 the start or end of a procedure involving use of the surgical microscope system based on the input data. The method includes providing 230 a control signal to a recording device 120 of the surgical microscope system based on the detected start or end of the procedure.

[0043] As indicated above, the features described in connection with the system 110 and microscope system 100 of FIGS. 1a-1d may be applied to the method of FIG. 2 as well.

[0044] More details and aspects of the method are mentioned in relation to the proposed concept or one or more examples described above or below (e.g., FIGS. 1a-1d, 3a-4). The method may include one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.

[0045] Various embodiments of the present disclosure relate to workflows for automated case recording. Thus, embodiments may provide concepts for automated recording (e.g., of surgical procedures).

[0046] As previously mentioned, ophthalmology case volumes are often high. Improving operating room efficiency and turnover results in more patients being helped per day. This trend is particularly prevalent in cataract surgery. Setting preferences for automatic video recording allows intuitive starting and stopping of recordings without additional manual steps.

[0047] Various embodiments relate to automatic recording functionality that is linked to the orientation of the parallelogram section. In particular, integration of video recording functionality based on the position of the parallelogram section in "retracted" mode or "driving" (i.e., active) mode may be provided. Thus, video recording can be started and stopped automatically as an integrated part of the surgical workflow. The surgeon can release control of the video recording footswitch to use other functions.

[0048] 3a and 3b show schematic diagrams of a surgical microscope system in active and retracted positions. Figures 3a and 3b show a surgical microscope 140, a parallelogram section 136 of the arm, and a patient 300. When the parallelogram section is moved to the surgical position (Figure 3a), the parallelogram section, and therefore the surgical microscope, may be in an operational mode and may begin video recording. When the parallelogram section is moved to the retracted position after surgery (Figure 3b, e.g., away from the patient), video recording may be stopped. A timer countdown may be set to end the case.

[0049] More details and aspects of the concept are mentioned in relation to the proposed concept or one or more examples described above or below (e.g., Figures 1a-2, 4). The concept may include one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.

[0050] Some embodiments relate to a microscope including a system such as that described in connection with one or more of FIGS. 1 to 3b. Alternatively, the microscope may be part of a system such as that described in connection with one or more of FIGS. 1 to 3b. FIG. 4 shows a schematic diagram of a system 400 configured to perform the methods described herein. The system 400 includes a microscope 410 and a computer system 420. The microscope 410 is configured to capture images and is connected to the computer system 420. The computer system 420 is configured to perform at least a portion of the methods described herein. The computer system 420 may be configured to execute a machine learning algorithm. The computer system 420 and the microscope 410 may be separate entities or may be integrated into a common housing. The computer system 420 may be part of a central processing system of the microscope 410 and / or part of a subsidiary component of the microscope 410, such as a sensor, actor, camera, or lighting unit of the microscope 410.

[0051] The computer system 420 may be a local computing device (e.g., a personal computer, laptop, tablet computer, or mobile phone) with one or more processors and one or more storage devices, or may be a distributed computing system (e.g., a cloud computing system with one or more processors and one or more storage devices distributed across various locations, such as local clients and / or one or more remote server farms and / or data centers). The computer system 420 may include any circuit or combination of circuits. In one embodiment, the computer system 420 may include one or more processors, which may be of any type. As used herein, a processor may contemplate any type of computing circuit, such as, but not limited to, a microprocessor of a microscope or microscope component (e.g., a camera), a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other type of processor or processing circuit. Other types of circuits that may be included in computer system 420 may be custom circuits, application specific integrated circuits (ASICs), etc., such as one or more circuits (e.g., communications circuits) used in wireless devices such as cell phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. Computer system 420 may also include one or more storage devices, which may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives that handle removable media, such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.Computer system 420 may also include a display device, one or more speakers and a controller which may include a keyboard and / or a mouse, trackball, touch screen, voice recognition device, or any other device that allows a user of the system to input information to and receive information from computer system 420.

[0052] Some or all of the steps may be performed by (or using) a hardware apparatus, such as, for example, a processor, microprocessor, programmable computer, or electronic circuitry. In some embodiments, any one or more of the critical steps may be performed by such an apparatus.

[0053] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation may be performed by a non-transitory storage medium, such as a digital storage medium, for example, a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM, or a FLASH memory, on which electronically readable control signals are stored, which cooperate (or can cooperate) with a programmable computer system to implement the respective methods. Therefore, the digital storage medium may be computer-readable.

[0054] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system to perform any of the methods described herein.

[0055] Generally, embodiments of the present invention may be implemented as a computer program product comprising program code that is operative to perform any of the methods when the computer program product is run on a computer, and that may be stored, for example, on a machine-readable carrier.

[0056] Further embodiments comprise the computer program for performing any of the methods described herein, stored on a machine readable carrier.

[0057] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing any of the methods described herein when the computer program runs on a computer.

[0058] Therefore, another embodiment of the invention is a recording medium (or data carrier or computer readable medium) containing a computer program stored thereon for performing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the invention is an apparatus as described herein, comprising a processor and a recording medium.

[0059] A further embodiment of the present invention is, therefore, a data stream or a sequence of signals representing the computer program for performing any of the methods described herein, the data stream or sequence of signals being for example adapted to be transmitted via a data communication connection, for example the Internet.

[0060] Another embodiment comprises a processing means, for example a computer, or a programmable logic device configured to or adapted to perform any of the methods described herein.

[0061] Another embodiment comprises a computer having installed thereon the computer program for performing any of the methods described herein.

[0062] Another embodiment of the present invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.

[0063] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform any of the methods described herein. In general, the methods are advantageously performed by any hardware apparatus.

[0064] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0065] While some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step, and similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus. [Explanation of symbols]

[0066] 100 Surgical Microscope System 102 Base Unit 104 Foot brake 106 Handrail 108 Speaker 110 System 112 Interface 114 one or more processors 116 one or more storage devices 118a System Control Unit 118b Camera and video control units 120 Recording Devices 130 Arm 132 Positioning Sensor 134 Arm control circuit 136 Parallelogram Section 140 Surgical microscope 150 displays 152 Monitor Arm 160 steering wheel 210 Get input data 220 Detect the start or end of surgery 230 Provides control signals 300 patients 400 System 410 Microscope 420 Computer Systems

Claims

1. A system (110; 420) for controlling a recording device (120) of a surgical microscope system (100; 400), said system comprising one or more processors (114) and an interface (112), said system comprising: obtaining input data from one or more sensors (132; 134; 142) of the surgical microscope system via said interface; Detecting the start or end of a surgery involving the use of the surgical microscope system based on the input data; providing a control signal to the recording device of the surgical microscope system via the interface based on the detected start or end of the surgery; It is structured as follows: the input data includes information regarding a position of an arm (130) of the surgical microscope system, and the system is configured to detect the start or end of the surgery based on the information regarding the position of the arm; the arm comprises a parallelogram section, and the information about the position of the arm includes information about an orientation of the parallelogram section of the arm, and the system is configured to detect a start or an end of the surgery based on the information about the orientation of the parallelogram section of the arm. system.

2. a surgical microscope (140; 410) of the surgical microscope system is attached to the arm of the surgical microscope system, the information about the position of the arm includes information about the vertical position of the surgical microscope, and the system is configured to detect the start or end of the surgery based on the information about the vertical position of the surgical microscope. The system of claim 1 .

3. The system is configured to detect the start of the surgery after the vertical position of the surgical microscope is lowered below a threshold and to detect the end of the surgery after the vertical position of the surgical microscope is raised above a threshold. The system of claim 2.

4. the system is configured to detect the end of the surgery when the surgical microscope remains above the threshold for at least a predetermined time interval. The system of claim 3.

5. the input data includes image sensor data of an image sensor (142) of the surgical microscope, and the system is configured to detect the end of the surgery when the surgical microscope remains above the threshold and the image sensor data is out of focus for at least a predetermined time interval. The system of claim 3.

6. the one or more sensors of the surgical microscope system include a positioning sensor (132) for determining the position of the arm, the system being configured to obtain information regarding the position of the arm from the positioning sensor; A system according to any one of claims 1 to 5.

7. the arm is a robotic arm, and the system is configured to obtain information regarding the position of the arm from a control circuit (134) of the robotic arm. A system according to any one of claims 1 to 5.

8. the input data includes image sensor data of an image sensor (142) of a surgical microscope of the surgical microscope system, and the system is configured to detect the start or end of the surgery based on the image sensor data. A system according to any one of claims 1 to 7.

9. the system is configured to detect the presence of a patient in the imaging sensor data, and the system is configured to detect the start or end of the surgery based on the presence of the patient in the imaging sensor data. The system of claim 8.

10. the input data includes information about lighting used in the environment of the surgical microscope system, and the system is configured to detect the start or end of the surgery based on the information about lighting used in the environment of the surgical microscope system. A system according to any one of claims 1 to 9.

11. the system is configured to provide a control signal to initiate recording by the recording device when a start of surgery is detected, and to provide a control signal to stop recording by the recording device when an end of surgery is detected. A system according to any one of claims 1 to 10.

12. A surgical microscope system (100; 400) comprising: A system (110; 420) according to any one of claims 1 to 11, one or more sensors (132; 134; 142) for providing input data; a recording device (120); A surgical microscope system (100; 400) comprising:

13. 1. A method for operating a system (110; 420) for controlling a recording device of a surgical microscope system (100; 400), said method comprising the steps of: A processor of the system acquires (210) input data from one or more sensors of the surgical microscope system; detecting (220) by the processor the start or end of a surgery involving the use of the surgical microscope system based on the input data; The processor provides a control signal to the recording device of the surgical microscope system based on the detected start or end of the surgery (230); Including, the input data includes information regarding a position of an arm (130) of the surgical microscope system, and the system is configured to detect the start or end of the surgery based on the information regarding the position of the arm; the arm comprises a parallelogram section, and the information about the position of the arm includes information about an orientation of the parallelogram section of the arm, and the system is configured to detect a start or an end of the surgery based on the information about the orientation of the parallelogram section of the arm. How it works.

14. A computer program comprising a program code for performing the operating method according to claim 13 when the computer program is run on a processor.

Images