Surgical Microscopy System and Corresponding Apparatus, Method and Computer Program - Patent application
Sensors in surgical microscopes detect imbalances and control brakes to prevent sudden movements, maintaining stability during surgeries.
Patent Information
- Application Number
- JP2022528016
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-11-14
- Filing Date
- 2020-10-30
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2040-10-30
AI Technical Summary
Surgical microscope systems face challenges in maintaining balance when accessories are added or components are adjusted, leading to sudden movements due to imbalances, which can be dangerous during surgical operations.
Incorporation of sensors to detect imbalance and provide warnings or override brake release to prevent sudden movements, using torque, weight, accelerometer, and position sensors to monitor balance and control brakes.
Prevents sudden movements by timely detection and correction of imbalances, ensuring stable operation of surgical microscopes during surgeries.
Smart Images

Figure 0007611912000001 
Figure 0007611912000002 
Figure 0007611912000003
Abstract
Description
[Technical field]
[0001] Each example relates to a surgical microscope system and corresponding apparatus, methods and computer programs. [Background technology]
[0002] Surgical microscope systems are often designed to make the movement of the optical bench (i.e., the surgical microscope) as easy and smooth as possible, ideally giving the sensation of no gravity. To achieve this, the balance of the optical bench can be maintained through various means. However, balancing can become more difficult when accessories such as an external camera are added, or when components such as the eyepieces are physically realigned. To simplify the process or balancing, some microscopes provide an automatic balancing function. For example, EP 1326115, DE 102008011638 and DE 4320443 show such a function. Using this function, the user may not need to put effort or time into balancing the microscope.
[0003] Although it is possible to automatically balance the optical table, the auto-balancing feature often relies on the user to detect the imbalance and trigger the auto-balancing feature. If the imbalance is small, this may not be a problem as the surgical microscope system may remain sufficiently stable. However, if the imbalance is relatively large, the surgeon may be surprised by a sudden movement of the surgical microscope system if he or she releases the brake on the arm that holds the optical table, expecting the table to remain in the same position.
[0004] There may be a need for an improved surgical microscope system in which imbalances in the surgical microscope system are avoided or mitigated. Summary of the Invention [Means for solving the problem]
[0005] Each example may relate to an approach to avoid situations where the microscope moves suddenly due to imbalance. Each embodiment is based on the discovery that one or more sensors may be used to obtain information regarding the balance of the surgical microscope. If a risk of imbalance is detected, a warning may be provided to a user of the surgical microscope system to enable the user to take countermeasures or the brake control may be overridden to avoid situations where sudden movements would occur.
[0006] An embodiment of the present disclosure provides a surgical microscope system. The surgical microscope system includes one or more sensors for providing sensor information regarding a balance of the surgical microscope system. The surgical microscope system includes one or more brakes for holding at least one component of the surgical microscope system in place. The surgical microscope system includes a surgical microscope. The surgical microscope system includes a processing module, the processing module configured to process the sensor information. The processing module is configured to determine information regarding a balance of the surgical microscope system. In some embodiments, the processing module is configured to provide a warning to a user of the surgical microscope system based on the information regarding the balance of the surgical microscope system. The warning indicates a risk of imbalance in the surgical microscope system. Alternatively or additionally, the processing module can be configured to control the release of one or more brakes based on the information regarding the balance of the surgical microscope system. By determining the information regarding the balance based on the sensor information, an impending imbalance can be detected in a timely manner. Once a condition is detected, the user can be warned or the brake release can be overridden to avoid a situation in which the surgical microscope system experiences a sudden movement.
[0007] In some embodiments, the processing module is configured to determine information regarding the balance of the surgical microscopy system in response to the release of one or more brakes of the surgical microscopy system, thereby allowing the information regarding the balance to be determined in a timely manner at a time when there is an increased risk of imbalance.
[0008] Alternatively, the processing module can be configured to continually determine information regarding the balance of the surgical microscopy system, thereby allowing the balance of the surgical microscopy system to be continuously monitored.
[0009] In at least some embodiments, the surgical microscopy system includes an output module for providing an alert to a user of the surgical microscopy system, the alert can be provided via the output module, and the user can be alerted via the output module so that the user can take action to correct the imbalance.
[0010] For example, the output module can include an illuminator or display. The alert can be provided as a visual alert. For example, the illuminator or display can be located within the field of view of the user / surgeon and therefore perceivable even when the user / surgeon is concentrating on his / her work.
[0011] Additionally or alternatively, the output module may include an audio output module. The alert may be provided as an audio alert. Thus, the alert may be provided without the surgeon / user having to take their eyes off the procedure.
[0012] Additionally or alternatively, the output module may include a haptic feedback actuator. The alert may be provided as haptic feedback. For example, haptic feedback may be provided when the user / surgeon grasps the handle of a surgical microscope.
[0013] In some embodiments, the processing module can be configured to dim or disable the lights or video display of the surgical microscopy system as a warning to a user of the surgical microscopy system, in which case an existing output module can be repurposed to provide the warning.
[0014] In various embodiments, the processing module is configured to at least partially and / or temporarily block the release of one or more brakes based on information regarding the balance of the surgical microscope system, thereby limiting movements performed by the surgical microscope to avoid loss of balance of the surgical microscope system.
[0015] In some embodiments, the surgical microscope system can include an automatic balancing system for balancing the surgical microscope system. The warning can prompt the user to initiate the automatic balancing system. Activating the automatic balancing system can correct any imbalance.
[0016] The one or more sensors may include one or more elements of the following group: one or more torque sensors, one or more weight sensors, one or more accelerometers, one or more position sensors, one or more angle sensors, one or more rotational sensors. Various types of sensors or combinations of sensors may be used to provide information regarding balance.
[0017] In some embodiments, the surgical microscope system may include an arm. One or more brakes may be adapted to hold the arm in place. The surgical microscope may be attached to the arm. Determining information regarding balance of the surgical microscope system may include determining a speed of movement of the arm. For example, the imbalance may warrant an alert if the speed of movement is greater than a threshold.
[0018] An embodiment of the present disclosure further provides a (corresponding) apparatus for a surgical microscope system. The surgical microscope system includes one or more brakes for holding at least one component of the surgical microscope system in place. The surgical microscope system includes a surgical microscope. The apparatus includes an interface for communicating with one or more components of the surgical microscope system. The apparatus includes a processing module, the processing module configured to obtain sensor information related to a balance of the surgical microscope system from one or more sensors of the surgical microscope system. The processing module is configured to process the sensor information. The processing module is configured to determine information related to a balance of the surgical microscope system. In some embodiments, the processing module is configured to provide a warning to a user of the surgical microscope system based on the information related to the balance of the surgical microscope system. The warning indicates a risk of imbalance in the surgical microscope system. Alternatively or additionally, the processing module can be configured to control release of the one or more brakes based on the information related to the balance of the surgical microscope system.
[0019] An embodiment of the present disclosure further provides a (corresponding) method for a surgical microscope system. The surgical microscope system includes one or more brakes for holding at least one component of the surgical microscope system in position. The surgical microscope system includes a surgical microscope. The method includes obtaining sensor information related to a balance of the surgical microscope system from one or more sensors of the surgical microscope system. The method includes processing the sensor information. The method further includes determining information related to a balance of the surgical microscope system. In some embodiments, the method includes providing a warning to a user of the surgical microscope system based on the information related to the balance of the surgical microscope system. The warning indicates a risk of imbalance in the surgical microscope system. Alternatively or additionally, the method may include controlling a release of the one or more brakes based on the information related to the balance of the surgical microscope system.
[0020] An embodiment of the present disclosure further provides a (corresponding) computer program having a program code for performing the above method, when the computer program is executed on a processor.
[0021] Some examples of apparatus and / or methods are now described, by way of example only, and with reference to the accompanying drawings, in which: [Brief description of the drawings]
[0022] [Figure 1] FIG. 1 is a schematic block diagram of a surgical microscope system and an apparatus for the surgical microscope system. [Diagram 2] 1 is a flow chart of one embodiment of a method for a surgical microscope system. [Diagram 3] FIG. 2 is a further block diagram of an embodiment of a surgical microscope system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Various examples will now be described more fully with reference to the accompanying drawings, in which several examples are shown and in which the thickness of lines, layers and / or regions may be exaggerated for clarity.
[0024] Thus, the further examples may realize various modifications and alternative forms, some specific examples of which are shown in the drawings and will be described in detail subsequently. However, this detailed description does not limit the further examples to the specific forms described. The further examples may cover all modifications, equivalents and alternative forms that fall within the scope of the present disclosure. The same or similar reference symbols refer to similar or similar elements throughout the description of the drawings, and the elements may be realized in the same or modified form while providing the same or similar function when compared with each other.
[0025] When an element is described as being "connected" or "coupled" to another element, it is understood that these elements may be directly connected or coupled, or may be connected or coupled via one or more intervening elements. When two elements A and B are combined using "or", this should be understood to disclose all possible combinations, i.e., A only, B only, and A and B, unless otherwise defined, either explicitly or implicitly. Alternative expressions for the same combination are "at least one of A and B" or "A and / or B". The same applies, mutatis mutandis, to combinations of more than two elements.
[0026] Terms used herein for the purpose of describing particular examples are not intended to limit further examples. Whenever singular forms such as "a", "an" and "the" are used and are not explicitly or implicitly defined as requiring the use of only a single element, further examples may use multiple elements to achieve the same functionality. Similarly, when a function is later described as being implemented using multiple elements, further examples may use a single element or processing entity to achieve the same functionality. Furthermore, the terms "comprises", "comprising", "includes" and / or "including", when used, specify the presence of stated features, integers, steps, operations, processes, acts, elements and / or components, but are understood not to preclude the presence or addition of one or more other features, integers, steps, operations, processes, acts, elements, components and / or any group thereof.
[0027] Unless otherwise defined, all terms (including technical and scientific terms) are used herein in the ordinary sense of the art to which each example belongs.
[0028] 1 shows a schematic block diagram of a surgical microscope system 100. The surgical microscope system 100 includes one or more sensors 120 for providing sensor information regarding the balance of the surgical microscope system 100. The surgical microscope system 100 includes one or more brakes 165 for holding at least one component of the surgical microscope system in place. The surgical microscope system 100 includes a surgical microscope 170.
[0029] Optionally, the surgical microscope system may include an arm 160. The arm 160 may include two or more components, which are separated via one or more hinges that allow for flexible positioning of the arm 160. The surgical microscope 170 may be attached to the arm 160. For example, at least one of the one or more brakes may be a brake for the arm 160, e.g., may be part of a hinge of the arm. Thus, the one or more brakes may be suitable for holding the arm 160 of the surgical microscope system in a predetermined position. Optionally, the surgical microscope system may further include an output module 130. The surgical microscope system may further include a lighting 140 and / or a video display 150.
[0030] The surgical microscope system 100 includes a processing module 114, which is coupled, for example, via an interface 112, to one or more sensors and, optionally, at least one of one or more brakes, an output module, lighting, and a video display. FIG. 1 further illustrates an apparatus 110 including the processing module 114 and an interface 112 coupled to the processing module 114. For example, the apparatus may be suitable for controlling a surgical microscope system, for example, the apparatus 110 may be a control device of the surgical microscope system. The processing module 114 is configured to process the sensor information. The processing module is configured to determine information regarding the balance of the surgical microscope system 100. In some embodiments, the processing module is configured to provide a warning to a user of the surgical microscope system 100 based on the information regarding the balance of the surgical microscope system 100. The warning indicates a risk of imbalance in the surgical microscope system 100. Alternatively or additionally, the processing module can be configured to control the release of one or more brakes based on the information regarding the balance of the surgical microscope system 100.
[0031] The embodiments of the present disclosure relate to a surgical microscope system or to an apparatus, method, or computer program for a surgical microscope system. Generally, a microscope is an optical instrument suitable for inspecting objects that are too small to be inspected by the human eye (only). For example, a microscope can provide optical magnification of an object, such as an organic tissue sample. A surgical microscope is a microscope used during surgery, i.e., a microscope suitable for use (by a surgeon) during a surgical procedure. Such surgical microscope systems often include an arm or positioning means that is used to position the surgical microscope as desired by the surgeon, e.g., to position it in the vicinity of the surgical space, so that the surgical microscope can be used to provide a magnified view of the wound or tissue. Such an arm or positioning means is usually adapted to provide a wide variety of positions and / or angles to provide the surgeon with sufficient space to perform the operation while providing a magnified image of the surgical site. Furthermore, the arms or positioning means of the surgical microscope system are often designed to allow easy positioning of the surgical microscope, for example, using weights and counterweights, using pneumatic systems, or using motors to assist the movement of the arms or positioning means of the surgical microscope system. Often, because the movement is assisted by such assistance systems, the surgeon may not be able to "feel" if the surgical microscope system is out of balance, for example, if the surgical microscope has shifted to a position where the leverage is too great to be compensated for by the surgical microscope system. An embodiment of the present disclosure can detect such a situation and provide advance warning or mitigate the impending imbalance. This is particularly valuable when one or more additional devices, such as a monitor or additional cameras, are attached to the surgical microscope 170.
[0032] The surgical microscope system 100 includes one or more sensors 120 for providing sensor information regarding the balance of the surgical microscope system 100. The one or more sensors can be used to detect indicators of impending imbalance. For example, the one or more sensors 120 include one or more elements of a group of one or more torque sensors, one or more weight sensors, one or more accelerometers, one or more position sensors, one or more angle sensors, and one or more rotation sensors (e.g., implemented by gyroscopes). The one or more angle sensors and / or the one or more rotation sensors can be included in one or more components of the arm 160. For example, one or more torque sensors can be used to provide information regarding torques experienced at one or more hinges of the arm 160. Thus, the sensor information regarding the balance of the surgical microscope system 100 can include sensor information regarding torques experienced at one or more hinges of the arm 160. For example, one or more position sensors can be used to provide information regarding the current position of the surgical microscope 170 and / or information regarding the current position or orientation of one or more components of the arm 160. For similar purposes, one or more angle sensors and / or one or more rotational sensors may be used to provide information regarding the current position of the surgical microscope 170 and / or information regarding the current position or orientation of one or more components of the arm 160. Thus, sensor information regarding the balance of the surgical microscope may include information regarding the current position of the surgical microscope 170 and / or information regarding the current position or orientation of one or more components of the arm 160. For example, one or more accelerometers may be used to provide information regarding the movement of one or more components of the arm and / or information regarding vibrations of the arm (caused by imbalance of the surgical microscope system).Thus, the sensor information regarding the balance of the surgical microscope may include information regarding the movement of one or more components of the arm and / or information regarding the vibration of the arm. For example, one or more weight sensors may be used to determine information regarding the weight of the surgical microscope (including devices attached to the surgical microscope). Thus, the sensor information regarding the balance of the surgical microscope may include information regarding the weight of the surgical microscope. As described above, multiple sensors, or multiple types of sensors, may be used. Thus, the sensor information regarding the balance of the surgical microscope system 100 may include sensor information from one or more different types of sensors.
[0033] The processing module 114 is configured to process the sensor information to determine information regarding the balance of the surgical microscope system 100. For example, the processing module 114 can be configured to scan the sensor information for indicators of impending imbalance. For example, the processing module 114 can be configured to detect a torque that exceeds a torque threshold. If the torque threshold is exceeded, the surgical microscope system may be at risk of imbalance. For example, the processing module can be configured to detect a positioning of one or more components of the surgical microscope or arm that is at risk of increased imbalance. If the weight of the surgical microscope exceeds a weight threshold, the positioning of the arm may be at risk of increased imbalance. If such a positioning is detected, the surgical microscope system may be at risk of imbalance. For example, the processing module can be configured to detect a vibration of the arm that exceeds a vibration threshold. This can indicate, for example, that the surgical microscope system is at risk of imbalance in addition to a positioning of one or more components of the surgical microscope or arm that is at risk of increased imbalance. For example, the processing module can be configured to detect arm movement (e.g., speed of movement) exceeding a speed threshold. In other words, determining information regarding the balance of the surgical microscopy system 100 can include determining the speed of movement of the arm 160. In this case, an actual imbalance can be detected. Again, multiple indicators can be combined to determine whether the surgical microscopy system is at risk of (or has already reached) an imbalance state.
[0034] In general, the information regarding the balance of the surgical microscope system may indicate whether (or that) the surgical microscope system 100 is at risk of losing its balance. In this case, the risk of losing balance may be conditional - for example, the information regarding the balance of the surgical microscope system may indicate that the surgical microscope system 100 is at risk of losing its balance if one or more brakes are released, if the position of the surgical microscope changes beyond a threshold, if additional weight is added to the surgical microscope, etc. In some embodiments, the information regarding the balance may include a binary indication of impending imbalance - for example, the information regarding the balance may provide a value of "true" if the surgical microscope system is at risk of imbalance and a value of "false" if the surgical microscope system is not at risk of imbalance. Alternatively, three-level information can be provided - in this case a first severity level indicating that the surgical microscope system is balanced, a second severity level indicating that the surgical microscope system is slightly unbalanced, and a third severity level indicating that the surgical microscope system is very unbalanced. Additionally, the information regarding the balance of the surgical microscope system can include information regarding the cause of the imbalance or appropriate corrective measures to avoid or correct the imbalance.
[0035] There are various options that can be selected regarding when to determine the information regarding the balance. In some cases, the information regarding the balance can be determined when the risk of imbalance is greatest, for example, when one or more brakes are released. In other words, the processing module 114 can be configured to determine the information regarding the balance of the surgical microscope system 100 in response to the release of one or more brakes of the surgical microscope system 100, for example, in response to receiving a command related to the release of the brakes. For example, the release of the brakes can be delayed until the information regarding the balance of the surgical microscope system has been determined. For example, the brakes can be released only if the risk of imbalance is less than a threshold value. Alternatively, the brakes can be released after providing a warning, or a safeguard can be provided to restart the brakes if the surgical microscope is suddenly moved.
[0036] Alternatively, information regarding the balance of the surgical microscope system may be constantly (e.g., periodically) updated, for example to detect changes in balance due to an external weight or load applied to the surgical microscope system, or to detect rolling movements of the surgical microscope system. In other words, the processing module 114 can be configured to continually determine information regarding the balance of the surgical microscope system 100.
[0037] In some embodiments, a warning can be provided to a user (e.g., surgeon) of the surgical microscope system based on information regarding the balance of the surgical microscope system 100. For example, a warning can be provided to a user if the surgical microscope system is out of balance, in danger of imbalance, and / or to warn the user of actions that may / may result in imbalance. Thus, the warning indicates a risk of imbalance in the surgical microscope system 100. In some embodiments, the warning can simply indicate that there is a general risk of imbalance, for example, without providing details regarding the cause of the imbalance. In this case, the user can simply exercise more caution when releasing the brake of the surgical microscope system. Alternatively, the warning can indicate one or more causes of the (imminent) imbalance, or one or more courses of action to be taken to avoid or correct the imbalance. Additionally or alternatively, two or more severity levels can be distinguished in the warning, for example, a first severity level warning for a mild imbalance and a second severity level warning for a risk resulting from a severe imbalance. The warnings may indicate levels of severity (e.g., by different colors (yellow and red), different descriptions or symbols, or different pictograms). In some embodiments, a third level of severity may be indicated to indicate a balanced state of the surgical microscope system, for example, in the form of a green light or positive pictogram.
[0038] In general, the alert can be provided via one or more different means, such as visual, audio, or tactile means. Thus, the alert can use one or more components of the surgical microscope system. For example, the surgical microscope system can include an output module 130 for providing an alert to a user of the surgical microscope system 100. The alert can be provided via the output module 130.
[0039] For example, the warning may be provided as or may include a visual warning. Thus, the output module may include an emitter (e.g., a light emitting diode) or a display (e.g., a video display or a status display). Alternatively, an existing visual output module may be repurposed to provide a visual warning. For example, the processing module 114 may be configured to dim, modulate (e.g., pulse), or deactivate the illumination 140 (e.g., patient spot illumination or background illumination) or the video display 150 of the surgical microscope system 100 as a warning to a user of the surgical microscope system 100. For example, the video display may be a display of a (digital) viewfinder of the surgical microscope system, or may be an overview display of the surgical microscope system.
[0040] Alternatively or additionally, the warning may be or include an audible or acoustic warning, i.e., may be provided as an audible warning. Thus, the output module 130 may include an audio output module. For example, the warning may be provided as an alarm sound or as spoken text providing a warning or instructional message. The intensity, frequency and repetition rate of the audible warning may indicate the severity of the imbalance.
[0041] Both visual and / or audible warnings can be used, for example, to provide an instruction to a user of the surgical microscope system to pay attention to the operation of the surgical microscope system or specific instructions on how to move the surgical microscope to reach a balanced state. Additionally or alternatively, the warning can be related to an automatic balancing function. For example, the surgical microscope system 100 can include an automatic balancing system for balancing the surgical microscope system 100. The warning can request the user to start the automatic balancing system. Depending on parameters such as the severity of the imbalance and user preferences, different options are possible. According to some embodiments, the warning can suggest to the user to start the automatic balancing process. For example, the request can be provided as a visual warning or as an audible / acoustic warning. Alternatively, the user can be forced to start the automatic balancing process, for example by not allowing the release of the brakes or by switching off other microscope functions such as lighting or video. In some embodiments, auto-balancing may be performed automatically, for example, as soon as the processing module assumes that the user has completed adjusting the arms.
[0042] Alternatively or additionally, the warning can be provided as haptic feedback. For example, the output module 130 can include a haptic feedback actuator, for example a vibration module. The haptic feedback actuator can be integrated, for example, into the handle of the surgical microscope. Thus, the warning can be provided as haptic feedback, for example as vibration feedback.
[0043] Alternatively or additionally, one or more brakes can be controlled (by the processing module) to avoid or limit sudden movements of the surgical microscope. The surgical microscope system 100 includes one or more brakes 165 suitable or configured to hold at least one component of the surgical microscope system in place. For example, the one or more brakes can be suitable or configured to hold the entire surgical microscope system in place. For example, the one or more brakes can be or include one or more brakes for braking one or more wheels of the surgical microscope system, for example, one or more wheels for moving the surgical microscope system (as a whole) on the floor. In some embodiments, only one component of the surgical microscope system can be held in place, for example, via the arm 160 or positioning means of the surgical microscope system. For example, the one or more brakes 165 can be suitable for holding the arm 160 in place. For example, the one or more brakes 165 can be or include one or more brakes suitable or configured to hold the arm 160 of the surgical microscope system 100 in place. These brakes can be released when the surgical microscope 170 is to be moved. Once the brake or brakes are released, the position or orientation of the arm 160 can be adjusted, allowing the position of the surgical microscope 170 attached to the arm 160 to be changed. In at least some embodiments, the brakes can be released using one or more buttons located on one or more handles of the surgical microscope. Once the buttons are released, the brakes can be (re)activated.
[0044] The processing module can be configured to control the release of one or more brakes based on information regarding the balance of the surgical microscope system 100. For example, the processing module can be configured to override the control of one or more brakes based on information regarding the balance of the surgical microscope system. If the information regarding the balance of the surgical microscope system indicates a risk of imbalance, the processing module can be configured to limit the operation of the brakes, for example, to reapply the brakes if the surgical microscope moves downwards more than a predetermined distance, or to limit the positioning of the surgical microscope away from the patient. For example, the brake override can be complete, i.e., the brake release button can be deactivated, so that the user is notified of the situation but can prevent a potentially dangerous situation, or it can be partial, i.e., the brakes can be only partially released so that fast or large movements are prevented, or it can be temporary, for example, the brakes can be released but reapplied after some time or movement, for example after 0.1 seconds or 1 cm of movement. In other words, for example, if information regarding the balance of the surgical microscope system indicates a risk of imbalance, the processing module 114 can be configured to at least partially (e.g., not fully release one or more brakes, allowing the relatively large force required to move the surgical microscope) and / or temporarily (e.g., until a warning is provided, or for short or short distance increments) block the release of one or more brakes based on the information regarding the balance of the surgical microscope system 100. For example, the release of one or more brakes can be initiated or triggered by a user. Thus, the processing module can be configured to control, limit, block and / or override user-initiated release of one or more brakes.If the user determines that the imbalance is not overly severe and decides to continue, for example by continuing to press a brake release button, the system may cycle the brakes on and off just once or a few times before finally allowing the user to release the brakes.
[0045] The interface 112 may represent one or more inputs and / or outputs for receiving and / or transmitting information, which may be digital (bit) values according to a specified code, within a module, between modules, or between modules of different entities. For example, the interface 112 may include an interface circuit configured to receive and / or transmit information. In the embodiments, the processing module 114 may be implemented using one or more processing units, using one or more processing devices, using any processing means, such as a processor, computer, or programmable hardware components operable by appropriately adapted software. In other words, the above-mentioned functions of the processing module 114 may also be implemented in the form of software, in which case the software is executed on one or more programmable hardware components. Such hardware components may include general-purpose processors, digital signal processors (DSPs), microcontrollers, etc.
[0046] Further details and aspects of the surgical microscope system or apparatus for a surgical microscope system are mentioned in connection with the proposed concept or one or more examples described above or below (e.g., FIG. 2 or FIG. 3). The surgical microscope system or apparatus for a surgical microscope system may include one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.
[0047] 2 shows a flow chart of an embodiment of a (corresponding) method for a surgical microscope system. For example, the surgical microscope system can be implemented similarly to the surgical microscope system of FIG. 1. The method includes obtaining 210 sensor information related to the balance of the surgical microscope system 100 from one or more sensors 120 of the surgical microscope system 100. The method includes processing 220 the sensor information. The method includes determining 230 information related to the balance of the surgical microscope system 100. In some embodiments, the method includes providing 240 a warning to a user of the surgical microscope system 100 based on the information related to the balance of the surgical microscope system 100. The warning indicates a risk of imbalance in the surgical microscope system 100. Additionally or alternatively, the method can include controlling 250 the release of one or more brakes based on the information related to the balance of the surgical microscope system 100.
[0048] As mentioned above, the features described in connection with the surgical microscopy system 100 of FIG. 1 are equally applicable to the method of FIG.
[0049] Further details and aspects of the method are mentioned in relation to the proposed concept or one or more examples described above or below (e.g., FIG. 1 or FIG. 3). The method may include one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.
[0050] At least some embodiments relate to microscope balance safety. Each embodiment may provide a technical approach to avoid situations where the microscope moves suddenly due to imbalance. At least some embodiments may enable the microscope to evaluate the balance status and automatically take action to avoid dangerous situations.
[0051] 3 shows a further block diagram of one embodiment of a surgical microscope system 300. The surgical microscope system includes a base unit 310, a controller 110, an arm 160 having three brakes 165 built into the hinge of the arm 160, a surgical microscope 170, and two displays 150, one of which is located near the eyepiece and the other display is a relatively large display. Two handles 320 are attached to the surgical microscope 170, each of which includes a brake release button 325. The surgical microscope system 300 further includes sensors 130a-b.
[0052] Assessment of the balance state (e.g., determining information regarding the balance of the surgical microscope system) can be performed in a variety of ways. For example, the balance state can be assessed by sensors such as torque sensor 130d and weight sensor 130c, or a combination thereof. These sensors can provide a continuous measurement of the balance state while the microscope is not in use.
[0053] Alternatively or additionally, the balance state can be assessed by very quickly measuring the movement when the arm brake is released. This can be done by sensors such as accelerometer 130b or position / rotation sensors (such as gyroscope 130a). Technically, the degree of unbalance is not detected, but rather how fast the microscope moves. If this assessment is performed quickly enough, the risk can be assessed more directly. The measurement can be performed within the millisecond range, allowing the brake to be quickly reactivated if the microscope moves too fast.
[0054] Balance state information (i.e., information regarding the balance of the surgical microscope system) can be used to trigger different actions, such as:
[0055] For example, warnings can be provided in any combination of the following: A visual indication / warning can be shown, for example with a red light / sign if the microscope is unbalanced, a green light / sign if the microscope is balanced, or via the displays 150. Reference number 330 shows a pictogram displayed by one of the displays, indicating that the balance status is OK and the surgical microscope system is balanced. Reference number 340 shows a warning pictogram, indicating a minor imbalance. Reference number 350 shows a danger pictogram, indicating a severe imbalance. An audible warning can be provided. The intensity, frequency and repetition rate of the audible warning can indicate the severity of the imbalance. For example, haptic feedback (vibration) can be provided to alert the user when the user touches the handle 320 or the brake release button 325. Other microscope functions may be adjusted, for example the lighting may be reduced or switched off, or the video display may be dimmed or switched off.
[0056] Additionally or alternatively, the user's command to release the brakes can be overridden. This override can be complete, i.e., the brake release button can be deactivated so that the user is notified of the situation but can prevent a potentially dangerous situation, or it can be partial, i.e., the brakes can be only partially released so that fast or large movements are prevented, or it can be temporary, e.g., the brakes can be released but reapplied after some time or movement, e.g., after 0.1 seconds or 1 cm of movement. If the user determines that the imbalance is not severe enough and wishes to continue and continues to press the brake release button, the system can cycle between activation and deactivation only a few times before finally allowing the user to release the brakes.
[0057] In some embodiments, the surgical microscope system can function towards an automatic balancing function. Depending on parameters such as the severity of the imbalance and user preferences, different options are possible: Auto-balancing can be performed automatically: for example, if the balance is off and the user is not gripping the handle, after a predefined time, say 10 seconds, the microscope can assume that the user has completed the current change, indicating that an opportunity exists to rebalance. Suggesting to the user to start an automatic balancing process, for example as part of a warning. Forcing the user to start the automatic balancing process by not allowing the brakes to be released or by switching off other microscope functions such as lighting or video.
[0058] As used in this specification, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".
[0059] Although some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step. Similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus. Some or all of the steps may be performed by (or using) a hardware apparatus, such as, for example, a processor, microprocessor, programmable computer, or electronic circuitry. In some embodiments, any one or more of the crucial steps may be performed by such an apparatus.
[0060] Depending on certain implementation requirements, the embodiments of the present invention can be implemented in hardware or software. The implementation can be performed by a non-transitory recording medium, such as a digital recording medium, for example a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM and EPROM, an EEPROM or a FLASH memory, on which electronically readable control signals are stored, which cooperate (or can cooperate) with a programmable computer system to implement the respective methods. Thus, the digital recording medium can be computer readable.
[0061] Some embodiments of the present invention include a data carrier having electronically readable control signals capable of cooperating with a programmable computer system to perform any of the methods described herein.
[0062] Generally, embodiments of the present invention can be implemented as a computer program product comprising program code which is operable to perform any of the methods when the computer program product is run on a computer, the program code may for example be stored on a machine readable carrier.
[0063] Another embodiment comprises the computer program for performing any of the methods described herein, stored on a machine readable carrier.
[0064] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing any of the methods described herein, when the computer program runs on a computer.
[0065] Therefore, another embodiment of the present invention is a recording medium (or data carrier or computer readable medium) containing a computer program stored thereon for performing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the present invention is an apparatus as described herein, including a processor and a recording medium.
[0066] A further embodiment of the invention is therefore also a data stream or a sequence of signals representing the computer program for performing any of the methods described herein, the data stream or the sequence of signals being for example adapted to be transmitted via a data communication connection, for example the Internet.
[0067] Another embodiment comprises a processing means, for example a computer, or a programmable logic device configured to or adapted to perform any of the methods described herein.
[0068] Another embodiment comprises a computer having the computer program installed thereon for performing any of the methods described herein.
[0069] Another embodiment of the invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may, for example, include a file server to transfer the computer program to the receiver.
[0070] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform any of the methods described herein. In general, the methods are advantageously performed by any hardware apparatus. [Explanation of symbols]
[0071] 100 Surgical Microscope System 110 Apparatus for a surgical microscope system 112 Interface 114 Processing Module 120 One or more sensors 130 Output Module 130a Gyroscope 130b accelerometer 130c Weight Sensor 140c Torque Sensor 140 Lighting 150 Display 160 Arm 165 Brake 170 Surgical Microscope 210 Acquiring sensor information 220 Processing sensor information 230 Determining balance information for a surgical microscope system 240 Providing a warning 250 Controlling the release of one or more brakes 300 Surgical Microscope System 310 Base Unit 320 Handle 325 Brake release button 330 Display-OK-Balance 340 Display - Warning - Minor imbalance 350 Display - Danger - Severe imbalance
Claims
1. A surgical microscope system (100), comprising: one or more sensors (120) for providing sensor information related to the balance of the surgical microscopy system (100); one or more brakes (165) for holding at least one component of the surgical microscopy system (100) in position; A surgical microscope (170); A processing module (114); and the processing module (114) comprises: Processing the sensor information; determining information relating to the balance of the surgical microscopy system (100); controlling the release of the one or more brakes based on the information regarding the balance of the surgical microscopy system (100) by overriding the control of the one or more brakes based on the information regarding the balance of the surgical microscopy system (100) or by limiting the operation of the one or more brakes if the information regarding the balance of the surgical microscopy system (100) indicates a risk of imbalance. It is configured as follows: A surgical microscope system (100).
2. the processing module (114) is configured to determine the information regarding balance of the surgical microscopy system (100) in response to release of the one or more brakes of the surgical microscopy system (100). The surgical microscope system (100) of claim 1.
3. the processing module (114) is configured to continually determine the information regarding the balance of the surgical microscopy system (100); The surgical microscope system (100) of claim 1. and providing a warning to a user of the surgical microscope system (100) indicating a risk of imbalance in the surgical microscope system (100) based on the information regarding balance of the surgical microscope system (100); and the surgical microscopy system (100) includes an output module (130) for providing the alert to a user of the surgical microscopy system (100); The alert is provided via the output module (130). A surgical microscope system (100) according to any one of claims 1 to 3.
5. the output module (130) includes a light or display, and the alert is provided as a visual alert; and / or the output module (130) includes an audio output module, and the alert is provided as an audio alert. The surgical microscope system (100) of claim 4.
6. The output module (130) includes a haptic feedback actuator, and the alert is provided as haptic feedback. A surgical microscope system (100) according to claim 4 or 5.
7. and wherein the processing module (114) is configured to dim or deactivate a light (140) or a video display (150) of the surgical microscopy system (100) based on the information regarding the balance of the surgical microscopy system (100) as a warning to a user of the surgical microscopy system (100), the warning indicating a risk of imbalance in the surgical microscopy system (100). A surgical microscope system (100) according to any one of claims 1 to 3.
8. the processing module (114) is configured to at least partially and / or temporarily block release of the one or more brakes based on the information regarding balance of the surgical microscopy system (100). A surgical microscope system (100) according to any one of the preceding claims.
9. the surgical microscope system (100) includes an automatic balancing system for balancing the surgical microscope system (100); the warning prompting a user to initiate the automatic balancing system. A surgical microscope system (100) according to any one of claims 4 to 7.
10. the one or more sensors (120) include one or more elements of the following group: one or more torque sensors, one or more weight sensors, one or more accelerometers, one or more position sensors, one or more angle sensors, one or more rotation sensors; A surgical microscope system (100) according to any one of the preceding claims.
11. The surgical microscope system (100) includes an arm (160), said brake or brakes (165) are suitable for holding said arm (160) in a predetermined position; The surgical microscope (170) is attached to the arm. A surgical microscope system (100) according to any one of the preceding claims.
12. Determining the information regarding the balance of the surgical microscopy system (100) includes determining a speed of movement of the arm (160). The surgical microscope system (100) of claim 11.
13. An apparatus (110) for a surgical microscopy system (100), comprising: The surgical microscope system (100) comprises: one or more brakes (165) for holding at least one component of the surgical microscopy system (100) in position; A surgical microscope (170); Including, The device (110) comprises: an interface (112) for communicating with one or more components of the surgical microscopy system (100); A processing module (114); Including, The processing module (114) obtaining sensor information from one or more sensors (120) of the surgical microscopy system (100) relating to the balance of the surgical microscopy system (100); Processing the sensor information; determining information regarding the balance of the surgical microscopy system (100); controlling the release of the one or more brakes based on the information regarding the balance of the surgical microscopy system (100) by overriding the control of the one or more brakes based on the information regarding the balance of the surgical microscopy system (100) or by limiting the operation of the one or more brakes if the information regarding the balance of the surgical microscopy system (100) indicates a risk of imbalance. It is configured as follows: Apparatus (110).
14. A method for a surgical microscope system (100), comprising: The surgical microscope system (100) comprises: one or more brakes (165) for holding at least one component of the surgical microscopy system (100) in position; A surgical microscope (170); Including, The method comprises: acquiring (210) sensor information related to the balance of the surgical microscopy system (100) from one or more sensors (120) of the surgical microscopy system (100); processing (220) the sensor information; determining (230) information relating to the balance of the surgical microscopy system (100); controlling (250) the release of said one or more brakes based on the information regarding the balance of the surgical microscopy system (100) by overriding the control of said one or more brakes based on the information regarding the balance of the surgical microscopy system (100) or by limiting the operation of said one or more brakes if the information regarding the balance of the surgical microscopy system (100) indicates a risk of imbalance; The method includes:
15. 15. A computer program having a program code for performing the method according to claim 14, when the computer program runs on a processor.
Citation Information
Patent Citations
Balance adjustable stand and x-y sliding device
JP1995016239A
Microscopic device for operation
JP2001046399A
Stand
JP2002228938A
Immersive 3D Display for Robotic Surgery
JP2019531117A