Computer-implemented imaging technique and optical observation device
The computer-implemented imaging method addresses the challenges of capturing circular images with rectangular sensors by generating an image sequence through controlled sensor or lens movements, enhancing spatial perception and reducing manual effort.
Patent Information
- Application Number
- DE102023114945
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-06-07
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2043-06-07
AI Technical Summary
Existing imaging systems face challenges in capturing circular images with rectangular sensors, leading to partial image coverage and information loss, and manual or remote-controlled adjustments result in undesirable perspective changes and vibrations, straining users and reducing efficiency.
A computer-implemented imaging method that captures an original image and subsequent images with partial overlap, using actuators to move the image sensor or lens relative to the image circle, generating an image sequence under computer control to enhance spatial perception and reduce manual effort.
Improves the user's cognitive reconstruction of spatial structures by minimizing manual adjustments, reducing vibrations, and providing a more precise, efficient observation experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a computer-implemented imaging method, an optical observation device and a computer program.
[0002] Digital image sensors typically have a rectangular shape with a given aspect ratio of, for example, 16:9. However, optical observation devices typically produce circular images of the object world within an image circle. If these images are to be captured or recorded using digital image sensors, a discrepancy exists between the shape of the image sensor and the shape of the image. The image sensor can therefore: a) completely contain the image circle ( Fig. 1a), b) contain as large a part of the image circle as possible ( Fig. 1b) or c) lie within the image circle ( Fig. 1c, Fig. 1d).
[0003] However, this has the following disadvantages: in case a) the image sensor can only be used partially and the image therefore does not achieve the resolution possible due to the sensor area, in cases b) and c) only a more or less large part of the image circle is covered, so that only a section of the image circle is recorded and information is lost.
[0004] The invention described below is based on the following findings of the inventors: The human perception of spatial depth is naturally a highly developed cognitive ability. However, utilizing this ability to the fullest extent requires dynamic processes of image transmission through the eyes. In this process, the spatial situation is continuously and unconsciously cognitively reconstructed through the constant generation of different images from slightly different perspectives. Conversely, the necessary dynamics of different images or perspectives for the cognitive reconstruction and representation of a spatial structure also means that humans will often interpret a perspective and fixed representation, e.g., a 3D graphic or a 3D diagram on a sheet of paper or a screen, with errors.
[0005] The dynamic cognitive reconstruction of a spatial structure can therefore be described as a kind of exploration based on several different images. Changes in perspective are of great importance here. Other image differences can also contribute to this exploration, such as different image sections with the same perspective or differences in lighting and shadows.
[0006] Where these possibilities for obtaining different images through eye movements are lacking, e.g., with a digital microscope and its fixed camera position, the viewer or user is dependent on accomplishing the exploration through multiple, often only slight changes in perspective, e.g., by changing the microscope position.
[0007] This need may persist even after spatial representation has been achieved, because the details viewed may change their position and / or nature, e.g., during a microsurgical procedure due to manipulation with instruments, pulsating tissue, or fluids and secretions.
[0008] Typically, in the case of technical imaging, the perspective can be changed by changing the position of the optical observation device, e.g., manually or by means of an optionally remote-controlled, for example, electromechanical or hydraulic drive of a stand associated with the optical observation device. The following difficulties arise, particularly with magnified imaging, such as with a surgical microscope: - Due to the natural limitations of fine motor skills and the forces involved, manual adjustment of the position results in an undesirably strong change in perspective. The viewer is subsequently forced to repeatedly move back and forth to approximate the desired change. - This repeated manual adjustment of the position often leads to vibration in the support system of the tripod and optical observation device. The observer is forced to perform strenuous, fine-tuned movements to suppress this. - Since the viewer usually performs a main activity, e.g. manipulating surgical instruments, additional fine motor hand and finger movements will disrupt the overall efficiency as an additional burden. - A remote-controlled tripod drive, on the other hand, often leads to undesirable and excessive position changes due to the geometry of the tripod arms and their spatial position, as well as the type of joints and their spatial position. Furthermore, a very complex control technology for the drive is required to avoid vibrations, dead times, or overloads, for example.
[0009] Overall, it can therefore be assumed that the possibilities for fine-tuning or exploration are underutilized, and that attempts to utilize them result in unnecessarily large and therefore disturbing image changes. This can even lead to a loss of the original image impression and orientation regarding the originally chosen perspective.
[0010] US 2019 / 191110 A1 and US 2018 / 231752 A1 disclose imaging systems in which images are combined into composite images. US 8 360 964 B2 discloses an endoscope in which image circles from multiple imaging channels are projected onto a single image sensor, so that only a single image is captured. EP 1 860 492 B1 discloses an image acquisition device in which aliasing artifacts are reduced when capturing images with digital image sensors.
[0011] Apart from the topic explained above, methods for image stabilization are known, as disclosed, for example, in US 2019 / 0 020 822 A1.
[0012] Against this background, the object of the invention is to provide an imaging method and an optical observation device with which the disadvantages explained above can be at least partially eliminated. Preferably, the invention should enable a user to obtain an improved, in particular more precise, impression of an object being observed with minimal effort.
[0013] This problem is solved by the subject matter of the independent claims. The dependent claims relate to embodiments of the invention.
[0014] A first aspect of the invention relates to a computer-implemented imaging method in which an image of an observation object is projected into an image circle of a lens and a section of the image circle is captured by an image sensor.
[0015] The term "object of observation" refers to an object from which images are to be generated that at least partially show the object of observation. The object of observation can be, for example, a medical object, e.g., a surgical site, a tissue sample, etc.
[0016] In this case, an “image circle” can be understood as a circular area illuminated by the lens, which is defined by the objective lenses.
[0017] The term "lens" in this context refers to a converging optical system that produces a real optical image of the object being observed. The lens can be the lens of an optical observation device, e.g., a microscope, such as a surgical microscope.
[0018] An "image sensor" in this context can be understood as a device for recording two-dimensional images from light by electrical or mechanical means. The image sensor can, in particular, be semiconductor-based. The light can preferably be visible light. Optionally or alternatively, the images can also be recorded based on light with a wavelength in the non-visible range, e.g., infrared light, UV light, X-rays, etc. The image sensor can, in particular, have a rectangular shape, so that essentially rectangular images are generated.
[0019] The image sensor only captures a section of the image circle, i.e. the image sensor does not cover the image circle completely.
[0020] “Computer-implemented” means that at least one method step, preferably several or all method steps, are carried out using a computer program.
[0021] The proposed procedure comprises the following steps: a) Capturing an original image which represents a first section of the image circle, b) computer-controlled acquisition of subsequent images, wherein at least one of the subsequent images represents a different section of the image circle, wherein the other section partially overlaps with the first section, and c) generating and outputting an image sequence comprising the original image and the subsequent images.
[0022] In process step a), as usual, a first image, the original image, is first captured by the image sensor. Due to the rectangular shape of the image sensor, for example, this image represents only a section of the circular image circle. The section represented by the original image is referred to here as the first section.
[0023] In process step b), several subsequent images, i.e. at least two subsequent images, are captured. At least one of the subsequent images represents a different section of the image circle compared to the first section, with the other section partially overlapping with the first section. “Partially overlapped” means that the first section and the other section partially, but not completely, match. There is therefore a content-related connection between the original image and the subsequent image(s) representing the other sections partially overlapping with the first section, in that at least one, but not all, of the pixels shown in the original image can also be found in these subsequent images. Accordingly, “partially overlapping” means “partially offset,” but not completely offset.
[0024] Preferably, it can be provided that several subsequent images are captured, each representing a different section of the image circle that partially overlaps with the first section. Optionally, it can be provided that the displayed sections of these subsequent images partially overlap not only with the first section of the original image, but also with the other subsequent images.
[0025] In addition to the subsequent image(s) that represent other sections of the image circle that partially overlap with the original image, subsequent images can also be captured that represent the same section as the original image.
[0026] The acquisition of the subsequent images is computer-controlled, i.e., the sections of the subsequent images are defined by computer control. For this purpose, movements, e.g., of the image sensor relative to the image circle and / or of the lens together with the image sensor relative to the object under observation, can be carried out in a computer-controlled manner, i.e., based on instructions stored in the form of a computer program that are output to one or more corresponding actuators. Alternatively or additionally, the beam path between the object under observation and the image sensor can be influenced by computer control such that at least one of the subsequent images represents a different section of the image circle. For further details, please refer to the following description.
[0027] In method step c), an image sequence comprising the original image and the subsequent images is generated and output, for example in the form of a video film containing the image sequence. The output can be in the form of a video signal to a display device, for example, so that a viewer or user can perceive the image sequence displayed on the display device, e.g., a digital microscope. Alternatively or additionally, the image sequence can be output to another device, for example, a storage unit for storing the image sequence and / or an evaluation unit for computer-based evaluation of the image sequence according to predeterminable evaluation algorithms.
[0028] Preferably, the object being observed remains stationary during the imaging procedure, i.e., is not moved. This can, among other things, prevent any impairment of the object being observed due to movement.
[0029] The imaging process can also be performed using a stereo observation device. In this case, the object being observed can be simultaneously projected into the image circle of two lenses of the stereo observation device, e.g., a stereo microscope, and a section of the image circles is captured by one image sensor each, with process steps a) and c) being performed for each of the two lenses.
[0030] Using the proposed method, micro-adjustments or fine-tuning of imaging can be realized that are not possible with existing optical or optical-digital systems, such as surgical microscopes. Such micro-adjustments can be used for the cognitive reconstruction of an observed spatial structure, thus improving the effectiveness and efficiency of the user's cognitive representations. Depending on the specific implementation of the method, an improved three-dimensional impression of the observed object can be achieved. For example, medical structures can be discriminated better and with less effort under an observation device using the proposed imaging method, e.g., a microscope, so that, for example, resections can be performed more safely.
[0031] By carrying out the procedure under computer control, the time required for complex manual adjustment of the observation device can be eliminated, so that - depending on the specific application - operation times can be shortened, for example.
[0032] According to various embodiments, the image sensor can be moved relative to the image circle to capture at least one subsequent image.
[0033] Preferably, the image sensor can be moved within the image circle, so that the entire image sensor can advantageously always be used for image capture. In other words, the image sensor can be located entirely within the image circle for each image. Alternatively, at least 80%, preferably at least 90%, particularly preferably at least 95% of the image sensor's surface can be located within the image circle. For example, areas of the image sensor, e.g., an outermost corner, could protrude from the image circle.
[0034] The movement of the image sensor with respect to the image circle can in particular take place in such a way that at least one of the subsequent images represents a different section of the image circle, wherein the other section partially overlaps with the first section. For example, it can be provided that the image sensor is moved with respect to the image circle in such a way that the other sections of the subsequent images cover the entire image circle or at least substantially the entire image circle. For example, with a square shape of the image sensor, small corners in the edge region of the image circle could be disregarded. In other words, the image circle can be scanned, i.e. the images of the image sequence show at least substantially the entire image circle.
[0035] To move the image sensor, one or more actuators can be provided, which move the image sensor as desired based on corresponding control signals. The one or more actuators can be provided in addition to existing actuators for moving an optical observation device, e.g., for moving a microscope stand and for moving a microscope head with eyepiece, camera, and lens.
[0036] The movement of the image sensor can, for example, take place in a plane arranged perpendicular to an optical axis of the lens, ie in the xy direction if the optical axis corresponds to the z direction.
[0037] Alternatively or additionally, the image sensor can be moved along the optical axis of the lens, i.e. in the z-direction.
[0038] Alternatively or additionally, the image sensor can be tilted relative to the optical axis of the lens. The term "tilting" generally refers to a rotational movement about an arbitrarily positioned axis of rotation. In other words, the movement of the image sensor can be a tilting movement. For example, the image sensor can have an axis of rotation, which can run perpendicular to the optical axis of the lens, in particular, and the image sensor can be tilted about the axis of rotation.
[0039] Tilting allows subsequent images to be captured in which pixels arranged in a straight line contain focused image information. All other pixels may contain unfocused, or at least not fully focused, image information. The rotation axis of the image sensor can run through this straight line, depending on the orientation of the tilt. Alternatively, the rotation axis can also be positioned differently, for example, aligned parallel to the aforementioned straight line.
[0040] Tilting can stimulate the user's cognitive processes and, for example, lead to improved concentration when perceiving the subsequent sequence of images.
[0041] According to further embodiments, the lens can be moved together with the image sensor relative to the object being observed in order to capture at least one subsequent image.
[0042] The movement of the lens together with the image sensor with respect to the object being observed, in short the movement of the lens, can in particular take place in such a way that at least one of the subsequent images represents a different section of the image circle, the other section partially overlapping with the first section.
[0043] For the required minor movements, one or more actuators can be used in particular, which are present in addition to existing actuators for moving an optical observation device, e.g., for moving a microscope stand and for moving a microscope head with eyepiece, camera, and lens. In other words, the movement of the lens together with the image sensor relative to the observation device can be realized by means of one or more actuators arranged specifically for this purpose in the optical observation device, whereby the movement can be based on corresponding control signals.
[0044] Currently available optical observation devices and the associated imaging techniques, however, are neither designed nor suitable for the slight movements required for a partial overlap of the first section with at least one other section, but are accompanied by the limitations and disadvantages explained above.
[0045] For example, the lens can be moved together with the image sensor within a housing of an optical observation device.
[0046] For this purpose, the lens can be arranged together with the image sensor within a movable inner housing, with the inner housing being enclosed by a fixed outer housing, the aforementioned housing of the optical observation device. Based on control signals, the inner housing, which can be hydrodynamically or gel-mounted or gimbal-mounted, can be incrementally tilted or shifted using one or more actuators.
[0047] The lens and the image sensor can be components of an optical observation device, more precisely of an optical observation unit of an optical observation device, wherein the optical observation unit is movable in six degrees of freedom by means of a stand of the optical observation device. During the movement of the lens together with the image sensor relative to the observation object, preferably no movement occurs in these six degrees of freedom, i.e. the housing of the optical observation device or the outer housing is not moved relative to the observation object during the movement of the lens together with the image sensor relative to the observation object. Furthermore, during the movement of the image sensor relative to the image circle, preferably no movement occurs in these six degrees of freedom, i.e.the outer casing is not moved relative to the object being observed during the movement of the image sensor relative to the image circle.
[0048] The lens, together with the image sensor, can be moved relative to the object under observation in at least one plane, the movement plane. This movement plane can be aligned parallel to the object plane from which the original image was captured and can accordingly enable movement in the x- and y-directions. Alternatively or additionally, movement perpendicular to the object plane, in particular in the z-direction, can also be enabled.
[0049] The term "object plane" refers to a plane containing the object points that runs perpendicular to the optical axis of the lens. The movement of the lens together with the image sensor can therefore occur, for example, in the x-, y-, and / or z-direction, with the optical axis of the lens corresponding to the z-direction.
[0050] Alternatively or additionally, the lens can be tilted together with the image sensor with respect to the object plane from which the original image was captured.
[0051] For example, the first section can represent a first object plane of the observed object. Tilting the lens together with the image sensor relative to the observed object can then be performed in such a way that the object plane intersects the first object plane after tilting.
[0052] According to further embodiments, in order to capture at least one subsequent image, a beam path between the object under observation and the image sensor can be influenced in such a way that this subsequent image represents a different section of the image circle, wherein the other section partially overlaps with the first section.
[0053] In other words, by influencing the beam path, a different image area can be projected onto the image sensor.
[0054] For example, the beam path can be influenced by moving, in particular tilting, at least one beam-directing element arranged in the beam path, e.g., a prism or a mirror. The movement / tilting of the at least one beam-directing element can be implemented based on corresponding control signals using one or more actuators that are operatively connected to the beam-directing element.
[0055] In this embodiment, the image sensor can preferably be stationary relative to the lens and / or relative to the object being observed.
[0056] According to the invention, the imaging method is carried out using an optical observation device having a stand movable in six degrees of freedom. No movement occurs in the six degrees of freedom during the imaging method.
[0057] In other words, the tripod remains stationary, and only the micro-changes described above occur. This advantageously prevents the micro-changes from being overlaid by further movements, allowing the full benefits associated with the micro-changes to be realized.
[0058] According to further embodiments, the method may comprise detecting a pupil movement of a viewer of the image sequence to be output, wherein the detection of at least one subsequent image is carried out based on the detected pupil movement.
[0059] In other words, the acquisition of subsequent images can be controlled by pupil movement. For example, a direction of shifting the other section relative to the first section can be triggered by a pupil movement in that direction. Specifically, the image sensor can be shifted in the direction of view, i.e., according to the pupil movement.
[0060] To detect pupil movement, for example, a distortion of the circular pupil can be analyzed.
[0061] This offers the advantage of a cognitive link between pupil movement and image sequence, so that the process of cognitive reconstruction and representation of a spatial structure described above can take place despite an artificially predetermined image sequence, just as if the user were directly observing the object under observation.
[0062] According to further embodiments, the acquisition of the at least one subsequent image can be carried out according to a control routine in such a way that a predeterminable movement, e.g., displacement, of the other sections occurs with respect to the first section and optionally the previous other sections.
[0063] In other words, the image sequence can be specified starting from the original image, allowing the image sequence to be generated reproducibly. This allows, for example, different observation objects to be more easily compared with each other when using the same optical observation device. For example, the fifth image in the image sequence can depict a different section of the image circle, always based on the same movement relative to the first section. Among other things, micro-adjustments can be implemented according to a programmed routine, similar to a pre-planned reconnaissance flight over unknown terrain / tissue, and a corresponding image sequence can be generated.
[0064] According to further embodiments, the method may comprise tracking an illumination area of a light source for illuminating the object under observation.
[0065] The illumination area generated by the light source can be defined as needed, for example, based on control signals from the control device. For example, the illumination area can be adjusted when the lens moves together with the image sensor in such a way that an illuminated area of the object being observed is always projected into the image circle of the lens. The illumination area can be adjusted by moving the light source accordingly and / or influencing the beam path of the radiation emitted by the light source, e.g., using mirrors, prisms, lenses, etc.
[0066] The light source can, for example, be designed to emit light with a wavelength in the visible wavelength range, UV light and / or light for fluorescence excitation.
[0067] By tracking the illumination area, edge shading can be avoided and image quality can be improved.
[0068] Another aspect of the invention relates to an optical observation device. The optical observation device has a lens designed to project an image of an object under observation into an image circle.In addition, the optical observation device has an image sensor, designed to capture an original image which represents a first section of the image circle and subsequent images, one or more actuators which cause at least one of the subsequent images to represent a different section of the image circle, wherein the other section partially overlaps with the first section, a control device, designed to generate and output control signals to the actuators, wherein the control signals cause the subsequent images to be captured starting from the original image, wherein at least one of the subsequent images represents a different section of the image circle and wherein the other section partially overlaps with the first section, and an image processing device, designed to generate and output an image sequence comprising the original image and the subsequent images.The optical observation device has a tripod that can be moved in six degrees of freedom, whereby no movement occurs in the six degrees of freedom during the acquisition of the original image and the subsequent images, as well as during the generation of the image sequence.
[0069] The optical observation device can be used to perform the computer-implemented imaging method described above. In other words, the optical observation device can comprise the lens, the image sensor, and means configured to perform an imaging method as described above. All statements regarding the proposed imaging method and its embodiment variants can be applied analogously to the proposed optical observation device. The advantages of the imaging method are correspondingly associated with the optical observation device.
[0070] The actuators can be designed, for example, to move the image sensor relative to the image circle, to move the lens together with the image sensor relative to the object under observation and / or to move beam steering elements to influence a beam path between the image circle and the image sensor.
[0071] The actuators are connected to the control device for signal transmission, so that control signals generated by the control device can be transmitted to the actuators. The control device can be implemented in hardware and / or software and can be physically constructed in one or more parts. The control device can be configured to perform additional control functions of the optical observation device, e.g., output control signals to a stand of the optical observation device.
[0072] The control signals can cause the subsequent images to be captured starting from the original image, wherein at least one of the subsequent images represents a different section of the image circle and wherein the other section partially overlaps with the first section, for example by causing the image sensor to move relative to the image circle, the lens together with the image sensor relative to the object under observation and / or the beam steering elements to influence a beam path between the object under observation and the image sensor.
[0073] For example, the optical observation device can have additional actuators for moving an optical observation device, e.g., for moving a microscope stand and for moving a microscope head with eyepiece, camera, and lens. Preferably, the actuators for moving an optical observation device differ from the one or more actuators that cause at least one of the subsequent images to represent a different section of the image circle, with the other section partially overlapping the first section. For example, controlling the additional actuators for moving an optical observation device can enable the observation device to move in six degrees of freedom.When controlling the one or more actuators which cause at least one of the subsequent images to represent a different section of the image circle, with the other section partially overlapping with the first section, there is preferably no movement in the six degrees of freedom of the observation device.
[0074] The image processing device of the optical observation device generates the image sequence by appropriately processing the images captured by the image sensor. For this purpose, the image processing device is connected to the image sensor for signal transmission. The image processing can process the captured and transmitted images based on instructions or a code programmed in the image processing device according to one or more image sequence routines. The image sequence is then output, e.g., to a display device that can be viewed by a user or observer and that is connected to the image processing device for signal transmission. Alternatively or additionally, the output can be made to a storage unit and / or evaluation unit. The image processing device can be combined with the control device, i.e., they can form a common component.
[0075] Optionally, the optical observation device can comprise a light source designed to illuminate at least part of the object under observation. The illumination area generated by the light source can be defined as needed, for example, based on control signals from the control device.
[0076] According to various embodiments, the optical observation device can have a device for detecting a pupil movement of a viewer of the image sequence to be output. The control device can be configured to evaluate the detected pupil movement and, based on the evaluated pupil movement, generate the control signals and output them to the actuators in such a way that the capture of at least one subsequent image is based on the detected pupil movement.
[0077] The device for detecting pupil movement can, for example, be designed as a camera that is aimed at at least one eye of the observer and detects the observer's pupil movement. The control device is connected to the device for detecting pupil movement in a signal-transmitting manner.
[0078] According to further embodiments, the optical observation device can be designed as a stereo microscope.
[0079] The term "stereomicroscope" refers to a microscope with two separate optical paths, each of which is assigned to an observer's eye. This allows the object to be viewed from slightly different angles for each eye, resulting in a three-dimensional image. Each optical path can have an objective lens, and the two objectives can be constructed in a similar way.
[0080] The stereomicroscope can, for example, be a stereo surgical microscope. Preferably, the stereomicroscope can be a digital microscope, meaning the object being observed is not directly observable, but its image is displayed on a display. The display can, for example, be integrated into an eyepiece and present separate images for each eye of the observer. Alternatively, the display can be configured as a display that can be viewed by both eyes simultaneously, e.g., in the form of a monitor. Several of the aforementioned display devices or additional display devices can also be present.
[0081] According to further embodiments, the optical observation device can be designed as a medical observation device.
[0082] A "medical observation device" is understood here to mean an observation device used in a medical context. For example, the medical observation device can be a surgical microscope, a microscope for evaluating medical samples such as tissue, blood, etc., or a microscope used in pathology.
[0083] Since particularly precise observation of the object under observation is often required in the medical field and missing or incorrect information can have far-reaching consequences, e.g., for the patient being examined, the proposed optical observation device and the imaging method that can be performed with it are particularly advantageous when used in the medical field.
[0084] A further aspect of the invention relates to a computer program. The computer program comprises instructions that, when executed on a computer, cause the computer to generate control signals that cause an image sensor of an optical observation device to capture an original image and subsequent images, wherein the original image represents a first section of an image of an observation object projected into an image circle of a lens, and wherein at least one of the subsequent images represents a different section of the image circle, wherein the other section partially overlaps with the first section, and to generate and output an image sequence comprising the original image and the subsequent images.The computer program also includes instructions which, when executed on a computer, cause the computer to issue control signals to a tripod movable in six degrees of freedom which result in no movement in the six degrees of freedom during the acquisition of the original image and the subsequent images and during the generation of the image sequence.
[0085] The computer program can be used to carry out the computer-implemented imaging method described above using the optical observation device described above. In other words, the computer program can include instructions that cause an optical observation device according to the above description to carry out an imaging method according to the above description. All statements regarding the proposed imaging method, the optical observation device, and their embodiment variants can be applied analogously to the proposed computer program. The advantages of the imaging method and the optical observation device are correspondingly linked to the computer program.
[0086] A computer program can be understood as a program code that can be stored on a suitable medium and / or retrieved via a suitable medium. Consequently, the computer program can be stored on a computer-readable data carrier. Furthermore, a data carrier signal that transmits the computer program can be formed. Any medium suitable for storing software can be used to store the program code, for example, a non-volatile memory built into a control unit, a DVD, a USB stick, a flash card, or the like. The program code can be retrieved, for example, via the Internet or an intranet, or via another suitable wireless or wired network.
[0087] The instructions of the computer program can in particular cause a computer to generate control signals and output them to one or more actuators of the optical observation device, wherein the control signals cause: i) a displacement of an image sensor, with which images can be captured that represent a section of an image circle of a lens, into which an image of an observation object can be projected, with respect to the image circle, ii) a displacement of the lens together with the image sensor with respect to the observation object and / or iii) a movement of beam steering elements for influencing a beam path between the observation object and the image sensor in such a way that subsequent images can be captured starting from an original image, which represents a first section of the image circle,wherein at least one of the subsequent images represents a different section of the image circle and wherein the first section partially overlaps with the other section.,
[0088] Further features, properties and advantages of the present invention will become apparent from the following description of embodiments with reference to the accompanying figures. Fig. 1a to d show possible arrangements of an image sensor with respect to an image circle. Fig. Figure 2 shows a flow chart of an exemplary computer-implemented imaging method. Fig. 3 shows a possible arrangement of a first section and two other sections. Fig. 4a, b show an embodiment in which image sensors are moved with respect to the image circles assigned to them. Fig. 5a, b show an embodiment in which the lens is moved together with the image sensor with respect to the observation object. Fig. 6a, b show an embodiment in which the beam path between the observation object and the image sensor is influenced. Fig. Figure 7 shows a functional diagram of an exemplary optical observation device. Fig. 8 shows an embodiment of an optical observation device with a tripod in a schematic representation. Fig. 9 shows the degrees of freedom that the tripod has Fig. 8 and its suspension for the optical observation unit.
[0089] In the examples explained below, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. It should be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. For example, the features of the various exemplary embodiments described herein may be combined with one another unless specifically indicated otherwise. In the figures, identical or similar elements are designated by identical reference numerals where appropriate.
[0090] Directional terminology such as "top," "bottom," "right," "left," etc., is used with reference to the orientation of the described figures. Since components of embodiments can be positioned in a number of different orientations, the directional terminology is for illustrative purposes and is not limiting in any way.
[0091] Fig. 1 shows possible arrangements of an image sensor 5 with respect to an image circle 2 of a lens 3. As mentioned in the introduction, there is usually a discrepancy between the shape of the image sensor 5 and the shape of the image, which corresponds to the shape of the image circle 2. The image sensor 5 can therefore completely contain the image circle 2 ( Fig. 1a), contain as large a part of the image circle 2 as possible ( Fig. 1b) or within the image circle 2 ( Fig. 1c, Fig. 1d). Fig. 1a to 1d shown arrangement variants only a section 4 (hatched area in Fig. 1) of the image circle 2 is captured by the image sensor 5, resulting in loss of information.
[0092] Among other things, in order to solve this problem and to be able to obtain more information about an observation object 1, a computer-implemented imaging method 100 is proposed, the possible procedure of which is Fig. 2 is shown schematically. The aim of the imaging method 100 is an image sequence 19 of an observation object 1, which can be viewed by an observer, so that the observer receives, in particular, a spatial impression of the observation object 1. The observation object 1 can, in particular, be a medical object, e.g., a surgical site.
[0093] After starting the method 100, in a first method step S1, an image of the observation object 1 is projected into the image circle 2 of a lens 3. In method step S2, an original image is then captured, which represents, i.e., images, a first section of the image circle 2. This can be done, for example, according to the Fig. 1b to 1d shown arrangement possibilities of image circle 2 and image sensor 5.
[0094] In method step S3, the pupil movement of a viewer of the image sequence to be output is detected, for example, by observing the pupil with a camera and analyzing any distortion of the circular pupil. For example, a circular counterclockwise pupil movement can be detected.
[0095] Based on this pupil movement, several subsequent images are captured in a computer-controlled manner in method step S4. At least one of the subsequent images represents a different section of the image circle 2 than the first section, but which partially overlaps with the first section 2. Computer-controlled capture of the subsequent images means that the other sections 16a, 16b of the subsequent images are moved by suitable movements, as described below with reference to Fig. 4 to 6 explained in more detail, can be determined automatically.
[0096] A possible arrangement of the first cutout 15 and two other cutouts 16a, 16b is shown in Fig. 3. To move from the first section 15 to the first other section 16a, the image sensor 5 is shifted relative to the image circle 2 by dx in the x-direction and dy1 in the y-direction. To move from the first section 15 to the second other section 16b, the image sensor 15 is shifted relative to the image circle 2 by dy2 in the y-direction. Consequently, to move from the first other section 16a to the second other section 16b, a shift by -dx and +(dy2dy1) is necessary. Both other sections 16a, 16b partially overlap with the first section 15 as well as with each other. It should be noted that subsequent images whose other sections 16a, 16b partially overlap with the first section 15 are not only determined by the Fig. 3 shown displacement of the image sensor 5 with respect to the image circle 2, but also by other movements, as described below with reference to the Fig. 4 to 6 are explained in more detail.
[0097] In the exemplary embodiment, the subsequent images are captured based on the pupil movement detected in method step S3. For example, the other sections 16a, 16b of the subsequent images can be defined along the pupil movement trajectory. If, for example, the pupil moves to the right from the observer's perspective, the corresponding other section 16a, 16b can also be defined to the right by shifting the image sensor 5. However, it should be noted that the capture of the subsequent images does not necessarily have to be based on a detected pupil movement; rather, the other sections 16a, 16b can also be defined in other ways.
[0098] In method step S5, an image sequence 19 is generated, comprising the original image and the subsequent images. This image sequence 19 is then output, e.g., displayed to the viewer on a display device 17. This concludes method 100.
[0099] The following is based on the Fig. Figures 4 to 6 explain in more detail how subsequent images can be captured that represent a different section 16a, 16b that partially overlaps with the first section 15 of the original image. For this purpose, the movement options explained can be performed individually or combined with one another.
[0100] Based on the Fig. 4a and Fig. 4b, an embodiment is explained below in which image sensors 5a, 5b are moved with respect to the image circles 2a, 2b assigned to them in order to capture at least one subsequent image each representing a different section 16a, 16b of the image circle 2a, 2b, which partially overlaps with the first section 15.
[0101] The Fig. 4a and Fig. 4b each show two objectives 3a, 3b of a stereomicroscope for observing the observation object 1, e.g., a surgical site. The objectives 3a, 3b are constructed analogously and have several lenses 20a, 20b, 20c as well as a beam-directing element 9e, 9f designed as a prism as optical elements to form the two beam paths 8a, 8b and to define them from the observation object 1 to the image sensors 5a, 5b. Here, the optical axes 6a, 6b, which are shown in the Fig. 4a, Fig. 4b are represented by a dashed line, are folded several times. Using the lenses 3a, 3b, an image of the observation object 1 is projected into the image circles 2a, 2b, whereby a section 4 of each of the image circles 2a, 2b can be captured by the corresponding image sensors 5a, 5b.
[0102] In the middle and lower part of the Fig. 4a and 4b, respectively, show the lenses 3a, 3b in a sectional view parallel to the optical axes 6a, 6b of the lenses 3a, 3b, so that the position of the image sensors 5a, 5b relative to the image circles 2a, 2b in the z-direction can be seen. The z-direction corresponds to the orientation of the optical axes 6a, 6b at the intersection point with the image circles 2a, 2b.
[0103] In the upper part of the Fig. For better understanding, in Figures 4a and 4b the image circles 2a, 2b with the associated image sensors 5a, 5b are shown again separately in plan view, ie perpendicular to the optical axes 6a, 6b, so that the position of the image sensors 5a, 5b with respect to the image circles 2a, 2b in the xy direction can be seen.
[0104] In Fig. 4a shows an initial situation in which an original image is captured by means of the image sensors 5a, 5b, which represents a first section 15 of the image circles 2a and 2b, respectively. For this purpose, the image sensors 5a, 5b are initially arranged centrally with respect to the image circles 2a, 2b, as shown in the upper part of the Fig. 4a shown.
[0105] Starting from this initial situation, subsequent images are captured. For this purpose, the image sensors 5a, 5b are moved in a computer-controlled manner in the xy direction, i.e., in a plane perpendicular to the optical axes 6a, 6b, relative to the image circles 2a, 2b. Optionally, the image sensors 5a, 5b can also be moved in the z direction, i.e., along the optical axes 6a, 6b, and / or tilted relative to the optical axes 6a, 6b.
[0106] Fig. Figure 4b shows the situation when capturing a subsequent image, the other section 16a, 16b of which partially overlaps with the first section 15 of the Fig. 4a. For this purpose, the image sensors 5a, 5b were aligned from the central position according to Fig. 4a is shifted to the right in the x-direction and downwards in the y-direction. This results in the upper part of the Fig. 4b shows the alignment of the image sensors 5a, 5b with respect to the image circles 2a, 2b.
[0107] Analogous to Fig. 4b, further subsequent images can be acquired, the other sections 16a, 16b of which partially overlap with the first section 15. For example, several subsequent images can be acquired in the form of an image series, the other sections 16a, 16b of which cover the entire image circles 2a, 2b, i.e., the image circles 2a, 2b are scanned. This can, as already mentioned, be done based on a detected pupil movement or, for example, based on a programmed sequence for shifting the image sensors 5a, 5b with respect to the image circles 2a, 2b.
[0108] Based on the Fig. 5a and Fig. 5b, a further embodiment is explained below, in which the lenses 3a, 3b together with the image sensors 5a, 5b are moved with respect to the observation object 1 in order to capture at least one subsequent image each representing a different section 16a, 16b of the image circle 2a, 2b, which partially overlaps with the first section 15.
[0109] The general structure of the lenses 3a, 3b corresponds to that of the Fig. 4a, Fig. 4b, so that only the differences compared to the Fig. 4a, Fig. 4b and otherwise refer to the explanations on the Fig. 4a and Fig. 4b is referred to.
[0110] The lenses 3a, 3b, together with the image sensors 5a, 5b, are arranged in a movable housing 18, stationary relative to this movable housing 18. The movable housing 18 is located in another housing 7, which is stationary relative to the observation object 1 during the implementation of the imaging method 100. The movable housing 18 can be moved and tilted relative to the housing 7 and thus also relative to the observation object 1.
[0111] In Fig. Figure 5a shows an initial situation in which an original image is captured by the image sensors 5a, 5b, which represents a first section 15 of the image circles 2a and 2b, respectively. For this purpose, the movable housing 18 is initially arranged centrally with respect to the housing 7.
[0112] Fig. Figure 5b shows the situation when capturing a subsequent image, the other section 16a, 16b of which partially overlaps with the first section 15 of the Fig. 5a. For this purpose, the movable housing 18 was rotated from the central orientation according to Fig. 5a is tilted relative to the housing 7 and thus also relative to the observation object 1. In other words, the tilting occurred relative to the object plane from which the original image was captured, i.e. the object plane in the representation according to Fig. 5a. The tilting causes the beam paths 8a, 8b to hit the observation object 1 slightly off-center (in Fig. 5b exaggerated).
[0113] In addition to the Fig. 5b, the movement of the lenses 3a, 3b together with the image sensors 5a, 5b with respect to the observation object 1 can alternatively or additionally cause a displacement in a plane that is oriented perpendicular to the object plane from which the original image was captured, i.e. in the x-, y- and / or z-direction.
[0114] In the case of this embodiment, analogous to Fig. 5b, further subsequent images are acquired, the other sections 16a, 16b of which partially overlap with the first section 15. For example, several subsequent images can be acquired in the form of an image series, the other sections 16a, 16b of which cover the entire image circles 2a, 2b, i.e., the image circles 2a, 2b are scanned. This can be done based on a detected pupil movement or, for example, based on a programmed sequence for moving the lenses 3a, 3b together with the image sensors 5a, 5b relative to the observation object 1.
[0115] Based on the Fig. 6a and Fig. 6b, a further embodiment is explained below, in which the beam paths 8a, 8b between the observation object 1 and the image sensors 5a, 5b are influenced in such a way that at least one subsequent image is captured for each lens 3a, 3b, which represents a different section 16a, 16b of the image circle 2a, 2b, which partially overlaps with the first section 15.
[0116] The general structure of the lenses 3a, 3b corresponds to that of the Fig. 4a, Fig. 4b, so that only the differences compared to the Fig. 4a, Fig. 4b and otherwise refer to the explanations on the Fig. 4a and Fig. 4b is referred to.
[0117] In each of the two beam paths 8a, 8b of the two lenses 3a, 3b, two mirrors are arranged as beam-directing elements 9a, 9b, 9c, 9d, which can be tilted to influence the beam paths 8a, 8b. Alternatively or additionally, other or additional beam-directing elements can be used to influence the beam paths 8a, 8b.
[0118] In Fig. Figure 6a shows an initial situation in which an original image is captured by means of the image sensors 5a, 5b, which represents a first section 15 of the image circles 2a and 2b, respectively. For this purpose, the beam paths 8a, 8b are influenced in such a way that the image sensors 5a, 5b are initially arranged centrally with respect to the image circles 2a, 2b, as shown in the upper part of the Fig. 6a shown.
[0119] Starting from this initial situation, subsequent images are now acquired, for which the beam paths 8a, 8b are influenced by tilting the beam steering elements 9a, 9b, 9c, 9d. Fig. Figure 6b shows the situation after tilting the beam steering elements 9a, 9b, 9c, 9d by the tilt angle γ, whereby for comparison with the initial situation the initial positions of the beam steering elements 9a, 9b, 9c, 9d are Fig. 6a are shown as a dashed-dot line. The beam paths 8a, 8b are influenced in such a way that the image sensors 5a, 5b are arranged off-center with respect to the newly positioned image circles 2a, 2b, as shown in the upper part of the Fig. 6b. The tilting can, for example, comprise a rotation about a rotation axis located in the center of the beam path. The position of the image sensors 5a, 5b relative to the observation object 1 remains unchanged. As a result, the same subsequent images can be obtained as in the case of the Fig. 4a and Fig. 4b described first embodiment.
[0120] Analogous to Fig. 6b, additional subsequent images can be acquired, the other sections 16a, 16b of which partially overlap with the first section 15. For example, several subsequent images can be acquired in the form of an image series, the other sections 16a, 16b of which cover the entire image circles 2a, 2b of the original images, i.e., the image circles 2a, 2b are scanned. This can, as already mentioned, be done based on a detected pupil movement or, for example, based on a programmed sequence for moving the beam-directing elements 9a, 9b, 9c, 9d.
[0121] Fig. 7 shows a diagram illustrating the functional relationships of some devices of an exemplary optical observation device 200.
[0122] The optical observation device 200 has a control device 11 configured to generate and output control signals 12a, 12b, 12c. For this purpose, the control device 11 can use a computer program that includes corresponding commands.
[0123] The control signals 12a, 12b, 12c are output to actuators 10a, 10b, 10c, which are connected to the beam steering elements 9, the movable housing 18 and the image sensors 5, respectively, as shown in Fig. 7 by means of dashed arrows, are in an operative connection and a movement of these devices, for example in accordance with the explanations to the Fig. 4 to 6. It should be noted that the optical observation device 200 comprises at least one of the actuators 12a, 12b, 12c or any combination of several of the actuators 12a, 12b, 12c together with the devices associated with them, ie the beam steering elements 9, the movable housing 18 or the image sensors 5.
[0124] Image signals 21 are transmitted from the image sensors 5 to the image processing device 13 of the optical observation device 200, regardless of whether they are designed to be movable or immovable with respect to the associated image circle 2. The image processing device 13 uses these image signals 21 to generate and output an image sequence 19 based on the image signals 21, wherein the image sequence 19 comprises the original image and the subsequent images. The image processing device 13 can form a common component with the control device 11, e.g., be integrated into it.
[0125] The image sequence 19 is output to a display device 17 of the optical observation device 200, so that the image sequence 19 can be viewed by a viewer or user. The display device 17 can be designed, for example, as a digital binocular, in which two different image sequences 19 are displayed separately for the right and left eyes, from which the viewer can obtain a three-dimensional impression of the object 1 under observation.
[0126] Optionally, the optical observation device 200 can have a device 14 for detecting a pupil movement of the observer. The detected pupil movement can be transmitted as a pupil signal 22 to the control device 11, which evaluates the pupil movement and takes it into account when generating the control signals 12a, 12b, 12c such that at least one subsequent image is captured based on the detected pupil movement.
[0127] In the exemplary embodiment, the optical observation device 200 is designed as a stereo surgical microscope. Nevertheless, the invention is neither limited to stereo microscopes nor to medical observation devices.
[0128] The optical observation device 200 of the embodiment comprises, in addition to the features described with reference to Fig. 7 described devices a tripod 201 as in Fig. 8 shown.
[0129] In Fig. Figure 8 shows an optical observation device 200 with a motor-driven stand 201 and an optical observation unit 102 attached to the stand 201. The optical observation unit 102 includes, among other things, the lenses 3a, 3b, the image sensors 5a, 5b, and one or more of the actuators 10a, 10b, 10c. By inputting navigation data, the orientation and position of the optical observation unit 102 can be automatically adjusted, which enables positioning and orientation of the optical observation unit 102, even remotely, in such a way that a specific section of an object field, e.g., the site, is optimally displayed. For this purpose, a control unit 401 is assigned to the stand 201, which carries out the positioning or orientation of the optical observation unit 102 on the basis of received position and / or orientation control data by outputting control signals 403, 404 to suitable servo motors.The control unit 401 can form a common component with the control device 11 and / or the image processing device 13, i.e. can be designed in one piece.
[0130] In the following, the tripod 201 and the degrees of freedom enabled by the tripod 201 for the optical observation unit 102 are described using the Fig. 8 and Fig. 9. In the Fig. In the example of a tripod 201 shown in Figure 8, the tripod 201 rests on a tripod base 205, on the underside of which are rollers 206 that allow the tripod 201 to be moved. To prevent accidental movement of the tripod 201, the tripod base 205 has a foot brake 207.
[0131] The actual tripod 201 comprises, as tripod elements, a height-adjustable tripod column 208, a support arm 209, a spring arm 210 and a suspension 211 for the optical observation unit 102, which in turn comprises a connecting element 213, a pivot arm 215 and a holding arm 214. The degrees of freedom provided by the tripod elements for positioning the optical observation unit 102 are shown in Fig. 9. The support arm 209 is connected at one end to the stand column 208 so that it can rotate about an axis A. At the other end of the support arm 209, one end of the spring arm 210 is attached so that it can rotate about an axis B parallel to the axis A, so that the support arm 209 and the spring arm 210 form an articulated arm. The other end of the spring arm 210 is formed by a tilting mechanism (not shown) to which the suspension 211 is attached and which enables the suspension 211 to tilt about the axis C.
[0132] The suspension 211 has a rotation axis D, a pivot axis E and a tilt axis F, about which the optical observation unit 102 can be rotated, pivoted or tilted. The connecting element 213 attaches the suspension 211 to the outer end of the spring arm 210 so that it can rotate about the rotation axis D. The rotation axis D extends along the connecting element 213. A pivot arm 215 is connected to the connecting element 213, with the aid of which the optical observation unit 102, more precisely a holding arm 214 attached to the pivot arm 215, to which the optical observation unit 102 is fastened by means of a holder (not shown), can be pivoted about the pivot axis E. The pivot axis E extends through the pivot arm 215. The angle between the pivot arm 215 and the connecting element 213, iethe angle between the pivot axis E and the rotation axis D, can be varied by means of an adjustment mechanism arranged between the connecting part 213 and the pivot arm 215.
[0133] The tilt axis F runs perpendicular to the display plane through the support arm 214, allowing tilting of the optical observation unit 102. The optical observation unit 102 is attached to the support arm 214 by means of a bracket (not shown).
[0134] The degrees of freedom of the suspension 211 as well as the adjustment options of the optical observation unit 102, e.g., focusing, sharpness, magnification factor, etc., can be adjusted via an adjustment device 202, which in the present embodiment is shown as a foot control panel. However, the adjustment device 202 can also be implemented as a hand control element or as a combination of a foot and hand control element. Remote control may also be possible.
[0135] Even though the tripod 201 has been described using a specific example, a person skilled in the art will recognize that other types of tripods can also be used.
[0136] Preferably, it can be provided that during the implementation of the described imaging method 100, no movement takes place in the six degrees of freedom, but rather only one or more of the described movements i) image sensor 5 with respect to image circle 2, ii) lens 3 together with the image sensor 5 with respect to the observation object 1 and iii) one or more beam steering elements 9 in the beam path 8 between the observation object 1 and the image sensor 5 take place.
[0137] The term "and / or" as used herein, when used in a series of two or more items, means that any one of the listed items may be used alone, or any combination of two or more of the listed items may be used.
[0138] It is expressly pointed out that for the sake of simplicity and to facilitate understanding of the described methods, devices, equipment, etc., individual components or devices are often referred to. Depending on the specific circumstances, several corresponding components or devices may be used for the same function. Such multi-part arrangements are also expressly intended to be encompassed by the claims and the description. List of reference symbols 1 observation object 2, 2a, 2b image circle 3, 3a, 3b lens 4 Excerpt 5, 5a, 5b image sensor 6a, 6b optical axis 7 housings 8, 8a, 8b Beam path 9, 9a, 9b, 9c, 9d, 9e, 9f beam steering element 10a, 10b, 10c Actuator 11 Control device 12a, 12b, 12c control signal 13 Image processing device 14 Device for detecting pupil movement 15 first excerpt 16a, 16b other section 17 Display device 18 movable housing 19 image sequence 20a, 20b, 20c lens 21 image signal 22 Pupil signal 100 imaging procedures 102 optical observation unit 200 optical observation device 201 Tripod 202 Actuating device 205 Tripod base 206 roll 207 Foot brake 208 Tripod column 209 Support arm 210 spring arm 211 Suspension 213 connecting element 214 Holding arm 215 swivel arm 401 Control unit 403 Control signal 404 Control signal S1 Projecting an image of an observation object into an image circle of a lens S2 Acquisition of an original image, which represents a first section of the image circle S3 Detecting a pupil movement of a viewer of the image sequence to be output S4 computer-controlled acquisition of subsequent images, wherein at least one of the subsequent images represents a different section of the image circle, wherein the other section partially overlaps with the first section S5 Generating and outputting an image sequence comprising the original image and the subsequent images γ tilt angle
Claims
[1] Computer-implemented imaging method (100), in which an image of an observation object (1) is projected (S1) into an image circle (2, 2a, 2b) of a lens (3, 3a, 3b) and a section (4) of the image circle (2, 2a, 2b) is captured by an image sensor (5, 5a, 5b), the method (100) comprising: - (S2): capturing an original image which represents a first section (15) of the image circle (2, 2a, 2b), - (S4): computer-controlled acquisition of subsequent images, wherein at least one of the subsequent images represents a different section (16a, 16b) of the image circle (2, 2a, 2b), wherein the other section (16a, 16b) partially overlaps with the first section (15), and - (S5): generating and outputting an image sequence (19) comprising the original image and the subsequent images, characterized bythat the method (100) is carried out by means of an optical observation device (200) which has a tripod (201) which is movable in six degrees of freedom, and wherein no movement takes place in the six degrees of freedom during implementation of the method (100). [2] Method (100) according to claim 1, wherein the image sensor (5, 5a, 5b) is moved with respect to the image circle (2, 2a, 2b) to capture at least one subsequent image. [3] Method (100) according to claim 2, wherein the image sensor (5, 5a, 5b) is moved with respect to the image circle (2, 2a, 2b) such that the other sections (16a, 16b) of the subsequent images cover at least substantially the entire image circle (2, 2a, 2b). [4] Method (100) according to claim 2 or 3, wherein the image sensor (5, 5a, 5b) is moved in a plane arranged perpendicular to an optical axis (6a, 6b) of the lens (3, 3a, 3b). [5] Method (100) according to one of claims 2 to 4, wherein the image sensor (5, 5a, 5b) is moved along the optical axis (6a, 6b) of the lens (3, 3a, 3b). [6] Method (100) according to one of claims 2 to 5, wherein the image sensor (5, 5a, 5b) is tilted with respect to the optical axis (6a, 6b) of the lens (3, 3a, 3b). [7] Method (100) according to one of the preceding claims, wherein, in order to capture at least one subsequent image, the lens (3, 3a, 3b) is moved together with the image sensor (5, 5a, 5b) with respect to the observation object (1). [8] Method (100) according to claim 7, wherein the lens (3, 3a, 3b) is moved together with the image sensor (5, 5a, 5b) within a housing (7) of the optical observation device (200). [9] Method (100) according to claim 7 or 8, wherein the lens (3, 3a, 3b) together with the image sensor (5, 5a, 5b) is moved with respect to the observation object (1) in at least one plane aligned parallel to an object plane from which the original image was captured. [10] Method (100) according to one of claims 7 to 9, wherein the lens (3, 3a, 3b) is tilted together with the image sensor (5, 5a, 5b) with respect to the object plane from which the original image was captured. [11] Method (100) according to one of the preceding claims, wherein, in order to capture at least one subsequent image, a beam path (8, 8a, 8b) between the observation object (1) and the image sensor (5, 5a, 5b) is influenced in such a way that this subsequent image represents a different section (16a, 16b) of the image circle (2, 2a, 2b), wherein the other section (16a, 16b) partially overlaps with the first section (15). [12] Method (100) according to claim 11, wherein the beam path (8, 8a, 8b) is influenced by moving at least one beam steering element (9, 9a, 9b, 9c, 9d, 9e, 9f) arranged in the beam path (8, 8a, 8b). [13] Method (100) according to one of the preceding claims, comprising: - (S3): detecting a pupil movement of a viewer of the image sequence to be output, wherein the detection of at least one subsequent image is based on the detected pupil movement. [14] Optical observation device (200), comprising: - a lens (3, 3a, 3b) designed to project an image of an observation object (1) into an image circle (2, 2a, 2b), - an image sensor (5, 5a, 5b) designed to capture an original image which represents a first section (15) of the image circle (2, 2a, 2b) and subsequent images, - one or more actuators (10a, 10b, 10c) which cause at least one of the subsequent images to represent a different section (16a, 16b) of the image circle (2, 2a, 2b), the other section (16a, 16b) partially overlapping with the first section (15), - a control device (11) designed to generate and output control signals (12a, 12b, 12c) to the actuators (10a, 10b, 10c), wherein the control signals (12a, 12b, 12c) cause the subsequent images to be captured starting from the original image, wherein at least one of the subsequent images represents a different section (16a, 16b) of the image circle (2, 2a, 2b) and wherein the other section (16a, 16b) partially overlaps with the first section (15), and - an image processing device (13) designed to generate and output an image sequence (19) comprising the original image and the subsequent images, characterized bythat the optical observation device (200) has a tripod (201) movable in six degrees of freedom, wherein no movement occurs in the six degrees of freedom during the acquisition of the original image and the subsequent images and during the generation of the image sequence (19). [15] Optical observation device (200) according to claim 14, comprising: - a device (14) for detecting a pupil movement of a viewer of the image sequence to be output, wherein the control device (11) is designed to evaluate the detected pupil movement and, based on the evaluated pupil movement, to generate the control signals (12a, 12b, 12c) and to output them to the actuators (10a, 10b, 10c) in such a way that the detection of at least one subsequent image is carried out based on the detected pupil movement. [16] Optical observation device (200) according to claim 14 or 15, designed as a stereomicroscope. [17] Optical observation device (200) according to one of claims 14 to 16, designed as a medical observation device. [18] Computer program comprising instructions which, when executed on a computer, cause it to: - to generate control signals (12a, 12b, 12c) which cause an image sensor (5, 5a, 5b) of an optical observation device (200) to capture an original image and subsequent images, wherein the original image represents a first section (15) of an image of an observation object (1) projected into an image circle (2, 2a, 2b) of a lens (3, 3a, 3b), and wherein at least one of the subsequent images represents another section (16a, 16b) of the image circle (2, 2a, 2b), wherein the other section (16a, 16b) partially overlaps with the first section (15), and - to generate and output an image sequence (19) comprising the original image and the subsequent images, characterized bythat the computer program further comprises instructions which, when executed on a computer, cause the computer to output control signals 403, (404) to a tripod (201) movable in six degrees of freedom, which result in no movement in the six degrees of freedom during the acquisition of the original image and the subsequent images and during the generation of the image sequence (19).
Citation Information
Patent Citations
Method of spatial filtering and image capture device
EP1860492B1
Camera and specimen alignment to facilitate large area imaging in microscopy
US20180231752A1
Camera with image sensor shifting
US20190020822A1
Apparatuses, systems, and methods for an enhanced field-of-view imaging system
US20190191110A1
Wide angle HDTV endoscope
US8360964B2
