Eye surgery visualization system

Abstract

An ocular surgery visualization system has an ophthalmoscopic loupe that images a portion located within a patient's eye in an intermediate image plane. An image processing routine separates a first portion of an image of a target region in the imaging plane from a second portion of the image of the target region, the first portion being captured by an image sensor and resulting from an imaging beam path through the ophthalmoscopic loupe, the second portion being captured by the image sensor and resulting from an imaging beam path extending beyond the ophthalmoscopic loupe and being complementary to the first portion, so as to transform the first portion of the image of the target region into a mirror first portion by a congruence corresponding to a rotation of the first portion around an axis of rotation perpendicular to the image plane or by a congruence corresponding to a point mirror, and so as to combine the rotated or point mirror first portion and the second portion to form a target region composite image that is provided to an image display device.

Description

[0001] This application is a divisional application of Chinese Patent Application No. 201811055640.7, filed on September 11, 2018, and entitled “Eye surgery visualization system”. TECHNICAL FIELD

[0002] The present invention relates to an eye surgery visualization system comprising an image sensor, an imaging system for generating an image of a target region in an imaging plane on the image sensor by an optical imaging beam path, a computer unit containing an image processing routine for the image of the target region, said image being captured by the image sensor and having an image plane, and an image display device for visualizing the image data of the image processed in the computer unit. The present invention further relates to an eye surgery visualization system comprising a first image sensor, an imaging system for generating an image of a target region in an imaging plane on the first image sensor by an optical imaging beam path, a second image sensor, a second imaging system for generating an image of a target region in an imaging plane on the second image sensor by an optical imaging beam path, a computer unit containing an image processing routine for processing the image of the target region, which is captured by the first image sensor and has an image plane, and for processing the image of the target region, which is captured by the second image sensor and has an image plane, and an image display device for visualizing the image data of the images of the first and second image sensor processed in the computer unit. Furthermore, the present invention relates to a method for providing image data for visualizing a patient’s eye, and a computer program. BACKGROUND

[0003] From DE 10 2009 030 504 A1 an eye surgery visualization system comprising an image sensor and a computer unit containing an image processing routine for the image of a target region, said image being captured by the image sensor, is known.

[0004] The eye surgery visualization system is used in ophthalmic surgery, for example in the case of a surgical intervention on the posterior of a patient’s eye.

[0005] DE 41 14 646 A1 describes an eye surgery visualization system comprising a surgical microscope having an ophthalmoscopy attachment module arranged below the microscope main objective along the range of the microscope tube. This ophthalmoscopy attachment module comprises one or more ophthalmoscopy magnifiers for producing an inverted image of the fundus of the patient's eye in a first intermediate image plane, i.e. an image which is upside down and back to front. With an optical system for image erecting and pupil interchanging, the image of this first intermediate image plane is erected and imaged correctly laterally into a second intermediate image plane. The observer can see the image of this second intermediate image plane in the eye surgery visualization system through the microscope main objective and a displaceable lens arranged between the microscope main objective and the system for image erecting and pupil interchanging in the ophthalmoscopy attachment module. This ophthalmoscopy attachment module allows the observer to observe a region of interest inside the patient's eye.

[0006] The observer who visually inspects a target region by using an ophthalmoscopy magnifier in an eye surgery visualization system is presented with an image of the target region which has a different orientation in the part within the ophthalmoscopy magnifier and in the part outside the ophthalmoscopy magnifier. Especially in so-called vitreoretinal surgery, as a result of which the part of the target region seen through the ophthalmoscopy magnifier is shown correctly laterally to the observer, while the part of the target region located next to the ophthalmoscopy magnifier does not undergo a correct lateral imaging from the observer's point of view.

[0007] However, it is desirable that the observer can observe the region of the target region located on the side of the ophthalmoscopy magnifier facing away from the microscope tube, as well as the region not perceived through the ophthalmoscopy magnifier, with the same image orientation. This is because this ensures that during an ophthalmic surgery in which the observer inserts an endoscope light guide through a trocar into the patient's eye, the observer does not need to move the light guide in a mirror-symmetrical manner with respect to the observed image. This is because if a part of the patient's eye is not shown correctly laterally to the observer through the ophthalmoscopy magnifier, the observer, i.e. usually the surgeon, perceives the entry of the instrument into the surgical region from the outside to the inside of the patient's eye, i.e. from the edge to the center of the observed image, which is different from the case corresponding to the actual movement of the instrument in the case of a surgical operation using the eye surgery visualization system. SUMMARY

[0008] Against this background, it is an object of the present invention to develop an eye surgery visualization system which facilitates the observation of a target region having a patient's eye part arranged inside the patient's eye independently of the set magnification, while in the process the observed image having an image part with a different image orientation is not visualized.

[0009] This object is achieved by the ophthalmic surgical visualization system as specified hereinafter, and by the method for providing image data for visualizing a patient's eye as specified hereinafter. Advantageous embodiments of the present application are specified in the dependent claims.

[0010] It is proposed in the present application to provide in an ophthalmic surgical visualization system an image sensor and an imaging system for producing an image of a target region in an imaging plane on the image sensor by an optical imaging beam path, and to provide a computer unit comprising an image processing routine for processing an image of the target region, said image being captured by the image sensor and having an image plane. There is an image display device in the ophthalmic surgical visualization system for visualizing image data of the image processed in the computer unit. The ophthalmic surgical visualization system comprises an ophthalmoscopic loupe for imaging a portion located within a patient's eye in an intermediate image plane which is conjugate to the imaging plane on the image sensor. The image processing routine is for separating a first portion of the image of the target region in the imaging plane on the image sensor from a second portion of the image of the target region, said first portion being captured by the image sensor and being produced by an imaging beam path through the ophthalmoscopic loupe, said second portion being captured by the image sensor and being produced by an imaging beam path extending beyond the ophthalmoscopic loupe and being complementary to the first portions, so as to transform the first portions of the image of the target region into mirror first portions by a homomorphism corresponding to a mirror image of the first portions with respect to two mirror axes located within the image plane of the image and perpendicular to each other, and so as to combine the mirror first portions and the second portions complementary to the first portions to form a target region composite image which is provided to the image display device.

[0011] Thus, the portions of the image of the target region which are complementary to each other are to be understood as meaning that they are separated from each other, while in combination they produce an image portion of the image of the target region.

[0012] The eye surgery visualization system according to the present application can also comprise a first image sensor and an imaging system for producing an image of the target region in an imaging plane on the first image sensor through an optical imaging beam path, a second image sensor and a second imaging system for producing an image of the target region in an imaging plane on the second image sensor through an optical imaging beam path, and also a computer unit having an image processing routine for processing the image of the target region, which is captured by the first image sensor and has an image plane, and for the image of the target region, which is captured by the second image sensor and has an image plane. Then, in this eye surgery visualization system there is an image display device for visualizing the image data of the images of the first and second image sensors processed in the computer unit. This eye surgery visualization system according to the present application likewise comprises an ophthalmoscopic loupe for imaging the portion located in the patient's eye in an intermediate image plane conjugate to the imaging plane on the first image sensor and for imaging the portion located in the patient's eye in an intermediate image plane conjugate to the imaging plane on the second image sensor. In the eye surgery visualization system, the image processing routine is for separating a first portion of the respective image of the target region in the imaging plane on the first and second image sensor, which is captured by the first image sensor and the second image sensor, respectively, and which is produced by the imaging beam path through the ophthalmoscopic loupe, from a second portion of the respective image of the target region, which is captured by the image sensors and which is produced by the imaging beam path extending beyond the ophthalmoscopic loupe, respectively, and which is complementary to the first portion, in order to transform the respective first portion of the respective image of the target region into a respectively mirrored first portion by a homothety corresponding to a mirror image of the first portion with respect to two mirror axes located in the image plane of the image and perpendicular to one another, and in order to combine the respectively mirrored first portions and the second portions complementary thereto, respectively, to form a target region composite image provided to the image display device.

[0013] The magnification of the first imaging system and the magnification of the second imaging system can be the same or different.

[0014] According to the application, the first imaging system can be configured to image the target region with a magnification larger than the second imaging system, for example. In this way, the retina of the patient's eye can be imaged on the first image sensor in a format filling manner and an image of the sclera of the patient's eye can be provided to the second image sensor. It is therefore noted that in the case of the eye surgery visualization system according to the application, it can be provided that first stereoscopic partial images of the target region are captured by a plurality of first image sensors and second stereoscopic partial images of the target region are captured by a plurality of second image sensors, wherein the first stereoscopic partial images and the second stereoscopic partial images have different magnifications, and wherein the first stereoscopic partial images and the second stereoscopic partial images are composed to form a stereoscopic overall image which is provided to the image display device.

[0015] In a preferred embodiment of the application, it is provided that the image processing routine comprises an image data evaluation stage which triggers a specialized processing of image data related to a first portion of the image in a retina visualization routine in dependence on the image information in the form of a portion of the retina of the patient's eye, in which the first portion of the image of the target region is transformed into a mirrored first portion by a self- isomorphism corresponding to a mirror image of the first portion with respect to two mirror axes lying in the image plane of the image and being perpendicular to each other, and is output as a retina visualization routine target region image to the image display device. In this way, unnecessary processing of image data in both video streams can be avoided, for example if only the image of the retina of the patient's eye is to be displayed as a target region image.

[0016] The image processing routine in the eye surgery visualization system can comprise an algorithm for identifying the lens edge of the ophthalmoscopic magnifying glass by image processing, which defines the area enclosed by the lens edge of the ophthalmoscopic magnifying glass in the image of the target region as a first portion of the image of the target region produced by the imaging beam path through the ophthalmoscopic magnifying glass.

[0017] The ophthalmoscopic magnifying glass in the eye surgery visualization system is preferably held on an ophthalmoscopic magnifying glass support, which has at least one portion with a characteristic color, wherein the algorithm for identifying the edge of the ophthalmoscopic magnifying glass comprises a color evaluation routine which matches the characteristic color of the at least one portion of the ophthalmoscopic magnifying glass support.

[0018] The preferred embodiment of the present invention provides that the image processing routine comprises an algorithm for identifying the pupil of the patient's eye by image processing and defines the area enclosed by the lens edge of the ophthalmoscopy magnifier in the image of the target area as a first part of the image of the target area produced by the imaging beam path through the ophthalmoscopy magnifier.

[0019] A method for providing image data for visualizing a patient's eye according to the present invention comprises the steps of providing an image of a patient's eye to an image processing routine and processing the image in the image processing routine to form image data. Thus, the image of the patient's eye is captured by at least partly passing through the imaging beam path of an ophthalmoscopy magnifier. Thus, a first part of the image of the target area in the imaging plane on the image sensor is separated from a second part of the image of the target area, said first part being captured by the image sensor and being produced by the imaging beam path passing through the ophthalmoscopy magnifier, said second part being captured by the image sensor and being produced by the imaging beam path path extending outside the ophthalmoscopy magnifier and being complementary to the first parts, wherein the first part of the image of the target area is transformed into a mirror first part by a self- isomorphism corresponding to a mirror image of the first parts with respect to two mirror axes lying in the image plane of the image and being perpendicular to each other and the mirror first parts are combined with the second parts being complementary to the first parts to form image data of a composite image with respect to the target area.

[0020] A computer program according to the present invention comprises program code means for performing the above-mentioned method on a computer unit. BRIEF DESCRIPTION OF DRAWINGS

[0021] Further details of the present invention become apparent from the following description of exemplary embodiments with reference to the accompanying drawings.

[0022] In the drawings:

[0023] Figure 1 A first eye surgery visualization system is shown as well as a patient's eye;

[0024] Figure 2 A patient's eye image captured with an image sensor in an eye surgery visualization system is shown;

[0025] Figure 3 A flow chart of an image processing routine of a computer unit of an eye surgery visualization system is shown;

[0026] Figure 4 A second eye surgery visualization system is shown; and

[0027] Figure 5A third-eye surgery visualization system is shown. Detailed Implementation

[0028] Figure 1 The illustrated first ocular surgical visualization system 10 includes a surgical microscope 12 for stereoscopic observation of a target region 14. The surgical microscope 12 includes an imaging optics unit 16 having a microscope primary objective system 18, which is housed within a body 20. The surgical microscope 12 has an illumination device 22 that facilitates illumination of the target region 14 using an illumination beam path 23 passing through the microscope primary objective system 18. The surgical microscope 12 has a focal amplification system 24 through which a first stereoscopic local observation beam path 26 and a second stereoscopic local observation beam path 28 are guided. The surgical microscope 12 has a binocular tube 30 connected to an interface 29 of the body 20, the binocular tube having a first eyepiece 32 and a second eyepiece 34 for the observer's left eye 35a and right eye 35b. The first stereoscopic local observation beam path 26 and the second stereoscopic local observation beam path 28 traverse the microscope primary objective system 18 within the surgical microscope 12. The surgical microscope 12 includes a first image capturing device 36, which has a first objective lens system 38 and a first image sensor 40. The first image capturing device 36 is used to capture image information from a first stereoscopic local observation beam path 26. A second image capturing device 42 can capture image information from a second stereoscopic local observation beam path 28 within the surgical microscope 12. The second image capturing device 42 has a second objective lens system 44 and includes a second image sensor 46.

[0029] An ophthalmoscopy attachment module 48 is connected to the surgical microscope 12. This ophthalmoscopy attachment module includes an ophthalmoscopy magnifying lens 50 housed within an ophthalmoscopy magnifying lens support 49. The ophthalmoscopy magnifying lens 50 is used to image a portion 52 located inside the patient's eye 54 through the natural lens and its cornea onto an intermediate image plane 56 conjugate to the image plane 58 on the first image sensor 40 and conjugate to the image plane 60 on the second image sensor 46.

[0030] The ophthalmoscopy magnifying lens support 49 is painted green to easily distinguish it from the hue of the patient's eye 54 and the hues of the surgical instruments used during ophthalmic surgery, and to make it easily identifiable in the target area 14. It should be noted that, particularly in alternative embodiments of the invention, the ophthalmoscopy magnifying lens support 49 may also be painted yellow. The ophthalmoscopy magnifying lens support 49 may also have any suitable coloring that allows it to be easily seen in the target area 14 relative to an image background containing bodily fluids (e.g., blood and body tissue, and surgical instruments) during ophthalmic surgery.

[0031] The eye surgery visualization system 10 includes a computer unit 62 containing image processing routines for processing images of a target region 14, which are captured by a first image sensor 40 and a second image sensor 46. The computer unit 62 is connected to a monitor (image display device 64) serving as an image display device for visualizing 3D image information. The computer unit 62 of the eye surgery visualization system 10 can be controlled via a keyboard 66 serving as an input interface.

[0032] It should be noted that in a modified embodiment of the eye surgery visualization system, first and second monitors may also be provided to visualize the 3D image information. Thus, for example, an overview image of the target area can be displayed on the first monitor, and a magnified image of the patient's eye can be displayed on the second monitor.

[0033] Figure 2 An image 68 of the patient's eye in an imaging plane 58, along with an ophthalmoscopy magnifying lens 50 and surgical instruments 59, is shown. The image is captured by a first image capturing device 36. Image 68 has a first portion 70 generated by the imaging beam path passing through the ophthalmoscopy magnifying lens 50, and a second portion 72 complementary to the first portion, generated by the imaging beam path guided through the ophthalmoscopy magnifying lens 50 as it exits the target region 14.

[0034] The technical function of the image processing routine in computer unit 62 firstly includes separating a first portion of an image 68 of a target region 14 in an imaging plane 58 on a first image sensor 40 from a second portion 72 of the image 68 of the target region 14. The first portion is captured by a first image capturing device 36 on the first image sensor 40 and generated by an imaging beam path passing through an ophthalmoscopy magnifying lens 50. The second portion is imaged on the first image sensor 40 and generated by an imaging beam path extending beyond the ophthalmoscopy magnifying lens 50, and is complementary to the first portion 70. Correspondingly, the image processing routine in computer unit 62 is designed to separate the first portion of an image corresponding to the image 68 of the target region 14 in an imaging plane 60 on a second image sensor 46 from the second portion 72 of the image corresponding to the image 68 of the target region 14, i.e., separating the first portion captured by the second image capturing device 42 and generated by an imaging beam path passing through an ophthalmoscopy magnifying lens 50, and the second portion captured by the first image sensor 40 and generated by an imaging beam path extending beyond the ophthalmoscopy magnifying lens 50. of the mirror 50 The imaging beam path outside is generated and is complementary to the first part 70.

[0035] Furthermore, the image processing routine in computer unit 62 functions to perform an image inversion operation on the first portion 70 of the image of target region 14, because the image of the portion 52 arranged inside the patient's eye 54 (which is generated in the intermediate image plane 56 by an ophthalmoscopy magnifying glass 50) is upside down and inverted front to back in the intermediate image plane 56, i.e., inverted. Furthermore, the image processing routine in computer unit 62 functions to combine the first portion 70 of the image of target region 14 with the second portion 72 of the image of target region 14 to form a composite, horizontally correct and upright target image, which can then be displayed on the monitor (image display device 64) of the eye surgery visualization system 10.

[0036] Figure 3 A flowchart 74 of the image processing routine is shown. The image processing routine in the computer unit 62 has an image partial separation stage 76, in which images from the first image sensor 40 and the second image sensor 46 are provided. The image partial separation stage 76 of the image processing routine includes an algorithm for identifying the lens edge of the ophthalmoscopy magnifying glass 50. This algorithm identifies the structure of the ophthalmoscopy magnifying glass support 49 in the images provided to the first image sensor 40 and the second image sensor 46 through image processing. For this purpose, the algorithm in the image partial separation stage 76 includes a color evaluation function that matches the unique color of the ophthalmoscopy magnifying glass support 49.

[0037] The image processing routine includes a filtering stage 78. In filtering stage 78, the image portions of the images captured by the first image sensor 40 and the second image sensor 46 are then convolved through an annular filter 80, wherein the filter center 81 and filter radii r1 and r2 are changed in the captured image, so as to determine a set of image points in the image, which corresponds to the portion of the ophthalmoscopy magnifying lens support 49 surrounding the ophthalmoscopy magnifying lens 50. The inner radius r1 of the annular filter 80 (here, the convolution function takes an extreme value) is then determined as an edge 82 of the ophthalmoscopy magnifying lens 50. Based on the edge 82 of the ophthalmoscopy magnifying lens 50 determined in this way, subsequent steps establish Figure 2 The image of the first portion 70 of the target region 14 shown is used to further refine the first portion 70 in a subsequent step. Figure 2 The second part 72 of the image of the target region 14 shown is separated.

[0038] Next, the first portion 70 of the image of the target region 14, separated from the second portion 72 of the image by the filtering stage 78, is provided to the mirroring stage 84 in the image processing routine. In the mirroring stage 84, the first portion 70 of the images from the first image sensor 40 and the second image sensor 46 is self-morphomorphically transformed into a mirrored first portion 70' by mirroring about two mirror axes 86, 88 located in the image plane of image 68 and perpendicular to each other. It should be understood that, in alternative embodiments, the self-morphism of the mirroring routine can also be implemented as a rotation of the first portion 70 about a rotation axis perpendicular to the image plane. Furthermore, point mirroring can be provided, for example, as such self-morphism.

[0039] Next, the mirrored first portion 70' is passed to the combination stage 90 in the image processing routine. In the combination stage, the mirrored first portion 70' and second portion 72 (the images captured by the first image sensor 40 and the second image sensor 46) of the target region 14 are combined again to form a composite image 68' of the target region. The image data of the composite image is then visualized on a monitor (image display device 64) as a stereoscopic image of the target region 14.

[0040] It should be noted that the image processing routine in the computer unit 62 may include an evaluation phase of image data related to image data captured by the first image sensor 40 or the second image sensor 46, which suppresses processing of the image data provided by the first image sensor 40 or the second image sensor 46 based on the captured image information, such as image information in the form of a portion of the retina of a patient's eye 54.

[0041] It should be noted that, for example, if the sole purpose is to display an image of the retina of the patient's eye 54 as the target region image, unnecessary processing of the image data can be avoided by means of an image processing routine that includes a retinal visualization routine that is triggered based on the captured image information. In this retinal visualization routine, a first portion 70 of the corresponding image of the target region 14 is converted into a mirrored first portion by an automorphism corresponding to the mirror image of the first portion with respect to two mirror axes that are perpendicular to each other and located in the image plane of the image. This mirrored first portion is then output as the target region image of the retinal visualization routine to an image display device in the form of a monitor (image display device 64).

[0042] Figure 4A second ophthalmic surgery visualization system 10' is shown. Components and elements in the ophthalmic surgery visualization system 10' are denoted by the same numbers as those in the aforementioned ophthalmic surgery visualization system 10. The ophthalmic surgery visualization system 10' includes a device for reflecting data 92 onto the endoscope surface. This device is connected to the computer unit 62 and facilitates the display of information overlaid on the image of the target region 14 in the first and second stereoscopic local observation beam paths 26, 28, which can be perceived within the binocular tube 30.

[0043] Figure 5 A third ophthalmic surgical visualization system 10” is shown. To the extent that the components and elements in the ophthalmic surgical visualization system 10” correspond to those in the aforementioned ophthalmic surgical visualization system 10, these components and elements are indicated by the same numerals as reference numerals. Unlike the surgical microscope 12 of ophthalmic surgical visualization systems 10 and 10’, the surgical microscope 12 of ophthalmic surgical visualization system 10” is a purely digital surgical microscope used to stereoscopically capture the target region 14 via a first image sensor 40 and a second image sensor 46.

[0044] Like the computer unit 62 of the first ocular surgical visualization system 10, the computer units 62 of the second and third ocular surgical visualization systems 10' and 10'' contain image processing routines for processing images of target regions captured by the first image sensor 40 and the second image sensor 46. These image processing routines have the features described above based on... Figure 3 The described functionality.

[0045] In summary, particular attention should be paid to the following preferred features of the present invention: the ophthalmic surgery visualization system 10 includes a first image sensor 40, a second image sensor 46, and an imaging system for generating an image 68 of a target region 14 in imaging planes 58 and 60 on the first image sensor 40 and the second image sensor 46 via an optical imaging beam path. The ophthalmic surgery visualization system 10 includes: a computer unit 62 containing an image processing routine for the image 68 of the target region 14, said image being captured by the second image sensor 46 and having an image plane; and an image display device 64 for visualizing the image data of the image 68 processed in the computer unit 62. According to the present invention, the ophthalmic surgery visualization system 10, 10', 10" has an ophthalmoscopy magnifying lens 50 for imaging a portion 52 located within the patient's eye 54 onto an intermediate image plane 56 conjugate to the imaging planes 58, 60 on the first image sensor 40 and the second image sensor 46. The image processing routine is used to separate a first portion 70 of an image 68 of a target region 14 captured by the first image sensor 40 and the second image sensor 46 and transmitted through the ophthalmoscopy magnifying lens 50. The second part, generated by the imaging beam path, is captured by the first image sensor 40 and the second image sensor 46 and is generated by the imaging beam path extending beyond the ophthalmoscopy magnifying glass 50, and is complementary to the first part, so as to transform the first part 70 of the image 68 of the target region 14 into a mirror first part 70' by automorphism corresponding to the mirror of the first part 70 with respect to two mirror axes 86, 88 located in the image plane of the image 68 and perpendicular to each other, and so as to combine the mirror first part 70' and the second part 72 of the image 68 that is complementary to the first part 70 to form a composite image of the target region provided to the image display device.

[0046] List of reference signs

[0047] 10, 10', 10” Eye Surgery Visualization System

[0048] 12. Surgical microscope

[0049] 14 Target Area

[0050] 16 Imaging Optical Units

[0051] 18. Microscope primary objective system

[0052] 20 main bodies

[0053] 22 lighting fixtures

[0054] 23 Illumination beam path

[0055] 24. Focusless Amplification System

[0056] 26 First stereoscopic partial observation beam path

[0057] 28 Second stereoscopic partial observation beam path

[0058] 29 Interface

[0059] 30 Binocular tubes

[0060] 32 First eyepiece

[0061] 34 Second eyepiece

[0062] 35a Left eye

[0063] 35b Right eye

[0064] 36 First image capturing device

[0065] 38 First Objective System

[0066] 40 First Image Sensor

[0067] 42 Second image capturing device

[0068] 44 Second Objective System

[0069] 46 Second Image Sensor

[0070] 48 Ophthalmoscopy Attachment Module

[0071] 49. Ophthalmoscopy magnifying glass support

[0072] 50 Ophthalmoscope Magnifying Glass

[0073] 52 parts

[0074] 54 patients' eyes

[0075] 56 Intermediate Image Plane

[0076] 58 Imaging plane

[0077] 59 Surgical Instruments

[0078] 60 Imaging plane

[0079] 62 Computer Units

[0080] 64. Image display device (monitor)

[0081] 66-keyboard

[0082] 68 images

[0083] 68' Composite image of the target region

[0084] 70 Part 1

[0085] 70' Mirror Image Part 1

[0086] 72 Part Two

[0087] 74 Flowchart

[0088] 76 Image Partial Separation Stage

[0089] 78 Filtering Stage

[0090] 80 Ring Filter

[0091] 81 Filter Center

[0092] 82 Edge

[0093] 84 Mirror Phase

[0094] 86, 88 Mirror Axis

[0095] 90 Combination Stage

[0096] 92. Data on reflection from the inner mirror surface

[0097] r1, r2 filter radii

Claims

1. An ocular surgery visualization system (10, 10', 10"), comprising: Image sensor (40, 46); An imaging system for generating an image (68) of a target region (14) in an imaging plane (58, 60) on an image sensor (40, 46) via an optical imaging beam path; a computer unit (62) comprising an image processing routine for processing the image (68) of the target region (14), the image being captured by the image sensor (40, 46) and having an image plane; and an image display device (64) for visualizing image data of the image processed in the computer unit (62). Its features are, An ophthalmoscopy magnifying lens (50) is used to image a portion (52) located within a patient's eye (54) onto an intermediate image plane (56) conjugate to the imaging plane (58, 60) on the image sensor (40, 46), wherein the image processing routine is used to separate a first portion (70) of an image (68) of the target region (14) on the imaging plane (58, 60) on the image sensor (40, 46) from a second portion (72) of the image (68) of the target region (14), the first portion being captured by the image sensor (40, 46) and generated by an imaging beam path passing through the ophthalmoscopy magnifying lens (50), the second portion... The images (70) are captured by the image sensor (40, 46) and generated by an imaging beam path extending beyond the ophthalmoscopic magnifying glass (50), and are complementary to these first portions (70) so that these first portions (70) of the image (68) of the target region (14) are transformed into mirror first portions (70') by automorphism corresponding to rotation of the first portions (70) about a rotation axis perpendicular to the image plane or by automorphism corresponding to dot mirroring, and so that these rotated or dot mirror first portions (70') and these second portions (72) complementary to these first portions (70) are combined to form a composite image (68') of the target region provided to the image display device (64).

2. The eye surgery visualization system according to claim 1, characterized in that, The image processing routine includes an image data evaluation phase that triggers specialized processing of image data associated with these first portions (70) of the image (68) in a retinal visualization routine based on image information in the form of a portion of the retina of the patient's eye (54). In this retinal visualization routine, these first portions (70) of the image (68) of the target region (14) are transformed into mirrored first portions (70') by automorphism corresponding to rotation of the first portions (70) about a rotation axis perpendicular to the image plane or by automorphism corresponding to point mirroring, and are output to the image display device (64) as the target region image of the retinal visualization routine.

3. An ocular surgery visualization system (10, 10', 10"), comprising: First image sensor (40); A first imaging system for generating an image (68) of a target region (14) in an imaging plane (58, 60) on a first image sensor (40) via an optical imaging beam path; a computer unit (62) comprising an image processing routine for processing the image (68) of the target region (14), the image being captured by the first image sensor (40) and having an image plane; and an image display device (64) for visualizing the image data of the image (68) of the first image sensor (40) processed in the computer unit (62). Its features are, A second image sensor (46) and a second imaging system, the second imaging system being used to generate an image (68) of a target region (14) in an imaging plane (58, 60) on the second image sensor (46) via an optical imaging beam path, wherein the image processing routine in the computer unit is also designed to process the image (68) of the target region (14), the image being captured by the second image sensor (46), and The image display device (64) is also designed to visualize the image data (68) of the second image sensor (46) processed by the computer unit (62). An ophthalmoscopy magnifying lens (50) is used to image a portion (52) located within a patient's eye (54) onto an intermediate image plane (56) conjugate to an image plane (58) on a first image sensor (40), and to image a portion (52) located within a patient's eye (54) onto an intermediate image plane (56) conjugate to an image plane (60) on a second image sensor (46). The image processing routine is used to separate a first portion (70) of the corresponding image of the target region (14) in the image planes (58, 60) on the first and second image sensors (40, 46) from a second portion (72) of the corresponding image (68) of the target region (14), the first portion being captured by the first image sensor (40) and the second image sensor (46) and being respectively... The second portion is generated by the imaging beam path passing through the ophthalmoscopy magnifying lens (50), and is captured by the first and second image sensors (40, 46) and correspondingly generated by the imaging beam path extending beyond the ophthalmoscopy magnifying lens (50), and is complementary to these first portions (70), so that the corresponding first portion (70) of the image (68) of the target region (14) is transformed into a correspondingly mirrored first portion (70') by an automorphism corresponding to the rotation of the first portion (70) about a rotation axis perpendicular to the image plane or by an automorphism corresponding to a dot mirror, and so that these rotated or dot mirrored first portions (70') and their complementary second portions (72) are combined accordingly to form a composite image (68') of the target region provided to the image display device (64).

4. The eye surgery visualization system according to claim 3, characterized in that, The image processing routine includes an image data evaluation phase that triggers specialized processing of image data associated with these first portions (70) of the corresponding image (68) of the target region (14) in the retinal visualization routine based on image information in the form of a portion of the retina of the patient's eye (54). In the retinal visualization routine, these first portions (70) of the corresponding image (68) of the target region (14) are transformed into mirrored first portions (70') by automorphism corresponding to rotation of the first portions (70) about a rotation axis perpendicular to the image plane or by automorphism corresponding to point mirroring, and are then output to the image display device (64) as the target region image of the corresponding retinal visualization routine.

5. The visual system for eye surgery according to claim 4, characterized in that, The first imaging system images the target region (14) at a greater magnification than the second imaging system.

6. The ocular surgery visualization system according to any one of claims 3 to 5, characterized in that, The first image sensor (40) is used to capture a first stereoscopic partial image of the target area (14) and the second image sensor (46) is used to capture a second stereoscopic partial image of the target area (14), and the image display device (64) is designed to make stereoscopic visualization of the image data (68) of the first image sensor (40) and the second image sensor (46) processed in the computer unit (62).

7. The ocular surgery visualization system according to any one of claims 1 to 5, characterized in that, The image processing routine includes an algorithm for identifying the lens edge of the ophthalmoscopy magnifying lens (50) by image processing, and defines the area enclosed by the edge (82) of the ophthalmoscopy magnifying lens (50) in the image (68) of the target region (14) as a first part of the image (68) of the target region (14) generated by the imaging beam path passing through the ophthalmoscopy magnifying lens (50).

8. The ophthalmic surgery visualization system according to claim 7, characterized in that, The ophthalmoscopy magnifying glass (50) is held on the ophthalmoscopy magnifying glass support (49), and the algorithm for identifying the edge (82) of the ophthalmoscopy magnifying glass (50) includes a color evaluation routine that matches the characteristic color of at least one part of the ophthalmoscopy magnifying glass support (49).

9. The visual system for eye surgery according to any one of claims 1 to 5, characterized in that, The image processing routine includes an algorithm for identifying the pupil of the patient's eye (54) through image processing, and defines the area enclosed by the lens edge of the ophthalmoscopy magnifying lens (50) in the image (68) of the target region (14) as a first part of the image (68) of the target region (14) generated by the imaging beam path passing through the ophthalmoscopy magnifying lens (50).

10. The ophthalmic surgery visualization system according to claim 1 or 2, characterized in that, The image processing routine includes a filtering stage (78) in which a portion of the image captured by the image sensor is convolved by an annular filter (80), wherein the filter center (81) and filter radii r1 and r2 are changed in the captured image so as to determine a set of image points in the image, the set corresponding to the portion of the ophthalmoscopy magnifying glass support (49) for holding the ophthalmoscopy magnifying glass around the ophthalmoscopy magnifying glass (50), wherein, based on the edge (82) of the ophthalmoscopy magnifying glass (50) determined in this way, the region of the first portion (70) of the image of the target region (14) is established in a subsequent step so as to separate these first portions (70) from the region of the second portion (72) of the image of the target region (14).

11. The ocular surgery visualization system according to claim 3 or 5, characterized in that, The image processing routine includes a filtering stage (78) in which an image portion of the image captured by the first image sensor is convolved by an annular filter (80), wherein the filter center (81) and filter radii r1 and r2 are changed in the captured image so as to determine a set of image points in the image, the set corresponding to the portion of the ophthalmoscopy magnifying glass support (49) for holding the ophthalmoscopy magnifying glass around the ophthalmoscopy magnifying glass (50), wherein, based on the edge (82) of the ophthalmoscopy magnifying glass (50) determined in this way, the region of the first portion (70) of the image of the target region (14) is established in a subsequent step so as to separate these first portions (70) from the region of the second portion (72) of the image of the target region (14).

12. The ophthalmic surgery visualization system according to claim 1 or 2, characterized in that, An apparatus for observing the beam path and the data (92) reflected from the inner mirror surface, the apparatus being connected to a computer unit (62) and adapted to display information on the image overlaid on the target area (14) in the observed beam path (26, 28).

13. The ophthalmic surgery visualization system according to claim 1 or 2, characterized in that, A device for first and second observation beam paths and inward mirror reflection data (92), the device being connected to a computer unit (62) and adapted to display information on the image overlaid on the target area (14) in the first and second observation beam paths (26, 28).

14. A method for providing image data to visualize a patient's eye (54), comprising the following steps: The image (68) of the patient's eye (54) is provided to the image processing routine; and The image is processed in the image processing routine (68) to form image data. Its features are, An image (68) of the patient's eye (54) is captured by at least partially passing through the imaging beam path of the ophthalmoscopy magnifying lens (50), and The first portion (70) of the captured image (68) of the target region (14) is separated from the second portion (72) of the image (68) of the target region (14), the first portion being generated by an imaging beam path passing through the ophthalmoscopy magnifying lens (50), and the second portion being generated by an imaging beam path extending beyond the ophthalmoscopy magnifying lens (50) and complementary to these first portions (70). These first portions (70) of the image (68) of the target region (14) are transformed into mirrored first portions (70') by automorphism corresponding to rotation of the first portions (70) about a rotation axis perpendicular to the image plane or by automorphism corresponding to point mirroring, and these rotated or point mirrored first portions (70') are combined with these second portions (72) complementary to these first portions (70) to form image data of the composite image (68') of the target region.

15. A computer-readable storage medium having program code tools for executing the method of claim 14 on a computer unit (62).

Images