Rotation guidance of an optical imaging device
By combining cross-channel and peripheral images of a multi-channel optical imaging device, the problem of alignment and focusing difficulties in traditional optical imaging devices is solved, achieving high-quality image capture and smooth video guidance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- OPTOS PLC
- Filing Date
- 2020-07-23
- Publication Date
- 2026-05-08
AI Technical Summary
Traditional single-channel optical imaging devices cannot provide sufficient real-time video feedback during alignment and focusing. In particular, in multi-channel optical imaging devices, a single optical channel cannot provide rotationally symmetrical and coaxial video or images, leading to difficulties in alignment and focusing.
A multi-channel combined imaging method is adopted to generate a composite image by using images of the cross channel area, outer periphery and inner periphery. Real-time video feedback is provided to guide and focus the optical imaging device, and the reflection and illumination of the optical channels are used to align the object.
It achieves high-quality image capture for multi-channel optical imaging devices, and provides smooth video guidance through image synthesis to ensure accurate positioning and focusing of the device.
Smart Images

Figure CN115135229B_ABST
Abstract
Description
Technical Field
[0001] This application generally relates to methods for guiding and aligning optical imaging systems. Background Technology
[0002] Traditional fundus cameras have a single imaging path and provide real-time video from a single sensor that is also used to capture still images. The imaging path is used to provide real-time video during the guidance or alignment phase before image acquisition. For video guidance to be useful, the guidance video should provide the operator with feedback on centering and alignment, as well as image focus and quality.
[0003] The subject matter claimed by this invention is not limited to embodiments that address any drawbacks or operate only in environments such as those described above. Rather, the background art is provided merely to illustrate an exemplary technical field in which some embodiments of the invention described may be practiced. Summary of the Invention
[0004] Example 1 - One or more embodiments of this disclosure may include a method for aligning an imaging device relative to an object. The imaging device includes two or more optical channels. The method may include aligning the two or more optical channels with corresponding overlapping areas of the object, such that the two or more optical channels are positioned at different angles to each other and off-axis relative to the central axis of the imaging device. The method may also include using a composite image created by combining individual images from the two or more optical channels to guide or focus the imaging device relative to the object.
[0005] Example 2 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 1, may further include centering the imaging device using images from the outer and inner peripheries of the optical channel field of view.
[0006] Example 3 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 2, can be used to generate a synthetic image from the outer and inner peripheries.
[0007] Example 4 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the methods in Examples 1-3, where the object to be imaged is an eye, uses corneal reflections generated by illuminating the cornea from two or more light channels to align the imaging device.
[0008] Example 5 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 4, fixes a target between optical channels, the fixed target including a target that enables the eye to focus when imaging the eye.
[0009] Example 6 - According to one or more embodiments of the present disclosure, any method of the present disclosure, such as the methods in Examples 1-5, includes two or more optical channels, including a first optical channel and a second optical channel. The guiding or focusing imaging device further includes illuminating a cross-channel region of the first optical channel through the second optical channel, and capturing a cross-channel image of the cross-channel region of the first optical channel in a separate image through the first optical channel while the second optical channel illuminates the cross-channel region, wherein the cross-channel image is used to generate a composite image.
[0010] Example 7 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 6, may further include illuminating at least one of the outer periphery and inner periphery of the field of view of the first optical channel when the second optical channel illuminates the cross channel region.
[0011] Example 8 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 6 or 7, may further include illuminating a second cross-channel region of a second optical channel through a first optical channel after capturing a cross-channel image. Such a method may also include capturing a second cross-channel image of the second cross-channel region of the second optical channel through a second optical channel while the first optical channel illuminates the second cross-channel region, and using the second cross-channel image to generate a second composite image.
[0012] Example 9 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 8, may further include updating a display that previously showed one or more composite images to a second composite image to create a video on the display.
[0013] Example 10 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 9, may further include repeatedly generating additional composite images and updating a display with the additional composite images, wherein updating the display produces a rotation effect because different regions of the video are updated based on which of the two or more optical channels captures a sub-image to generate the additional composite image.
[0014] Example 11 - According to one or more embodiments of the present disclosure, any method of the present disclosure, such as the methods in Examples 1-10, may further include initial guidance or focusing of the imaging device based on a first composite image representing at least an inner peripheral region of the eye when the imaging device is at a first distance from the eye; secondary guidance based on a second composite image representing at least an outer peripheral region of the eye when the imaging device moves from the first distance to a second distance closer to the eye than the first distance; and final guidance or focusing based on a third composite image representing at least an intersecting channel region of the eye when the imaging device is at a second distance from the eye.
[0015] Example 12 - According to one or more embodiments of the present disclosure, any method of the present disclosure, such as the methods in Examples 1-11, may further include initial guidance based on corneal reflections generated by two or more light channels illuminating the cornea of the eye when the imaging device is at a first distance from the eye; secondary guidance based on a first composite image representing at least the inner and outer peripheral regions of the eye when the imaging device moves from the first distance to a second distance closer to the eye than the first distance; and final guidance or focusing based on a second composite image representing the intersecting channel region and the inner peripheral region of the eye when the imaging device is at a second distance from the eye.
[0016] Example 13 - According to one or more embodiments of the present disclosure, any method of the present disclosure, such as the methods in Examples 1-12, may further include initial guidance or focusing of the imaging device based on a first composite image representing at least a cross-channel region of the eye when the imaging device is at a first distance from the eye; and final guidance or focusing based on a second composite image representing at least a peripheral region of the eye when the imaging device is at a second distance from the eye closer than the first distance.
[0017] Example 14 - According to one or more embodiments of the present disclosure, any method of the present disclosure, such as the methods in Examples 1-13, may further include simultaneously displaying a first sub-combined image representing a cross-channel region of the eye and a second sub-combined image representing a peripheral region of the eye.
[0018] Example 15 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the methods in Examples 1-14, may further include simultaneously displaying a first sub-combined image representing a cross-channel region of the eye and an indirect graphic based on the peripheral region of the eye.
[0019] Example 16 - According to one or more embodiments of this disclosure, any method of this disclosure, such as the method in Example 15, may include at least one of a status bar and dots within a circle in the indirect graphic.
[0020] Example 17 - One or more additional embodiments of this disclosure may include an imaging apparatus. The imaging apparatus may include a first optical channel comprising a first illumination source and a first image capturing device, wherein the first optical channel is disposed at a first off-axis position relative to the central axis of the imaging apparatus. The imaging apparatus may further include a second optical channel comprising a second illumination source and a second image capturing device, wherein the second optical channel is disposed at a second off-axis position relative to the central axis, and the second off-axis position is positioned such that the first and second optical channels point to corresponding overlapping regions aligned with the central axis. The imaging apparatus may further include a display, one or more processors, and one or more non-transitory computer-readable media containing instructions, wherein the instructions, when executed, are configured to operate the imaging apparatus. Operation may include capturing one or more images via the first and second image capturing devices, generating a composite image using the captured images, and displaying the composite image while guiding or focusing the imaging apparatus relative to an object to be imaged.
[0021] Example 18 - According to one or more embodiments of the present disclosure, any imaging device of the present disclosure, such as the imaging device in Example 17, may further include a fixed target located in a first optical channel and a second optical channel, wherein when the eye is the object to be imaged, the fixed target includes a target that enables the eye to focus when imaging the eye.
[0022] Example 19 - According to one or more embodiments of this disclosure, any imaging device of this disclosure, such as the imaging device in Examples 17-18, may further include a third optical channel aligned with a central axis.
[0023] Example 20 - According to one or more embodiments of this disclosure, any imaging device of this disclosure, such as the imaging devices in Examples 17-19, may be guided or focused manually by the user of the imaging device. Attached Figure Description
[0024] Exemplary embodiments will be described and explained with additional features and details using the accompanying drawings, wherein:
[0025] Figure 1 An exemplary embodiment of an optical device is shown;
[0026] Figure 2 An exemplary embodiment of a multi-channel imaging device is shown;
[0027] Figure 3A and Figure 3B An example of a multi-channel imaging device and the field of view of multiple optical channels are shown;
[0028] Figure 4A and 4B An exemplary imaging area of the optical channel is shown;
[0029] Figure 5 An example of an overlapping cross-channel region is shown;
[0030] Figure 6 An example is shown where the outer periphery is illuminated by three light channels;
[0031] Figure 7 An example is shown where the inner periphery is illuminated by three light channels; and
[0032] Figure 8A and 8B An exemplary implementation of aligning an optical imaging device is shown, which uses the reflection generated by illuminating the cornea through a light channel. Detailed Implementation
[0033] This disclosure relates (in particular) to aligning an optical imaging device using images from multiple different optical imaging channels. While cross-channel optical imaging devices eliminate imaging artifacts by using multiple optical channels, none of these channels can provide sufficient video for aligning the device when viewing the same object from different angles. Unlike single-channel optical imaging devices, rotationally symmetric or non-coaxial multi-channel optical imaging devices may not have a single imaging channel aligned along the central axis of the imaging device. Therefore, no single channel can provide a real-time video or single-frame view that is rotationally symmetric and coaxial with the central axis of the device. This disclosure provides a method for aligning an optical imaging device with an image to be captured in a multi-channel imaging device. For example, a composite image can be created from the cross-channel region of the optical channels, where a first optical channel provides illumination and a second optical channel performs imaging; therefore, simultaneous imaging of the first and second channels is undesirable and impossible due to illumination artifacts within the channels. A composite image centered on the central axis of the device can then be created using sequentially captured images that contain but are not centered on the central axis of the device. These composite images can be used to guide and focus the optical imaging device. Peripheral images from the outer and inner peripheries of the optical channel imaging region can be used, alternatively, to provide information for centering the optical imaging device on the object to be imaged. Alternatively, the light reflected from the object to be imaged by the optical imaging channel can be used to guide the optical imaging device. Aligning a multi-channel optical imaging device is not as simple as aligning a single optical channel; rather, by using a composite image of the center of the optical imaging device's field of view, peripheral images of each optical channel, and / or reflections from the object to be imaged by the optical channel, the cross-channel optical imaging device can be guided, aligned, and centered to capture high-quality images.
[0034] To illustrate with an example, when imaging the retina, an optical imaging device comprising multiple optical channels can be placed in front of the patient's eye. The reflections of the optical channels onto the patient's cornea can guide the positioning and / or alignment of the optical imaging device. Images of the outer periphery can provide information about when the optical imaging device clears the patient's pupil. Then, by providing images and / or video details of the macula, a composite image composed of images of the intersecting channel regions of all the optical channels of the optical imaging device is used to guide the device to the fovea or the center of the macula. Simultaneously, images of the inner and / or outer periphery can be used to center the optical imaging device. When the device is positioned at the center of the retina, the optical channels of the optical imaging device can use intersecting channel illumination to capture an image of the retina. In some cases, a fixed target can be located between multiple imaging channels to provide a single point for the eye to focus. Alternatively or concurrently, the illumination of the optical channels can serve as a fixed target for the patient to focus on, so that the patient's eye remains stationary.
[0035] Figure 1 An exemplary optical device 100 with a single optical imaging channel 105 is shown. This optical imaging channel 105 has a field of view 110 that is rotationally symmetrical about a central axis 120 of the optical channel. This optical imaging device 100 provides illumination and captures images through the single optical channel 105. The optical device 100 includes a sensor (not shown) that provides video for aligning the optical device 100 with the object to be imaged. The optical device 100 is aligned with the object to be imaged along the central axis 120 of the optical channel.
[0036] Because the optical device 100 is aligned along the central axis 120 of the optical channel, its ability to capture images may be limited. This alignment makes it easier for the optical device 100 to focus and align, but when capturing an effective eye image, especially with a wider field of view 110 of the optical channel, illumination can interfere with the imaging capability of the optical device 100.
[0037] Figure 2An exemplary multi-channel optical device 200 according to one or more embodiments of the present disclosure is shown. Optical channel A 210 and optical channel B 240 may be positioned at an angle relative to each other and image and / or illuminate different areas of an object or scene 240. Depending on the alignment of optical channels A 210 and B 240, neither optical channel A 210 nor optical channel B 240 is coaxial with the central axis 201 of the device. Thus, neither optical channel A 210 nor optical channel B 240 can individually provide a rotationally symmetric and approximately centered guide image to assist the user in positioning and aligning the device 200. For example, optical channel A 210 may image and / or illuminate area Y 280, while optical channel B 240 may image and / or illuminate area X 260. The operation of optical channels 210 and 240 can be described with reference to optical channel A 210 as an example, and the description also applies to optical channel B 240 and any other additional optical channels (e.g., the multi-channel optical device 200 may include three or more optical channels). Figure 2 As shown, the light channel A 210 can be positioned and aligned along the central axis 220, which can be oriented toward the object or scene 240. The central axis 220 can be offset and / or angled relative to the central axis 201 of the optical imaging device 200, rather than aligned with the central axis 201 of the optical imaging device 200 (e.g., Figure 1 (As shown). Alternatively, due to the offset characteristics of optical channel A 210, region Y 280 may not cover the entire object or scene 270 to be imaged. Therefore, when aligning the optical imaging device 200, the image and video from optical channel A 210 alone may not be sufficient to provide guidance.
[0038] Modifications, additions, or deletions to the optical imaging device 200 may be made without departing from the scope of this disclosure. For example, the optical imaging device 200 may include components that are larger than those described above. Figure 2 The elements shown may be more or fewer than those in the diagram. For example, the optical imaging device 200 may include any number of optical channels. As another example, the optical imaging device 200 may include additional channels coaxial with the device's central axis. As yet another example, the optical imaging device 200 may include channels that are not coaxial with the device's central axis 201 but are not rotationally symmetrical with respect to the device's central axis 201.
[0039] Figure 3A An example of a multi-channel optical imaging device 300 is shown. The multi-channel imaging device 300 may include three optical channels, labeled as imaging path A, imaging path B, and imaging path C. Figure 3BAn example view of an object or scene 301 is shown, which has overlapping fields of view 310, 320, and 330 for three optical channels of a multi-channel optical imaging device, which includes three optical channels. The object or scene 301 can be constructed from... Figure 3A The multi-channel imaging system 300 provides illumination and / or imaging. Each optical channel can be configured to image along its respective central axis. For example... Figure 2 As shown, the central axes of the optical channels can be configured to converge at a point in front of the object. In such a configuration, each optical channel can image an area relative to its own position with respect to the central axis, such as... Figure 2 As shown. Figure 3A The optical channel A in the image can image a field of view of 320. Figure 3B The optical channel B in the image can image a field of view of 330. Figure 3A Optical channel C can image field 310. The optical channels can be configured such that fields 310, 320, and 330 partially overlap. The overlapping area of fields 310, 320, and 330 can represent an intersecting channel region 340. Intersecting channel imaging and illumination can occur in the intersecting channel region 340. For example, optical channel A can capture an image from the intersecting channel region 340, while optical channels B and / or C provide illumination.
[0040] Images captured in the cross-channel area 340 can be combined to create composite images. These composite images can be used to focus the optical imaging device and identify features on the object to be imaged during guidance. The composite images can be used to provide real-time video during alignment. The real-time video can be used to guide the optical imaging device to the area of the object to be imaged.
[0041] For example, in some embodiments, when imaging the retina using an imaging device with three optical channels configured to provide cross-channel illumination, none of the three optical channels are coaxial with the optical axis of the eye. In such an arrangement, the field of view of each optical channel can extend far to the periphery of the retina in one direction, while only slightly beyond the central axis of the eye in the opposite direction. Therefore, when close to the eye, none of the three imaging paths can independently provide sufficient real-time video images of the center or periphery of the retina. However, if the optical channels capture images in a rapid sequence (e.g., A, B, C, A, B…), the images can be combined into a composite image covering the desired field of view. The composite images can be combined to provide guiding video for aligning the optical imaging device.
[0042] When capturing images, the guide video can be updated on the user's monitor (not shown) so that the monitor updates sequentially according to the image order provided by the optical channels. The monitor can continuously update in the same order as the optical channels so that, to the device operator, the images appear to be updated in a rotating cycle. This rotating cycle of image updates creates a rotational effect on the monitor.
[0043] Without departing from the scope of this disclosure, the following can be made: Figure 3A and 3B Modifications, additions, or deletions can be made. For example, fields of view 310, 320, and / or 330 may include […]. Figure 3B The elements shown may have more or fewer elements. For example, the cross-channel region 340 may take any shape depending on the number and / or orientation of the cross-channels to provide illumination and / or to perform imaging.
[0044] Figure 4A and 4B An example of the optical channel field of view 410 and the imaging regions 420, 430, and 440 of the field of view 410 are shown. Field of view 410A can represent the total area on an object imaged by the optical channel. For example, refer to... Figure 2 Field of view 410A can correspond to region Y 280 imaged by optical channel A 210. Field of view 410B can represent Figure 4A The same field of view is shown, but different portions of the field of view 410B are covered by different imaging and / or illumination methods. For example, the field of view 410B can be divided into an intersecting channel region 420, an inner peripheral region 430, and an outer peripheral region 440.
[0045] The cross-channel region 420 can represent the area where the fields of view of the independent optical channels overlap (including field of view 410A). Within the cross-channel region 420, an image can be captured by a first optical channel, and illumination can be provided by a second optical channel and / or other optical channels. For example, if the optical imaging device includes three optical channels, one of which can capture an image in the cross-channel region 420, while the other two optical channels can provide illumination within the cross-channel region 420.
[0046] Other portions of the field of view 410B may include an inner peripheral region 430 and an outer peripheral region 440. In both the inner and outer peripheral regions 430 and 440, the same optical path may or may not provide illumination and image capture. In some embodiments, both the inner and outer peripheral regions 430 and 440 may offer significant advantages in guiding and / or aligning the associated optical imaging device. For example, the outer peripheral region 440 may capture a wider field of view of the object to be imaged, while the inner peripheral region 430 may be more useful when the imaging field of view narrows (e.g., when the imageable portion is blocked by the iris of the eye due to the distance between the optical imaging device and the eye).
[0047] The intersecting channel region 420, the inner periphery 430, and the outer periphery 440 can be imaged simultaneously or individually. For example, in a multi-channel optical imaging device including optical channels A, B, and C, optical channel C can capture an image of the field of view 410B, optical channels A and / or B can illuminate the intersecting channel region 420, and optical channel C can capture an image from the intersecting channel region 420. Simultaneously, optical channels A and / or B can illuminate the inner and / or outer peripheries of their respective fields of view and capture images from their inner and / or outer peripheries, while also illuminating the intersecting channel region 420 of optical channel C. As another example, in a multi-channel optical imaging device including optical channels A, B, and C, optical channels A and / or B can illuminate the intersecting channel region 420, while optical channel C can capture an image from the intersecting channel region 420. Simultaneously, optical channel C can illuminate and capture images within the inner periphery 430 and / or outer periphery 440. Thus, optical channel C can capture images including the cross-channel region 420 and the inner periphery 430 and / or outer periphery 440, while avoiding artifacts in the image caused by effective cross-channel illumination of optical channels A and / or B. In such an example, the entire field of view 410B of a single optical channel can be captured to facilitate alignment and / or guidance of the imaging device. In these and other embodiments, the peripheral illumination of optical channel C does not cause artifacts in the image, nor does the cross-channel illumination of optical channels A and / or B.
[0048] In an exemplary application of retinal imaging, the cross channel region 420 may be illuminated with red or infrared light, which causes less discomfort to the center of the retina than with white light, while the peripheral region may be illuminated with white light (or some other color of light, including red or infrared light).
[0049] Without departing from the scope of this disclosure, modifications, additions, or deletions may be made to the fields of view 410A and / or 410B. For example, the fields of view 410A and / or 410B may include […]. Figure 4A and 4BThe elements shown may have more or fewer elements. For example, the cross-channel region 420 may take any shape depending on the number and / or orientation of the cross-channels to provide illumination and / or to perform imaging.
[0050] Figure 5 An example of a center guide view 510 for a multi-channel optical imaging apparatus comprising three optical channels is shown. The center guide view 510 is formed from a composite image of a portion or all of the intersecting channel regions of the optical channel field of view. The center guide view 510 can be a portion of the optical channel field of view used to guide and focus the optical imaging apparatus. For example, when providing the center guide view 510, certain portions of the image can be discarded, or the entire image can be used. The images of the three optical channels can be combined by stitching, stamping, or other processes to create a composite image. The composite image can be created quickly enough to give a smooth and continuous video feel. For example, each optical channel can capture an image per second, and optical channels A, B, and C can capture images sequentially (e.g., A, B, C, A, B…). The images of the three optical channels can then be stitched together to create a composite image. Three consecutive images from the three optical channels can be combined into a composite image to form a video frame that can run at 15 frames per second, giving a smooth and continuous video feel. This video can then be used to focus and align the optical imaging apparatus and confirm that the apparatus is centered. Although described as a capture rate of 45 images per second and a video running rate of 15 frames per second, any rate can be used. For example, images can be captured at any rate from 10 to 180 frames per second, resulting in video at 5-60 frames per second.
[0051] In some embodiments, when imaging the retina, the composite center-guided view 510 can provide the user with a continuous video of central retinal features (e.g., the optic nerve, macular vessels, etc.). This video can be used to guide the optical imaging device to the center of the retina so as to align the optical imaging device and / or perform manual or autofocus functions based on landmarks (e.g., the optic nerve, macular vessels, etc.) within or near the center of the retina. For such a guiding video, red or infrared light can be used to provide illumination during image capture to avoid the discomfort caused by white light.
[0052] Without departing from the scope of this disclosure, the composite center guide view 510 may be modified, added to, or deleted. For example, the composite center guide view may include more than Figure 5 The elements shown may have more or fewer elements. For example, the composite center guide view 510 may take any shape depending on the number and / or orientation of the intersecting channels to provide illumination and / or to perform imaging.
[0053] Figure 6An example of the outer peripheral region 610 of the field of view 600 of a multi-channel optical imaging device including three optical channels is shown. The combined field of view 600 represents the total combined region visible to all optical channels. The periphery of each optical channel is the area where the same optical channel provides illumination and performs imaging, as opposed to the cross-channel area where different optical channels provide illumination and perform imaging. Optical channels can provide illumination in the cross-channel area and capture images at their periphery; illumination and image capture can be performed sequentially or simultaneously. Thus, for example, if optical channel A provides illumination for optical channel B to image in the cross-channel area, then optical channel A can simultaneously capture images from its outer periphery. The outer peripheral image can be used to center the optical imaging device.
[0054] For example, when imaging the retina, the outer periphery 610 of the optical device can provide images of the three portions of the retina, which can be relatively rotationally symmetrical if the device is centered. This rotational symmetry allows the user of the optical imaging device to properly position the optics at the center of the eye. The three peripheral retinal regions can be displayed to the user in a direct, or modified (e.g., compressed in an eccentric manner relative to the center of the guiding display) or indirect manner (providing the user with a graphic indicating centering based on the three peripheral regions, rather than directly displaying these regions, such as a status bar, a dot within a circle, etc.) manner. In these and other embodiments, image analysis of the images of the peripheral regions can be performed to provide an indication of relative centering when generating indirect graphics.
[0055] The outer periphery 610 can also be used to guide the optical device to an effective working distance for imaging. For example, if the optical imaging device is not close enough to the eye, the outer periphery 610 of the optical device's field of view will not fall into the patient's pupil, and the light on the outer periphery 610 will not enter the eye due to being truncated by the iris. If the light from the outer periphery 610 does not enter the pupil, the image of the outer periphery 610 will be obscured. In some embodiments, the image of the outer periphery 610 of the optical device may not be displayed to the user at scale. For example, the image may be compressed or simplified to simply provide a roughly centered position.
[0056] Without departing from the scope of this disclosure, modifications, additions, or deletions may be made to the outer perimeter 610. For example, the outer perimeter 610 may include components that are larger than those specified in this disclosure. Figure 6 The elements shown may have more or fewer elements. For example, the outer perimeter 610 may take any shape depending on the number and / or orientation of the intersecting channels to provide illumination and / or to perform imaging.
[0057] Figure 7An example of an inner periphery 710 of an optical imaging device comprising three optical channels is shown. The combined field of view 700 represents the total combined area visible to all optical channels. Like the outer periphery of an optical channel, the inner periphery 710 of the optical channels can be imaged and illuminated through the same optical channel. The inner periphery 710 can be used to center the optical imaging device. For example, in imaging the retina, the inner periphery of the three optical channels can image three portions of the retina, and these images can be relatively rotationally symmetrical if the device is centered. Using the inner periphery 710 may be more advantageous for centering than using the outer periphery when the field of view is narrowed, because the inner periphery is closer to the center of the field of view. For example, in imaging the retina, if the patient's pupil is too small to image the outer periphery, or if the device is used in a non-contact manner, thus narrowing the field of view, inner periphery guidance is more useful than outer periphery guidance. In some embodiments, the image of the inner periphery of the optical channels may not be displayed to the user at scale. For example, the image may be compressed or simplified to simply provide a roughly centered position. In some embodiments, the user can select either inner peripheral guidance or outer peripheral guidance. For example, the lighting of the inner and outer peripheral edges can be manually turned on or off, thus allowing the use of one or both of the inner and outer peripheral guidance.
[0058] Modifications, additions, or deletions may be made to the inner periphery 710 without departing from the scope of this disclosure. For example, the inner periphery 710 may include components that are larger than those in the original document. Figure 7 The elements shown may have more or fewer elements. For example, the inner periphery 710 may take any shape depending on the number and / or orientation of the intersecting channels to provide illumination and / or to perform imaging.
[0059] Figure 8A and 8B An example of corneal reflection 830 produced by light channel illumination of the cornea is shown. Figure 8A A side view of the light channel A 810 and light channel B 812 illuminating the eye is given. Figure 8B A front view with a reflective 830 lens is shown. (As shown) Figure 8A and 8B As shown, the configuration of light channels A 810 and B 812 can produce a reflection 830 on the eye 850. The illumination of light channel A can be directed to produce a reflection 830 on the cornea 860, which is visible to light channel A. Light channel A 810 is used as an example; the same description applies to light channel B 812. The illumination can be directed such that the periphery of the reflection 830 is narrow enough not to obscure the center of the field of view, and the center is large enough to produce a long, sharp reflection 830 from the cornea 860. Figure 8B An eye 850 with a reflector 830 having three optical channels is shown. This reflector 830 can provide direct visual feedback through guiding video that helps align the device. For example, when an optical imaging device such as... Figure 8B When properly aligned, the optical channel can be oriented so that reflection 830 is located at a point around pupil 870.
[0060] The illumination of the optical path of the optical imaging device can be oriented so that it produces a long, sharp reflection from the patient's cornea at the effective working distance from the patient's eye. For example (but not limitingly), the effective working distance is the distance as close as possible during image capture and / or the distance as close as possible to the optical imaging device for image capture with minimal additional movement. In some embodiments, the corneal reflection 830 can be used to guide the optical imaging device to the effective working distance and / or center the optical imaging device. The user can move the optical imaging device, use the corneal reflection 830 to guide the optical imaging device, and confirm that the optical imaging device is located at the effective working distance for imaging and is centered on the eye 850.
[0061] In some embodiments, the illumination of the optical channel of the optical imaging device can be positioned such that a corneal reflection 830 occurs during early guidance when the optical imaging device is at a first distance from the eye 850, and subsequently disappears during late guidance when the optical imaging device is brought closer to the eye 850 at a second distance. When the optical device is brought closer to the eye 850 at the second distance, the illumination that caused the corneal reflection 830 at the first distance can illuminate the periphery within the eye 850. In other words, the optical channel can be oriented such that, at the first distance from the eye 850, the peripheral illumination of the optical channel can produce a corneal reflection 830, while at the second distance closer to the eye 850, the peripheral illumination of the optical channel can illuminate the periphery of the optical imaging device, such as... Figure 6 and 7 As shown.
[0062] In one embodiment, light channels A, B, and C can be arranged to produce reflections 830 at three points around the patient's pupil 870. Light channels A, B, and C can capture images and illuminate them sequentially (e.g., A, B, C, A, B...) so that the reflections 830 appear to be rotating, thereby producing a rotational effect visible on a display (not shown) of the optical device.
[0063] Without departing from the scope of this disclosure, modifications, additions, or deletions may be made to the configuration 800 of optical channels 810 and 812. For example, the reflection 830 on the cornea 860 may include a... Figure 8A and 8B The elements shown may have more or fewer components. For example, the reflector 830 may take any shape depending on the number and / or orientation of the intersecting channels to provide illumination and / or to perform imaging.
[0064] In some embodiments, when imaging the eye, a fixed target (not shown) may be placed in the central channel located between the three optical channels. The fixed target may blink or be synchronized with the illumination of the three optical channels. The fixed target may include an optical lens that positions the target at a predetermined distance in front of the emmetropic patient. The fixed target remains visible and is unaffected by the illumination and image capture performed by the three optical channels.
[0065] The advantage of this type of fixed target is that none of the three optical channels need to continuously illuminate the eye, allowing for cross-channel illumination and imaging. If one optical channel continuously illuminates the eye as a fixed target, imaging artifacts may occur on the image of that channel, leading to misalignment or other problems when guiding the imaging device to the position for imaging the eye.
[0066] In some embodiments, when the imaging device is far from the eye, initial guidance can be performed using inner peripheral illumination and an image. Then, when the imaging device is near the eye, guidance and centering are performed using outer peripheral illumination and an image, followed by cross-channel illumination and imaging to achieve focus and centering during final alignment and guidance of the imaging device. As another embodiment, when the imaging device is far from the eye, initial guidance can be performed using the reflection of outer peripheral illumination. Then, when the imaging device is near the eye, guidance is performed using both inner and outer peripheral illumination, followed by final alignment and guidance of the imaging device using both inner peripheral illumination and an image, and cross-channel illumination and an image. As yet another embodiment, in the initial method, approximate positioning, centering, and focusing can be performed using cross-channel images, followed by further centering using outer peripheral illumination before image capture. As yet another embodiment, cross-channel images can be displayed simultaneously with outer peripheral images to allow for approximate visualization and focusing using cross-channel images, and centering confirmation using outer peripheral illumination. As another example of implementation, the cross-channel image can be displayed simultaneously with an indirect graphic representing the peripheral image, allowing for general visualization and focusing using the cross-channel image and centering confirmation using the indirect graphic of the peripheral image.
[0067] In some embodiments, Figure 2 , 3A The multichannel imaging system shown in Figure 8A may include a computing device (not shown). This computing device may be configured to facilitate the performance of operations described herein, such as image capture, light source activation or deactivation, image processing, video playback, etc. This computing device may include a processor, memory, etc., and may communicate with the multichannel imaging system and / or portions thereof.
[0068] Typically, a processor can include any suitable special-purpose or general-purpose computer, computing entity, or processing apparatus comprising various computer hardware or software modules, and can be configured to execute instructions stored in any suitable computer-readable storage medium. For example, a processor can include a microprocessor, microcontroller, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or any other digital or analog circuit configured to interpret and / or execute program instructions and / or process data.
[0069] It should be understood that the processor may include any number of processors distributed across any number of networks or physical locations, configured to perform any number of operations described herein individually or collectively. In some embodiments, the processor may interpret and / or execute program instructions stored in memory and / or process data. By interpreting and / or executing program instructions stored in memory and / or processing data, the apparatus may perform operations, such as those performed by the retinal imaging apparatus described in this disclosure.
[0070] The memory may include a computer-readable storage medium or one or more computer-readable storage media for carrying or having computer-executable instructions or data structures stored thereon. Such a computer-readable storage medium may be any available medium accessible to a general-purpose or special-purpose computer (e.g., a processor). For example (but not limitingly), such a computer-readable storage medium may include non-transitory computer-readable storage media, including random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), read-only optical disc memory (CD-ROM) or other optical disc memory, disk storage or other magnetic storage devices, flash memory devices (e.g., solid-state storage devices), or any other storage medium that can be used to carry or store desired program code in the form of computer-executable instructions or data structures and is accessible to a general-purpose or special-purpose computer. Combinations of the above may also be included within the scope of computer-readable storage media. In these and other embodiments, the term "non-transitory" as used herein should be interpreted to exclude only those types of temporary media found to be outside the scope of the patentable subject matter in the Federal Circuit Court of Appeals in Inre Nuijten, 500F.3d 1346 (Federal Circuit Court of Appeals No. 4007). In some embodiments, a computer-readable storage medium may include, for example, instructions and data configured to cause a processor to perform one or more operations as described in this disclosure.
[0071] As is customary, the various features shown in the drawings are not drawn to scale. The illustrations presented in this disclosure are not intended to be actual representations of any particular device (e.g., apparatus, system, etc.) or method, but merely ideal representations for describing various embodiments of this disclosure. Therefore, the dimensions of various features may be arbitrarily enlarged or reduced for clarity. Furthermore, some drawings may be simplified for clarity. Thus, the drawings may not depict all components of a given device (e.g., apparatus) or all operations of a particular method. For example, dashed lines for illumination and imaging paths do not necessarily reflect an actual optical design, but rather illustrate the concepts of this disclosure.
[0072] The terms used herein, and especially in the appended claims (e.g., the text of the appended claims), generally refer to “open” terms (e.g., the term “comprising” should be understood as “including, but not limited to”, the term “having” should be understood as “having at least”, the term “including” should be understood as “including, but not limited to”, etc.).
[0073] Furthermore, if the specific number of introduced claim entries is intentional, it should be explicitly stated in the claims; otherwise, it makes no sense. For example, to aid understanding, the appended claims may include the use of introductory phrases “at least one” and “one or more” to introduce claim entries. However, even if the same claim includes the introductory phrases “one or more” or “at least one” and the indefinite article “a” or “an” (e.g., “a” or “an” should be understood as “at least one” or “one or more”), the use of such phrases should not be construed as limiting any particular claim containing such an introduction to an embodiment containing only one such entry through the introduction of the indefinite article “a” or “an”. The same applies to definite articles used to introduce claim entries.
[0074] Furthermore, even when a specific number of the introduced claims is explicitly listed, those skilled in the art will recognize that such listing should be understood as referring to at least the number listed (e.g., a simple "two items," without other modifiers, means at least two items, or two or more items). Additionally, in cases similar to "at least one of A, B, and C" or "one or more of A, B, and C," this structure is generally intended to include a single A, a single B, a single C, A and B, A and C, B and C, or A, B, and C together, etc. For example, the term "and / or" is intended to be interpreted in this manner. Furthermore, the terms "about" or "approximately" should be understood as referring to a value within 10% of the actual value.
[0075] Furthermore, any conjunction or phrase presenting two or more alternative terms in the description, claims, or drawings should be understood to imply the possibility of considering one term, either term, or both terms. For example, the phrase "A" or "B" should be understood to include either "A" or "B" or "A and B". However, even if the same claim includes the introductory phrases "one or more" or "at least one" and the indefinite articles "a" or "an" (e.g., "a" or "an" should be understood as "at least one" or "one or more"), the use of such phrases should not be construed as limiting any particular claim containing such an introductory claim to an embodiment containing only one such introductory claim by introducing the indefinite article "a" or "an". The same applies to definite articles used to introduce claim claims.
[0076] Furthermore, the terms "first," "second," "third," etc., are not necessarily used herein to indicate a specific order or quantity of elements. Generally, the terms "first," "second," "third," etc., are used as general identifiers to distinguish different elements. If the terms "first," "second," "third," etc., do not explicitly indicate a specific order, then these terms should not be understood as indicating a specific order. Furthermore, if the terms "first," "second," "third," etc., do not explicitly indicate a specific number of elements, then these terms should not be understood as indicating a specific number of elements. For example, a first component can be described as having a first side, and a second component can be described as having a second side. The use of the term "second side" for the second component is to distinguish this side of the second component from the "first side" of the first component, not to indicate that the second component has two sides.
[0077] All examples and conditional language listed herein are intended for educational purposes to aid the reader's understanding of the invention and the concepts contributed by the inventors to advance the field, and are to be understood as not being limited to these specifically listed examples and conditions. Although embodiments of this disclosure have been described in detail, it should be understood that various changes, substitutions, and modifications can be made therein without departing from the schemes and scope of this disclosure.
Claims
1. A method for aligning an imaging device relative to an eye, the imaging device comprising two or more optical channels, each optical channel comprising an illumination source and an image capturing device, the method comprising: Align the two or more optical channels with the corresponding overlapping area of the eye, positioning the two or more optical channels at different angles relative to each other and off-axis relative to the central axis of the imaging device, wherein the field of view of the two or more optical channels is divided into an intersecting channel region, an inner peripheral region, and an outer peripheral region with different imaging and / or illumination methods; and The imaging device is guided or focused relative to the eye using a composite image created by combining individual images from the two or more optical channels, wherein the imaging device is guided or focused relative to the eye in the following manner: The eye is illuminated at a first distance from the imaging device to produce a reflection. The eye is illuminated at a second distance from the imaging device to the eye, the second distance being shorter than the first distance. When the imaging device is positioned at a first distance from the eye, initial guidance of the imaging device is performed based on the illumination and composite image representing the inner peripheral region of the field of view. Following the initial guidance, as the imaging device moves from the first distance to the second distance, a second guidance of the imaging device is performed based on illumination and a composite image representing the outer peripheral region of the field of view. Following the second guidance, the imaging device is guided a third time based on illumination and a composite image representing the cross-channel region of the field of view, wherein the cross-channel region includes at least one of the overlapping regions.
2. The method of claim 1, further comprising using images of the outer and inner peripheries of the field of view of the optical channel to center the imaging device.
3. The method of claim 2, wherein the images of the outer and inner peripheries are used to generate the composite image.
4. The method of claim 1, wherein the imaging device is aligned using corneal reflections generated by illuminating the cornea with the two or more optical channels.
5. The method of claim 4, wherein a fixed target is located between the optical channels, the fixed target including a target focused by the eye when imaging the eye.
6. The method of claim 1, wherein the two or more optical channels include a first optical channel and a second optical channel, and wherein guiding or focusing the imaging device comprises: The second light channel illuminates the intersection area of the first light channel; as well as When the second light channel illuminates the intersecting channel region, one of the individual images is captured by the first light channel as the intersecting channel image of the intersecting channel region of the first light channel. The cross-channel image is used to generate the composite image.
7. The method of claim 6, further comprising illuminating at least one of the outer periphery and inner periphery of the field of view of the first optical channel when the second optical channel illuminates the cross channel region.
8. The method of claim 6, further comprising: After capturing the cross-channel image, the second cross-channel region of the second light channel is illuminated through the first light channel; When the first light channel illuminates the second cross channel region, the second cross channel image of the second cross channel region of the second light channel is captured through the second light channel; as well as The second composite image is generated using the second cross-channel image.
9. The method of claim 8, further comprising updating a display on which one or more of the composite images were previously displayed to the second composite image to create a video on the display.
10. The method of claim 9, further comprising repeatedly generating additional composite images and updating the display using the additional composite images, wherein updating the display produces a rotation effect because different regions of the video are updated based on which of the two or more optical channels capture sub-images to generate the additional composite images.
11. The method of claim 1, wherein guiding or focusing the imaging device includes simultaneously displaying a first sub-combined image representing an intersecting channel region of the field of view and a second sub-combined image representing an outer peripheral region of the field of view.
12. The method of claim 1, wherein guiding or focusing the imaging device includes simultaneously displaying a first sub-combined image representing an intersecting channel region of the field of view and an indirect graphic based on the outer peripheral region of the field of view.
13. The method of claim 12, wherein the indirect graphics include at least one of a status bar and dots within a circle.
14. A method for aligning an imaging device relative to an eye, the imaging device comprising two or more optical channels, wherein each optical channel includes an illumination source and an image capturing device, the method comprising: Align the two or more optical channels with the corresponding overlapping area of the eye, positioning the two or more optical channels at different angles relative to each other and off-axis relative to the central axis of the imaging device, wherein the field of view of the two or more optical channels is divided into an intersecting channel region, an inner peripheral region, and an outer peripheral region with different imaging and / or illumination methods; and The imaging device is guided or focused relative to the eye using a composite image created by combining individual images from the two or more optical channels, wherein the imaging device is guided or focused relative to the eye in the following manner: The cornea of the eye is illuminated through the two or more light channels at a first distance from the imaging device to the eye to produce corneal reflection. When the imaging device is at a first distance from the eye, initial guidance is performed based on the corneal reflection; As the imaging device moves from a first distance from the eye to a second distance that is closer to the eye than the first distance, it is guided a second time based on a first combined image representing at least the inner and outer peripheral regions of the field of view. as well as When the imaging device is at a second distance from the eye, it performs final guidance or focusing based on a second combined image representing the cross-channel region and the inner peripheral region of the field of view.
15. The method of claim 14, wherein the fixed target is located between the optical channels, the fixed target including a target focused by the eye when imaging the eye.
16. The method of claim 14, wherein the images from the outer peripheral region and the inner peripheral region are used to generate the composite image.
17. The method of claim 14, wherein the guidance or focusing is performed manually by the user of the imaging device.
18. The method of claim 15, wherein the fixed target is illuminated synchronously with the two or more optical channels.
Citation Information
Patent Citations
Apparatus and method for determining a position of an eye
CN101516253A
Hand-held fundus camera
CN109893087A