Apparatuses, systems, and methods for simulating vision before and after cataract surgery using augmented reality

Abstract

Aspects of the disclosure include a cataract simulation device for simulating a plurality of visions or images before and / or after cataract surgery by using Augmented Reality. The simulated visions or images may be utilized to display to a user how the user's vision would appear when certain types of lenses are implanted in the patient's eye, or how the user's vision would be with certain types of optical conditions such as cataracts. The simulated visions or images may be utilized to better assess the vision of the user following implantation of such lenses following cataract surgery.

Description

APPARATUSES, SYSTEMS, AND METHODS FOR SIMULATING VISION BEFORE AND AFTER CATARACT SURGERY USING AUGMENTED REALITYBACKGROUND

[0001] Cataracts is a common malady that affects large numbers of individuals every year. Common methods to treat cataracts include removal of the diseased natural eye lens and replacement of the natural eye lens with a prosthetic lens (or intraocular lens (IOL)).

[0002] The implanted prosthetic lenses may have optical characteristics that attempt to wholly or partially address the eyesight needs of the patient. For example, prosthetic lenses for implantation may not only have improved optical clarity (e.g., as compared to the clouded natural lens) but may also provide improved eyesight for the patient as compared to the patient’s natural eyesight.

[0003] Prosthetic lenses may include multiple different types of lenses, which may include single focus or monofocal lenses, and multifocal lenses. A patient may be implanted with either single focus or multifocal lenses, or combinations thereof, to provide for a desired type of eyesight for the patient.

[0004] It may be difficult, however, for a patient or the patient’s physician to fully assess the impact that implantation of certain types of lenses would have on the patient. For example, a patient may not fully realize the impact that a multifocal lens may have at nighttime with artificial light sources, as opposed to how the patient’s eyesight would function at daytime. Improvements in apparatuses, methods, and systems for simulating vision or images are desired.SUMMARY

[0005] Aspects of this disclosure are directed to a cataract simulation device for simulating a plurality of visions or images before and / or after cataract surgery by using Augmented Reality. The simulated visions or images may be utilized to display to a user (e.g., a prospective or actual patient or other type of user) how the user’s vision would appear when certain types of lenses are implanted in the patient’s eye, or how the user’s vision would be with certain types of optical conditions such as cataracts. The simulated visions or images may be utilized to better assess the vision of the user following implantation of such lenses following cataract surgery in examples.

[0006] Various parameter sets may be utilized to simulate the appearance of the plurality of visions or images for different types of lenses or optical conditions (such as cataracts). Theparameter sets may each be dedicated for a certain type of lens (or optical condition) and applied to images captured by a camera to simulate the resulting vision. The resulting vision may be produced on a display for evaluation by the user (or the user’s physician).

[0007] Beneficially, the parameter sets may be tailored to produce different optical effects for each lens type, with differentiations made between simulations in daytime and nighttime in examples. Such features may provide for an improved and realistic assessment of resulting vision for the user (or for the user’s physician).

[0008] In examples, a cataract simulation device is disclosed for simulating a plurality of visions or images before and after cataract surgery by using Augmented Reality, the device comprising: at least one camera for capturing images of the surroundings of the device; a processor for generating vision data based on the images captured by the at least one camera and a plurality of predetermined parameters; a display for selectably displaying the plurality of visions or images based on the vision data generated by the processor; and a touch panel for selecting the plurality of visions or images, wherein the plurality of visions or images after cataract surgery are based on: a first single focus parameter set for defining a first range of a first depth of focus; a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.

[0009] In examples, a non-transitory computer program product is disclosed, comprising instructions which, when the non-transitory computer program product is executed by a computing device, cause the computing device to carry out a method comprising: generating vision data based on images captured by at least one camera and a plurality of predetermined parameters; and selectably displaying, on a display, a plurality of visions or images based on the generated vision data, the plurality of visions or images comprising Augmented Reality that simulates visions or images after cataract surgery, and wherein the plurality of visions or images are based on: a first single focus parameter set for defining a first range of a first depth of focus; a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytimerange of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.

[0010] In examples, a computer-implemented method for simulating a plurality of visions or images after cataract surgery by using Augmented Reality is disclosed, the method comprising: generating vision data based on images captured by at least one camera and a plurality of predetermined parameters; and selectably displaying, on a display, a plurality of visions or images based on the generated vision data, the plurality of visions or images comprising Augmented Reality that simulates visions or images after cataract surgery, and wherein the plurality of visions or images are based on: a first single focus parameter set for defining a first range of a first depth of focus; a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and further aspects of this disclosure are further discussed with reference to the following description in conjunction with the accompanying drawings, in which like numerals indicate like elements and features in various figures. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating principles of the disclosure. The figures depict one or more implementations of the disclosure, by way of example only, not by way of limitation.

[0012] FIG. 1 is schematic view of a system according to example herein.

[0013] FIG. 2A is a front perspective view of a mobile computing device.

[0014] FIG. 2B is a rear perspective view of the mobile computing device shown in FIG. 2A.

[0015] FIG. 3 is a schematic view of a computing device according to examples herein.

[0016] FIG. 4 is a representation of a display of a mobile computing device.

[0017] FIG. 5 is a representation of a display of a mobile computing device.

[0018] FIG. 6 is a representation of a display of a mobile computing device.

[0019] FIG. 7 is a representation of a display of a mobile computing device.

[0020] FIG. 8 is a representation of a display of a mobile computing device.

[0021] FIG. 9 is a representation of a display of a mobile computing device.DETAILED DESCRIPTION

[0022] Although examples of the disclosed technology are explained in detail herein, it is to be understood that other examples are contemplated. Accordingly, it is not intended that the disclosed technology be limited in its scope to the details of construction or arrangement of components or features set forth in the following description or illustrated in the drawings. The disclosed technology is capable of other examples and / or of being practiced or carried out in various ways.

[0023] FIG. 1 illustrates a representation of an exemplary system according to examples herein. FIG. 1 illustrates use of a device 10 for simulating a plurality of visions or images before and / or after cataract surgery by using Augmented Reality (AR). The device 10 as shown in FIG. 1 comprises a mobile computing device, which may comprise a mobile phone (e.g., a smartphone), or a tablet computer, a laptop, or other form of mobile computing device. The device 10 may include at least one camera 12 for capturing images of the surroundings of the device 10. The device 10 may include a display 14 (as shown in FIG. 2A) for displaying the images captured by the camera 12.

[0024] The device 10 may comprise a cataract simulation device that may be utilized by a user to simulate a plurality of visions or images before and / or after cataract surgery by using Augmented Reality (AR). A user (represented by the eye 16 shown in FIG. 1) may position the camera 12 to view the surroundings 18 of the device 10 or a scene for view by the camera 12 of the device 10. The surroundings 18, for example, may comprise a near field region 20 (represented, for example, by a book or text for reading shown in FIG. 1) and a far field region 22 (represented, for example, by a tree or other distant object shown in FIG. 1). The device 10 may be configured to capture the images of the surroundings 18 by the camera 12 and modify the images to produce a plurality of visions or images for display on the display 14 to represent the appearance of the surroundings 18 before and / or after cataract surgery.

[0025] The user, for example, may have cataracts or may be concerned about potentially developing cataracts. The user may be interested in optics that may replace the user’s natural eye lens as a result of cataract surgery. The user may also be interested in optics that may supplement or modify current vision for a variety of other conditions or ailments, or simply be interested in use of a lens such as an intraocular lens. The user, however, may be uncertain of the vision or optical effects that may result from the use of the intraocular lens. Intraocular lenses, for example,may be provided in a variety of types, which may include single focus intraocular lenses (e.g., near focus or far focus), or may comprise multi-focus intraocular lenses that provide a plurality of focuses (which may be near and / or far focuses). The user, however, may be unable to anticipate or contemplate the optical effects of an intraocular lens upon implantation.

[0026] The device 10, however, may be utilized to simulate a plurality of visions or images before cataract surgery and also a resulting plurality of visions or images after cataract surgery and upon implantation of one or more types of lenses (e.g., intraocular lenses) by using Augmented Reality (AR). The device 10 may display the resulting visions or images to a user upon the display 14. The resulting visions or images may be displayed as AR, such that the user may control and move the camera 12 to view the surroundings 18 as they would appear with cataracts or upon implantation of one or more types of lenses. Such a feature may beneficially allow the user to view surroundings that the user may commonly or more naturally encounter, to determine how such surroundings would appear with cataracts or with one or more types of lenses implanted. The user may be more easily able to ascertain if implantation of a certain type of intraocular lens would be desirable and / or how the implantation of that type of lens would impact their vision in relation to certain types of surroundings.

[0027] For example, a user may be able to produce AR images of their office or home, to determine how such commonly encountered areas would appear with cataracts or with the one or more types of lenses implanted. The user may be able to ascertain based on the AR images whether a certain type of intraocular lens would be desirable and / or how the implantation of that type of lens would impact their vision in relation to those kinds of surroundings. Other areas (e.g., daytime or nighttime driving) may similarly be evaluated by a user. The resulting experience of the user may be utilized to select and implant a particular type of intraocular lens by a physician.

[0028] FIG. 2 A illustrates a front perspective view of the device 10 illustrating the display 14 for view by a user. The device 10 may further incorporate a touch panel 24 with the display 14 that may be utilized for selections by the user. Additional input devices (e.g., one or more buttons 26 or other types of input devices) may be utilized as desired.

[0029] FIG. 2B illustrates a rear perspective view of the device 10 illustrating the at least one camera 12. In examples, the device 10 may be a handheld device, although other forms of devices may be utilized in examples.

[0030] FIG. 3 illustrates components of the device 10 that may be utilized in examples herein. The camera 12, touch panel 24, and display 14 are illustrated in FIG. 3. The device 10 may include a processor 28 that may be utilized to perform the processes or methods disclosed herein. The processor 28 may be in communication with a memory 30 that may store programs, instructions, or data for use or execution by the processor 28. The processor 28 may be in communication with the camera 12, touch panel 24, and display 14.

[0031] The memory 30 may comprise one or more memory components, such as RAM, ROM, flash, or other forms of memory components. Other forms of memory may be utilized. The memory 30 may comprise non-transitory memory. The memory 30 may be utilized to store a computer program product comprising instructions for execution by the processor 28 and may be utilized to store parameters or sets of parameters for use by the processor 28. The computer program product may be built using an Integrated Development Environment (IDE) such as Unity, Xcode, Visual Studio, or Android Studio. The parameters or sets of parameters may be provided as a part of the computer program product. In the examples, the parameter or set of parameters is configured under the Unity platform. However, other parameters or sets of parameters corresponding to those of the Unity platform may be configured under other IDE such as Xcode, Visual Studio, or Android Studio. The memory 30 may comprise the memory of a mobile computing device, such as the memory of a mobile phone (e.g., a smartphone), or a tablet computer, a laptop, or other form of mobile computing device.

[0032] The processor 28 may comprise one or more processors, such as central processing units (CPUs) for performing the processes or methods disclosed herein. The processor 28 may operate according to instructions stored in the memory 30. The processor 28 may receive data from the camera 12 and / or the touch panel 24 and may produce visions or images on the display 14 based on such data.

[0033] The processor 28, for example, may be configured to generate vision data based on the images captured by the at least one camera 12 and a plurality of predetermined parameters. The images captured by the at least one camera 12 may comprise the images of the surroundings 18 produced by the at least one camera 12. The plurality of predetermined parameters may comprise parameters utilized to modify the images with the processor 28.

[0034] The plurality of predetermined parameters may be grouped into sets corresponding to which type of vision the processor 28 is intended to produce or replicate. The groupings maycorrespond to an optical condition (e.g., cataracts) or may correspond to a type of lens (e.g., intraocular lens) to be utilized. For example, five groupings or sets may be utilized in examples (although a greater or lesser number of groupings may be utilized in examples).

[0035] A grouping or set, for example, may comprise a cataract parameter set for defining cataract symptoms. A grouping or set, for example, may comprise a first single focus parameter set for defining a first range of a first depth of focus. A grouping or set, for example, may comprise a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus. A grouping or set, for example, may comprise a first multi-focus parameter set. The first multi-focus parameter set may define a daytime range of optical effects such as a plurality of depth of focus, glare, and halo. A grouping or set, for example, may comprise a second multi-focus parameter set. The second multi-focus parameter set may define a nighttime range of optical effects such as a plurality of depth of focus, glare, and halo. A greater or lesser number of groupings or sets may be utilized in examples.

[0036] Each grouping or set may be utilized by the processor 28 to produce the corresponding vision data for that grouping or set. As such, visions or images may be produced corresponding to that particular type of grouping or set. The user may select the particular type of grouping or set (e.g., a type of lens or a type of optical condition) to view the corresponding visions or images on the display 14 in Augmented Reality (AR).

[0037] The parameters of the sets may be set to simulate the optical effects of the corresponding type of lens or type of optical condition. Exemplary parameters that may be utilized may be provided in four main groups (although lesser or a greater number of groups may be utilized). The four main groups may comprise depth of focus (DoF), glare, halo, and color blit.

[0038] The DoF parameters may be applied to produce blur to objects at different distances from the camera 12. The DoF parameters may further include parameters or components of blur strength, focus distance, outer distance, inner distance, and contrast. Blur strength may comprise the strength of a blur effect. The blur may be stronger if the parameter value for blur strength is high. An exemplary parameter range for blur strength, for example, may be between 0 and 10 in a scaling used herein. Focus distance may comprise the distance from the camera that has a specified focus value. Objects, for example, may become blurrier the further away they are from such focus distance. An exemplary parameter range for focus distance, for example, may be between 0 and 20 in a scaling used herein. Outer distance may comprise the maximum distancefrom the focus distance for blur. Blur may gradually increase from the focus distance, with the blur reaching a maximum at and after the outer distance. An exemplary parameter range for outer distance, for example, may be between 0 and 20 in a scaling used herein. Inner distance may refer to the clear visible range from the focus distance. An exemplary parameter range for inner distance, for example, may be between 0 and 20 in a scaling used herein. Contrast may refer to the difference in visual properties between elements, such as colors, textures, or ideas. It is used to create visual interest and to highlight the differences between various components. An exemplary parameter range for contrast, for example, may be between 0 and 20 in a scaling used herein.

[0039] Parameters, for example, may comprise glare. The glare parameters may be applied to produce a dynamic and immersive visual effect that simulates intense brightness or reflections. The glare parameters may further include parameters or components of threshold, power, iteration, and sub iteration. Threshold may comprise a threshold value that the glare will react with. Glare, for example, may only react with strong light if the value is high, and may react with both weak and strong light if the value is low. An exemplary parameter range for threshold, for example, may be between 0 and 1 in a scaling used herein. Power may comprise the intensity of the glare. The glare effect may be weak if the value is low. An exemplary parameter range for power, for example, may be between 0 and 1 in a scaling used herein. Iteration may comprise the repetition or loop within the imaging processing where calculations or adjustments are made to simulate the effect of glare. Iteration typically involves iterating over the pixels or screen space to determine the intensity and appearance of the glare effect based on the input parameters and the characteristics of the light sources in the scene or surroundings. An exemplary parameter range for iteration, for example, may be between 0 and 16 in a scaling used herein. Sub iteration may comprise a secondary level of iteration. The process and effect may be similar to that of iteration. An exemplary parameter range for sub iteration, for example, may be between 0 and 16 in a scaling used herein.

[0040] Parameters, for example, may comprise halo. The halo parameters may be applied to produce a visual effect that creates a glowing or radiant aura around lights. The halo parameters may further include parameters or components of threshold, halo strength, halo power, halo width, iteration, blur power, blur strength, and alpha. Threshold may comprise a threshold value for the sensitivity which halo reacts. An exemplary parameter range for threshold, for example, may bebetween 0 and 1 in a scaling used herein. Halo strength may comprise a maximum value of halo intensity. An exemplary parameter range for halo strength, for example, may be between 0 and 10 in a scaling used herein. Halo power may comprise a power adjustment produced based on the maximum value of halo strength. An exemplary parameter range for halo power, for example, may be between 0 and 10 in a scaling used herein. Halo width may refer to a width of the aura effect. An exemplary parameter range for halo width, for example, may be between 0 and 10 in a scaling used herein. Iteration may be similar to iteration with glare, and may refer to the repetition or loop within the processes where calculations or adjustments are made to simulate the effect of halo. Iteration may typically involve iterating over the pixels or screen space to determine the intensity and appearance of the halo effect based on input parameters and the characteristics of the light. An exemplary parameter range for iteration, for example, may be between 0 and 16 in a scaling used herein. Blur power may comprise the blur applied to the aura itself. A higher value may produce more blur and a lesser value may produce less blur. An exemplary parameter range for blur power, for example, may be between 0 and 1 in a scaling used herein. Blur strength may comprise the blur applied to the outer board area of aura. A higher value may produce more blur and a lesser value may produce less blur. An exemplary parameter range for blur strength, for example, may be between 0 and 10 in a scaling used herein. Alpha may comprise the transparency or opacity of a material or texture. It is value ranging from 0 to 1, where 0 represents complete transparency (invisible) and 1 represents complete opacity (solid). An exemplary parameter range for alpha, for example, may be between 0 and 1 in a scaling used herein.

[0041] Parameters, for example, may comprise color blit. The color blit parameters may be applied to overlay colors. Such a feature may be utilized for the cataract parameter set in examples. The color blit parameters may further include parameters or components of color and intensity. Color may comprise ranges of red (R), green (G), and blue (B) to produce the colored effect. An exemplary parameter range for R, for example, may be between 0 and 255 in a scaling used herein. An exemplary parameter range for G, for example, may be between 0 and 255 in a scaling used herein. An exemplary parameter range for B, for example, may be between 0 and 255 in a scaling used herein. Intensity may comprise the intensity of the respective color. The color may be more clear if the value is low. An exemplary parameter range for intensity, for example, may be between 0 and 1 in a scaling used herein.

[0042] The parameters of depth of focus (DoF), glare, halo, and color blit may be applied by the processor 28 to produce desired visions or images on the display 14 corresponding to the type of lens or type of optical condition. A user may select which type of lens or type of optical condition the user desires to simulate on the display 14. The processor 28 may produce the vision data based on the images captured by the at least one camera 12 and the corresponding parameters (e.g., depth of focus (DoF), glare, halo, and color blit).

[0043] Representative parameters for the types of type of lenses are provided below. For example, for a single focus lens, the following parameters in Table 1 may be utilized for a near distance lens. Each numerical value of the parameters listed in Table 1 may have a numerical value within a range of ± 20% of each numerical value.

[0044] As such, the parameters of Table 1 define a first range of a first depth of focus (at a near distance for a monofocal intraocular lens). The first range of the first depth of focus is for near vision.

[0045] For example, for a single focus lens, the following parameters in Table 2 may be utilized for a far distance lens. Each numerical value of the parameters listed in Table 2 may have a numerical value within a range of ± 20% of each numerical value.TABLE 2

[0046] As such, the parameters of Table 2 define a second range of a second depth of focus (at a far distance for a monofocal intraocular lens). The second depth of focus is far from the first depth of focus. For example, the focus distance in the second range is further (at 20) than the focus distance in the first range (at 2.5). The corresponding visions or images shown on the display 14 represent these varied focus distances.

[0047] Each of the depth of focus parameter sets of the first range and second range include a blur strength, a focus distance, an outer distance, an inner distance, and a contrast.

[0048] For a multi-focus lens, the following parameters in Table 3 may be utilized for the lens utilized during day (e.g., a daytime range). Each numerical value of the parameters listed in Table 3 may have a numerical value within a range of ± 20% of each numerical value.TABLE 3

[0049] As such, the parameters of Table 3 define a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus (DoF), glare, and halo.

[0050] For a multi-focus lens, the following parameters in Table 4 may be utilized for the lens utilized during night (e.g., a nighttime range). Each numerical value of the parameters listed in Table 4 may have a numerical value within a range of ± 20% of each numerical value.TABLE 4

[0051] As such, the parameters of Table 4 define a second multi-focus parameter set for defining a nighttime range of each of a plurality of depth of focus (DoF), glare, and halo. As represented by the parameters in Tables 3 and 4, the width of the halo (Halo Width at 1.5) for the second multifocus parameter set is smaller than the width of the halo (Halo Width at 2) for the first multi-focus parameter set. Further, as represented by the parameters in Tables 3 and 4, the power of the halo (power at 5) for the second multi-focus parameter set is smaller than the power of the halo (power at 10) for the first multi-focus parameter set. Various other distinctions between the second multifocus parameter set and the first multi-focus parameter set are represented in Tables 3 and 4.

[0052] Table 5 illustrates the parameters for an optical condition such as cataracts (e.g., a cataract parameter set for defining cataract symptoms). Each numerical value of the parameters listed in Table 5 may have a numerical value within a range of ± 20% of each numerical value.TABLE S

[0053] As such, the parameters of Table 5 define a cataract parameter set for defining cataract symptoms (including a third range of a third depth of focus (DoF), halo, and color blit). The cataract parameter set may be utilized to simulate the cataract symptoms.

[0054] Other forms of parameters for other types of lenses or types of optical conditions may be utilized in examples. The processor 28 may generate the vision data based on the exemplary predetermined parameters listed above, yet may utilize other predetermined parameters in examples.

[0055] FIG. 4 illustrates an exemplary view of a display 14, including a graphical user interface (GUI) for use by a user. The GUI may be implemented with a touch panel 24 or other form of input device in examples (e.g., a mouse or remote controller or other form of input device). The display 14 may selectably display a plurality of visions or images that are based on the vision data that is generated by the processor 28. A user may select which type of lens or type of optical condition that the user desires to simulate and view on the display 14. The touch panel 24, for example, may be utilized to select the type of visions or images that the user will view, which are based on the parameter sets in a manner disclosed herein.

[0056] FIG. 5, for example, illustrates a vision of a healthy eye on the display 14, with no lens or optical condition simulated. The display 14 provides a real-time image of the images captured by the camera 12. The user may then select (e.g., using the touch panel 24) a type of lenses or type of optical condition to simulate using Augmented Reality (AR).

[0057] FIG. 6, for example, illustrates visions or images representative of cataract symptoms. The cataract parameter set represented in Table 5, for example, may be utilized to produce the visions or images shown in FIG. 6. A user may simulate the appearance of cataracts in AugmentedReality (AR). Such an appearance would result before cataract surgery. Other optical conditions or types of lenses may be selected by a user.

[0058] FIG. 7, for example, illustrates a representation of vision following cataract surgery, in which a single focus, far vision, lens is simulated. The parameter set represented in Table 2, for example, may be utilized to produce the visions or images shown in FIG. 7. Other optical conditions or types of lenses may be selected by a user.

[0059] FIG. 8, for example, illustrates a representation of vision following cataract surgery, in which a single focus, near vision, lens is simulated. The parameter set represented in Table 1, for example, may be utilized to produce the visions or images shown in FIG. 8. A user may beneficially be able to compare the appearance of both far vision lenses and near vision lenses through comparison of the respective visions or images.

[0060] A user may select the types of surroundings that the user will image. FIGS. 7 and 8, for example, illustrate an office or meeting room setting. FIG. 9, in contrast, represents a night scene or possible night driving scenario. FIG. 9, for example, illustrates a representation of vision following cataract surgery, in which a single focus, far vision, lens is simulated in a night scene. The parameter set represented in Table 2, for example, may be utilized to produce the visions or images shown in FIG. 9. Other optical conditions or types of lenses may be selected by a user.

[0061] FIG. 10, for example, illustrates a representation of vision following cataract surgery, in which a multi-focus lens is simulated. The user has selected the daytime or “bright” parameters, as represented in Table 3. The user may compare the resulting visions or images with a monofocal appearance as represented in FIG. 9 for example. The user may further select the nighttime or “dark” parameters, as represented in Table 4. The user may alternatively select the daytime or “bright” parameters, as represented in Table 3, or the nighttime or “dark” parameters, as represented in Table 4. As such, the user may compare and determine which type of lens (e.g., intraocular lens) would best suit the user. A technician or physician may utilize such information to determine which lens to implant within the eye of the user following cataract surgery. The lens selected may suit the needs of the user (e.g., whether the user is concerned about potential halo effects at night or rarely drives at night).

[0062] In examples, the device may comprise a mobile computing device and / or a headset. For example, a headset with Augmented Reality (AR) features may be utilized that may produce the effects disclosed herein. The headset may comprise a mobile computing device or otherwise maybe utilized (e.g., the headset may include clear lenses able to produce images, such as an organic light emitting device (OLED) screen or other forms of screens).

[0063] The examples disclosed herein may be utilized with a dedicated cataract simulation device or may be utilized with other forms of devices with the programming stored or downloaded to the device. For example, a user’s mobile computing device may receive (e.g., download) a program (e.g., an application or “app”) that may comprise the features disclosed herein. A program may comprise a non-transitory computer program product comprising instructions which, when the non-transitory computer program product is executed by a computing device, cause the computing device to perform the methods disclosed herein.

[0064] For example, methods that may be implemented by the program may include: generating vision data based on images captured by at least one camera and a plurality of predetermined parameters; and selectably displaying, on a display, a plurality of visions or images based on the generated vision data, the plurality of visions or images comprising Augmented Reality that simulates visions or images before and / or after cataract surgery. An application or “app” may be non-transitory and stored on a memory of a computing device. The application or “app” may include the parameters as disclosed herein. The application or “app” may be downloaded via a wifi-network, Bluetooth-network, or via a cabled connection. The application or “app,” for example, may be provided in a store (e.g., an “app” store) and downloaded for use. Cloud computing implementations may be utilized.

[0065] The features disclosed herein may be utilized to beneficially simulate a plurality of visions or images before and / or after cataract surgery by using Augmented Reality, which may allow a user and / or a medical professional to better determine a course of treatment (which may occur following a diagnosis of cataracts or preventative in nature). The features disclosed herein may allow a user and / or medical professional to better assess and provide a more realistic assessment of visions or images based on types of lenses and medical conditions.

[0066] In examples, the features disclosed herein may be applied to stored photographs or videos, and not only for real-time capture of images with a camera.

[0067] The methods disclosed herein may be a single computing device or a computing system formed with multiple connected computing devices. A computing device may be configured to perform various distributed computing tasks, in which processing and / or storage resources may be distributed among the multiple devices. A memory as disclosed herein may comprise a hard diskor CD-ROM drive, (or forms of solid state RAM or ROM), and it should be appreciated by those skilled in the art that memory can be any available computer storage media that can be accessed by a processor.

[0068] By way of example and not limitation, memory may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-storage instructions, data structures, program modules, or other data. For example, computer storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), HD-DVD, BLU-RAY, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a processor. Memory as described herein does not include transitory signals.

[0069] According to various examples, a processor may operate in a networked environment using connections to other local or remote computers through a network via a network interface unit connected to a bus. A network interface unit may facilitate connection of the computing device inputs and outputs to one or more suitable networks and / or connections such as a local area network (LAN), a wide area network (WAN), the Internet, a cellular network, a radio frequency (RF) network, a Bluetooth-enabled network, a Wi-Fi enabled network, a satellite-based network, or other wired and / or wireless networks for communication with external devices and / or systems.

[0070] Computing devices may also include an input / output controller for receiving and processing input from any of a number of input devices. Input devices may include one or more of keyboards, mice, stylus, touchscreens, microphones, audio capturing devices, and image / video capturing devices. An end user may utilize the input devices to interact with a user interface, for example a graphical user interface, for managing various functions performed by the computing device.

[0071] In the description herein, numerous specific details are set forth. However, it is to be understood that examples of the present disclosure may be practiced without these specific details. In other instances, well-known methods, structures, and techniques have not been shown in detail in order not to obscure an understanding of this description. References to “one example,” “an example,” “examples,” “some examples,” “certain examples,” “various examples,” etc., indicate that the example(s) of the present disclosure so described may include a particular feature,structure, or characteristic, but not every example necessarily includes the particular feature, structure, or characteristic. Further, repeated use of the phrase “in one example” does not necessarily refer to the same example, although it may.

[0072] Throughout the specification and the claims, the following terms take at least the meanings explicitly associated herein, unless the context clearly dictates otherwise. The term “or” is intended to mean an inclusive “or.” Further, the terms “a,” “an,” and “the” are intended to mean one or more unless specified otherwise or clear from the context to be directed to a singular form.

[0073] Unless otherwise specified, the use of the ordinal adjectives “first,” “second,” “third,” etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.

[0074] Certain examples of the present disclosure are described above with reference to block of systems and methods and / or computer program products according to examples of the present disclosure. It will be understood that one or more blocks of the block diagrams, and combinations of blocks in the block diagrams, respectively, may be implemented by computer-executable program instructions. Likewise, some blocks of the block diagrams may not necessarily need to be performed in the order presented, or may not necessarily need to be performed at all, according to some examples of the present disclosure.

[0075] The present disclosure may provide for a computer program product, including a computer-usable medium having a computer-readable program code or program instructions embodied therein, said computer-readable program code adapted to be executed to implement one or more functions specified in the blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational elements or steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions that execute on the computer or other programmable apparatus provide elements or steps for implementing the functions specified in the blocks.

[0076] While certain examples of the present disclosure have been described in connection with what is presently considered to be the most practical and various examples, it is to be understood that the present disclosure is not to be limited to the disclosed examples, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the scope ofthe appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

[0077] This written description uses examples to disclose certain examples of the present disclosure, including the best mode, and also to enable any person skilled in the art to practice certain examples of the present disclosure, including making and using any devices or systems and performing any incorporated methods. The patentable scope of certain examples of the present disclosure is defined in the claims, and may include other examples that occur to those skilled in the art.

[0078] The mention of one or more steps of a method does not preclude the presence of additional method steps or intervening method steps between those steps expressly identified. Steps of a method may be performed in a different order than those described herein without departing from the scope of the disclosed technology. Similarly, it is also to be understood that the mention of one or more components in a device or system does not preclude the presence of additional components or intervening components between those components expressly identified.

Claims

CLAIMSWhat is claimed is:

1. A cataract simulation device for simulating a plurality of visions or images before and after cataract surgery by using Augmented Reality, the device comprising: at least one camera for capturing images of the surroundings of the device; a processor for generating vision data based on the images captured by the at least one camera and a plurality of predetermined parameters; a display for selectably displaying the plurality of visions or images based on the vision data generated by the processor; and a touch panel for selecting the plurality of visions or images, wherein the plurality of visions or images after cataract surgery are based on: a first single focus parameter set for defining a first range of a first depth of focus; a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.

2. The device of claim 1, wherein the device is configured such that a user alternatively selects to display the plurality of visions or images corresponding to the first multi-focus parameter set or the plurality of visions or images corresponding to the second multi-focus parameter set.

3. The device of claim 1 or 2, wherein the plurality of visions or images are based on a cataract parameter set for defining cataract symptoms.

4. The device of claim 3, wherein the cataract parameter set defines a third range of a third depth of focus, halo, and color blit.

5. The device of any of claims 1-4, wherein the first range of the first depth of focus is for near vision.

6. The device of any of claims 1-5, wherein the second range of the second depth of focus is for far vision.

7. The device of any of claims 1-6, wherein the first single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast, and the second single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast.

8. The device of any of claims 1-7, wherein a width of the halo of the second multifocus parameter set is smaller than a width of the halo of the first multi-focus parameter set.

9. The device of any of claims 1-8, wherein a halo power of the second multi-focus parameter set is smaller than a halo power of the first multi-focus parameter set.

10. The device of any of claims 1-9, wherein the device comprises one or more of a mobile computing device or a headset.

11. A non- transitory computer program product comprising instructions which, when the non-transitory computer program product is executed by a computing device, cause the computing device to carry out a method comprising: generating vision data based on images captured by at least one camera and a plurality of predetermined parameters; and selectably displaying, on a display, a plurality of visions or images based on the generated vision data, the plurality of visions or images comprising Augmented Reality that simulates visions or images after cataract surgery, and wherein the plurality of visions or images are based on: a first single focus parameter set for defining a first range of a first depth of focus;a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.

12. The non-transitory computer program product of claim 11, wherein the non- transitory computer program product is configured such that a user alternatively selects to display the plurality of visions or images corresponding to the first multi-focus parameter set or the plurality of visions or images corresponding to the second multi-focus parameter set.

13. The non-transitory computer program product of claim 11 or 12, wherein the method further comprises selectably displaying, on the display, a plurality of visions or images comprising Augmented Reality that simulates visions or images before cataract surgery, wherein the plurality of visions or images before cataract surgery are based on a cataract parameter set for defining cataract symptoms.

14. The non-transitory computer program product of claim 13, wherein the cataract parameter set defines a third range of a third depth of focus, halo, and color blit.

15. The non-transitory computer program product of any of claims 11-14, wherein the first range of the first depth of focus is for near vision.

16. The non-transitory computer program product of any of claims 11-15, wherein the second range of the second depth of focus is for far vision.

17. The non-transitory computer program product of any of claims 11-16, wherein the first single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast, and the second single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast.

18. The non-transitory computer program product of any of claims 11-17, wherein a width of the halo of the second multi-focus parameter set is smaller than a width of the halo of the first multi-focus parameter set.

19. The non-transitory computer program product of any of claims 11-18, wherein a halo power of the second multi-focus parameter set is smaller than a halo power of the first multi-focus parameter set.

20. The non-transitory computer program product of any of claims 11-19, wherein the computing device comprises one or more of a mobile computing device or a headset.

21. A computer- implemented method for simulating a plurality of visions or images after cataract surgery by using Augmented Reality, the method comprising: generating vision data based on images captured by at least one camera and a plurality of predetermined parameters; and selectably displaying, on a display, a plurality of visions or images based on the generated vision data, the plurality of visions or images comprising Augmented Reality that simulates visions or images after cataract surgery, and wherein the plurality of visions or images are based on: a first single focus parameter set for defining a first range of a first depth of focus; a second single focus parameter set for defining a second range of a second depth of focus, wherein the second depth of focus is far from the first depth of focus; a first multi-focus parameter set for defining a daytime range of each of a plurality of depth of focus, glare, and halo; and a second multi-focus parameter set for defining a nighttime range of each of a plurality of depths of focus, glare, and halo.

22. The method of claim 21, further comprising allowing a user to alternatively select to display the plurality of visions or images corresponding to the first multi-focus parameter set or the plurality of visions or images corresponding to the second multi-focus parameter set.

23. The method of claim 21 or 22, further comprising selectably displaying, on the display, a plurality of visions or images comprising Augmented Reality that simulates visions or images before cataract surgery, wherein the plurality of visions or images before cataract surgery are based on a cataract parameter set for defining cataract symptoms.

24. The method of claim 23, wherein the cataract parameter set defines a third range of a third depth of focus, halo, and color blit.

25. The method of any of claims 21-24, wherein the first range of the first depth of focus is for near vision.

26. The method of any of claims 21-25, wherein the second range of the second depth of focus is for far vision.

27. The method of any of claims 21-26, wherein the first single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast, and the second single focus parameter set includes a blur strength, a focus distance, an outer distance, an inner distance, and a contrast.

28. The method of any of claims 21-27, wherein a width of the halo of the second multifocus parameter set is smaller than a width of the halo of the first multi-focus parameter set.

29. The method of any of claims 21-28, wherein a halo power of the second multi-focus parameter set is smaller than a halo power of the first multi-focus parameter set.

30. The method of any of claims 21-29, further comprising performing the method with one or more of a mobile computing device or a headset.

Images