Method and device for treating / preventing ophthalmological conditions
The method and device utilize an eye-tracker to generate display images with subtle degradation in non-central vision portions based on base image characteristics, addressing the limitations of existing refractive error treatments and enhancing compliance and efficacy.
Patent Information
- Application Number
- PCT/IB2026/054017
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-08
- Filing Date
- 2026-04-23
- Publication Date
- 2026-11-12
AI Technical Summary
Existing methods for treating and preventing refractive errors, such as myopia, are limited in effectiveness and compliance due to the difficulty in determining optimal degradation thresholds for non-central vision portions of display images, leading to reduced therapeutic efficacy.
A method and device using an eye-tracker to generate display images with a central-vision portion and a degraded non-central vision portion, where the degradation is dependent on the determined value of an image characteristic of the base image, ensuring the degradation is subtle yet effective.
Enhances treatment and prevention of refractive errors by increasing compliance through unnoticeable image degradation, thereby extending treatment time and improving therapeutic outcomes.
Smart Images

Figure IB2026054017_12112026_PF_FP_ABST
Abstract
Description
[0001] METHOD AND DEVICE FOR TREATING / PREVENTING OPHTHALMOLOGICAL CONDITIONS
[0002] RELATED APPLICATION
[0003] The present application gains priority from US Provisional Patent Application 63 / 801,863 filed 8 May 2025 which is included by reference as if fully set-forth herein.
[0004] FIELD AND BACKGROUND OF THE INVENTION
[0005] The invention, in some embodiments, relates to the field of ophthalmology and, more particularly but not exclusively, to methods and devices useful for non-invasive treatment and / or prevention of refractive errors in a human subject.
[0006] The invention, in some embodiments, relates to the field of eye-tracking and more particularly but not exclusively to improved eye-tracking.
[0007] In the field of ophthalmology, it is known to display to a subject on a display screen a modified version of a digital base image. The modified version, herein called a display image, is generated by modifying a digital base image in some specific way. In some instances, the viewing by the subject of the display image instead of the base image has an ophthalmologically-useful effect, for example the treatment and / or prevention of an ophthalmological condition. In some instances, the display image is generated from the base image with reference to the gaze direction of at least one eye of a subject as is determined using an eye-tracker. The use of an eye-tracker to determine a gaze direction in order to generate a display image from a base image is described, inter alia, in US 2018 / 0028057, US 2021 / 0393123 and in US 11,918,284.
[0008] It would be useful to have improved methods for using an eye-tracker, especially when the eye-tracker is used to determine a gaze direction to allow generation of a display image from a base image.
[0009] The eye of a full-term human baby is about 1.8 cm long (cornea to back of the eye). The eye grows throughout childhood, reaching a length of about 2.5 cm in adulthood during which, ideally, emmetropization occurs.
[0010] Emmetropia is a match between the power of the optics of the eye and the axial length of the eye so that in the absence of accommodation, distant images are focused at the photoreceptor layer.
[0011] Emmetropization is the process of achieving emmetropia and involves a reduction in the refractive error that is present at birth. The refractive state of a newborn human variesbetween individuals, most newborn's eyes being hyperopic and over time usually becoming emmetropic. The ocular components of the eye, notably the lens and the corneal curvature, continue to change and eye growth occurs beyond the time that initial emmetropia is obtained. Thus, the eye also needs to maintain emmetropia. It is undisputed that emmetropization is in part actively achieved through visual feedback. Less is known about the processes underlying the maintenance of emmetropia.
[0012] In some instances, the eye reaches emmetropia but continues physically changing, eventually developing myopia. Such myopia is usually caused by an increase in eye axial-length and / or corneal curvature so that light from distant objects is focused in front of the retina leading to reduced visual acuity.
[0013] Myopia, also known as nearsightedness, is the most common eye disorders in the world. Some children who develop myopia have a continual progression of their myopia throughout the school years, including high school. Long-term risks associated with myopia progression include cataracts, glaucoma, macular degeneration and retinal detachment.
[0014] In US 2022 / 0057651 is described a technique for driving emmetropization of an eye including receiving image data corresponding to a color image; blurring a first color channel of the image data greater than a second color channel of the image data in at least a portion of the color image to provide a simulated longitudinal chromatic aberration (LCA) in the portion of the color image; and displaying the color image with the simulated LCA as a display image to provide an emmetropization therapy to the eye. In some or all embodiments, the gaze of an eye of a subject is tracked.
[0015] In US 11,918,284 of the Applicant are described methods and devices useful for non-invasive treatment and / or prevention of refractive errors such as myopia by displaying to a subject a digital display image generated from a digital base image wherein a gaze direction is determined and used to generate the display image. The display image comprises at least two different portions: a central -vision portion and a non-central vision portion where the image quality of the non-central vision portion is lower than the image quality of the centralvision portion.
[0016] It would be useful to have methods and devices that provide one or more advantages over the described in US 11,918,284.
[0017] SUMMARY OF THE INVENTION
[0018] Some aspects of the teachings herein relate to methods and devices useful in the field of ophthalmology and, in some particular embodiments, useful for the non-invasive treatmentand / or prevention of refractive errors, particularly myopia and / or decreasing the rate of eye growth. Some embodiments of the teachings herein are useful for one or more of: preventing the development of refractive errors, stopping the progression of extant refractive errors and reducing the severity of extant refractive errors, particularly myopia, hyperopia and astigmatism. Some aspects of the teachings herein relate to the field of eye tracking and, more particularly, to devices that comprise an eye-tracker and methods of using an eyetracker.
[0019] According to an aspect of some embodiments of the teachings herein, there is provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0020] a. determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from a received digital base image, wherein the display image includes:
[0021] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0022] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and
[0023] c. displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen,
[0024] further comprising:
[0025] determining a value of an image characteristic of part of the base image; and during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image.
[0026] According to an aspect of some embodiments of the teachings herein, there is also provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0027] displaying a video as a sequentially-displayed series of frames on a display screen, each frame provided to a computer processor as a digital base image, the method comprising for each provided digital base image:a. determining a gaze direction of a first eye of a subject viewing an image on the display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from the digital base image that was provided, wherein the display image includes:
[0028] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0029] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to visual characteristics of a corresponding portion in the base image, and
[0030] c. displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen,
[0031] further comprising, for a first group of the frames:
[0032] determining a value of an image characteristic of part of the base image; and during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image and
[0033] for a second group of the frames:
[0034] during the generation of the display image, the generation of the non-central vision portion of the display image is dependent on the determined value of the characteristic of the part of a previously-provided base image that is a member of the first group. According to an aspect of some embodiments of the teachings herein, there is also provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0035] a computer processor functionally associated with a display screen and an eye tracker, the eye tracker configured for determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to the computer processor; the computer processor comprising a computer-readable storage medium having instructions stored thereon, when executed, the instructions cause the computer processor to perform the following steps:
[0036] a. receive a gaze direction of a first eye of a subject viewing an image on the display screen determined by the eye tracker;b. subsequent to 'a', based on the determined gaze direction of the first eye, generate a display image for display to the first eye on the display screen from a received digital base image, wherein the display image includes:
[0037] i. a central -vision portion of the display image that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0038] ii. a non-central vision portion of the display image that is different from the central -vision portion that is modified so that visual characteristics of the noncentral vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and c. display the generated display image on the display screen so that the first eye of the subject views the display image on the display screen,
[0039] and to also:
[0040] determine a value of an image characteristic of part of the base image; and
[0041] then during the generating of the display image from the base image, at least one characteristic of the non-central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image.
[0042] According to an aspect of some embodiments of the teachings herein, there is also provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0043] a computer processor functionally associated with a display screen and an eye tracker, the eye tracker configured for a determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to the computer processor; the computer processor configured to display a video as a sequentially-displayed series of frames on the display screen, each frame provided to a computer processor as a digital base image, the processor comprising a computer-readable storage medium having instructions stored thereon, when executed, the instructions cause the computer processor to perform the following steps:
[0044] a. receive a gaze direction of a first eye of a subject viewing an image on the display screen determined by the eye tracker;
[0045] b. subsequent to 'a', based on the determined gaze direction of the first eye, generate a display image for display to the first eye on the display screen from a received digital base image, wherein the display image includes:
[0046] i. a central-vision portion that corresponds to a portion of the field of view ofthe first eye that includes the determined gaze direction, and
[0047] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and
[0048] c. display the generated display image on the display screen so that the first eye of the subject views the display image on the display screen,
[0049] further comprising, for a first group of the frames:
[0050] to also determine a value of an image characteristic of part of the base image; and then during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image, and
[0051] for a second group of the frames:
[0052] during the generating of the display image, the generating of the non-central vision portion of the display image is dependent on a determined value of the characteristic of the part of a previously-provided base image that is a member of the first group. According to an aspect of some embodiments of the teachings herein, there is also provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0053] a computer processor functionally associated with a display screen and an eye tracker, the eye tracker configured for determining a gaze direction of a first eye of a person viewing an image on the display screen and for providing a determined gaze direction to the computer processor,
[0054] the computer processor configured:
[0055] to generate a display image from a received digital base image based on a gaze direction of the first eye received from the eye tracker, wherein the display image includes:
[0056] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0057] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and
[0058] to display the generated display image on the display screen so that the first eye of theperson views the display image on the display screen,
[0059] wherein the computer processor is further configured to:
[0060] determine a value of an image characteristic of part of the base image; and
[0061] during the generating of the display image, at least one characteristic of the noncentral vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image.
[0062] According to an aspect of some embodiments of the teachings herein, there is also provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0063] a computer processor functionally associated with a display screen and an eye tracker, the eye tracker configured for determining a gaze direction of a first eye of a person viewing an image on the display screen and for providing a determined gaze direction to the computer processor,
[0064] the computer processor configured:
[0065] to display a video as a sequentially-displayed series of frames on the display screen, each frame provided to a computer processor as a digital base image;
[0066] to generate a display image from a received digital base image based on a gaze direction of the first eye received from the eye tracker, wherein the display image includes:
[0067] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0068] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and
[0069] to display the generated display image on the display screen so that the first eye of the person views the display image on the display screen,
[0070] the computer processor further configured to:
[0071] for a first group of the frames:
[0072] determine a value of an image characteristic of part of the base image; and
[0073] during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the image characteristic of the part of the base-image, and
[0074] for a second group of the frames:during the generating of the display image, the generating of the non-central vision portion of the display image is dependent on a determined value of the characteristic of the part of a previously-provided base image that is a member of the first group.
[0075] Characteristic of the non-central vision portion of the display image
[0076] In the methods and devices, a display image is generated from a base image, where at least one characteristic of the non-central vision portion of the display image (which is degraded relative to the corresponding portion of the base image) is dependent on the determined value of an image characteristic of part of the base image.
[0077] In preferred embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of an image characteristic of part of the base image is the degree of degradation of the non-central vision portion, that is to say, the degree that non-central vision portion is degraded depends on the determined value. The degree of degradation is discussed in greater detail hereinbelow.
[0078] Additionally or alternatively, in some embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of an image characteristic of part of the base image is the size of the non-central vision portion, that is to say, the size of the non-central vision portion is degraded depends on the determined value.
[0079] Image characteristic of the part of the base image that is determined
[0080] The value of any suitable image characteristic or suitable combination of image characteristics of the part of the base image is determined. In some embodiments of the methods and / or devices, the image characteristic of the part of the base image for which a value is determined is a characteristic selected from the group consisting of sharpness, contrast, frequency and combinations thereof.
[0081] Dependence of display-image characteristic on base-image characteristic
[0082] As noted above, during the generating of the display image, at least one characteristic of the non-central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image, that is to say, the determined value is used as a parameter for generating the display image and particularly, for determining the characteristics of the non-central vision portion. This aspect of the invention according to the teachings herein is discussed in greater detail hereinbelow.Some embodiments of the methods and devices of the teachings herein are used in conjunction with the teachings of US 11,918,284 which is included by reference as if fully set-forth herein. In such embodiments, various options such as how gaze direction is determined, how a display image is generated including types of degradation are as described in US 11,918,284.
[0083] According to an aspect of some embodiments of the teachings herein, there is also provided a method of calibrating an eye-tracker that tracks the gaze direction of at least one eye of a subject who is viewing content displayed on a display screen, the method comprising:
[0084] providing a display device including:
[0085] a graphic-user interface (GUI) comprising a display screen and a user-command input component;
[0086] an eye-tracker for tracking the gaze direction of at least one eye of a subject looking at content displayed on the display screen; and
[0087] a controller comprising a computer processor for controlling other components of the display device including displaying content on the display screen, receiving input from the input component and the eye-tracker;
[0088] in a session during which the controller displays content on the display screen, the controller periodically receiving a gaze-direction of at least one eye of the subject determined by the eye-tracker;
[0089] at least one time during the session, when the controller receives a user-command through the GUI at a single location of the display screen which command lasts longer than a minimal threshold, the controller initiating an eye-tracker calibration event with the single location as a calibration target.
[0090] According to an aspect of some embodiments of the teachings herein, there is also provided a display device for tracking the gaze direction to at least one eye of a subject who is viewing content displayed on a display screen, the display device comprising:
[0091] a GUI comprising a display screen and a user-command input component;
[0092] an eye-tracker for tracking the gaze direction of at least one eye of a subject looking at content displayed on the display screen; and
[0093] a controller comprising a computer processor for controlling other components of the display device including displaying content on the display screen, receiving input from the input component and the eye-tracker,the computer processor comprising a computer-readable storage medium having instructions stored thereon, when executed the instructions cause the computer processor to perform the following:
[0094] in a session during which the controller displays content on the display screen, the controller periodically receiving a gaze-direction of at least one eye of the subject determined by the eye-tracker;
[0095] at least one time during the session, when the controller receives a user-command through the GUI at a single location of the display screen which command lasts longer than a minimal threshold, the controller initiating an eye-tracker calibration event with the single location as a calibration target.
[0096] According to an aspect of some embodiments of the teachings herein, there is also provided a display device for tracking the gaze direction to at least one eye of a subject who is viewing content displayed on a display screen, the display device comprising:
[0097] a GUI comprising a display screen and a user-command input component;
[0098] an eye-tracker for tracking the gaze direction of at least one eye of a subject looking at content displayed on the display screen; and
[0099] a controller comprising a computer processor for controlling other components of the display device including displaying content on the display screen, receiving input from the input component and the eye-tracker,
[0100] wherein the controller is configured in a session during which the controller displays content on the display screen, the controller periodically receiving a gaze-direction of at least one eye of the subject determined by the eye-tracker;
[0101] at least one time during the session, when the controller receives a user-command through the GUI at a single location of the display screen which command lasts longer than a minimal threshold, the controller initiating an eye-tracker calibration event with the single location as a calibration target.
[0102] In some embodiments of the method or display devices, the eye-tracker is a dedicated hardware eye-tracker, e.g., from Tobii AB (Stockholm, Sweden). Alternatively, in some embodiments the eye-tracker comprises a visible-light camera that acquires images and software that analyzes acquired images tor tracking the gaze direction of at least one eye, e.g., commercially-available eye-tracking software including from iMotions Lab (Copenhagen, Denmark) or from Eyeware Tech SA (Martigny, Switzerland).
[0103] In some embodiments of the method or display devices, the minimal threshold is greater than about 0.5 seconds and the eye-tracker calibration event is an active calibrationevent, that is to say, a calibration event initiated by the subject.
[0104] In some embodiments, the minimal threshold is greater than about 0.001 seconds and the eye-tracker calibration event is a passive calibration event, that is to say, a calibration event that is automatically initiated, preferably without the knowledge of the subject.
[0105] In some embodiments, subsequent to the initiating the eye-tracker calibration event, the controller initiates a rest period having a duration during which no additional passive calibration event is initiated.
[0106] In some embodiments, a calibration event comprises acquisition of a single calibration image.
[0107] In some embodiments, a calibration event comprises acquisition of at least two calibration images after initiation of the calibration event.
[0108] Additionally or alternatively, in some embodiments a calibration event comprises acquisition of at least one calibration image prior to initiation of the calibration event.
[0109] BRIEF DESCRIPTION OF THE FIGURES
[0110] Some embodiments of the invention are described herein with reference to the accompanying figures. The description, together with the figures, makes apparent to a person having ordinary skill in the art how some embodiments of the invention may be practiced. The figures are for the purpose of illustrative discussion and no attempt is made to show structural details of an embodiment in more detail than is necessary for a fundamental understanding of the invention. For the sake of clarity, some objects depicted in the figures are not to scale.
[0111] In the Figures:
[0112] Fig. 1 is a schematic depiction of a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject;
[0113] Fig. 2 is a flowchart describing an embodiment of a method for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subj ect;
[0114] Fig. 3 A schematically depicts an exemplary base image;
[0115] Fig. 3B schematically depicts an exemplary corresponding display image;
[0116] Fig. 4 schematically depicts an embodiment of a device comprising an eye tracker according to the teachings herein;
[0117] Fig. 5 schematically depicts an embodiment of a device comprising an eye tracker according to the teachings herein; andFig. 6 is a flowchart describing an embodiment of a method for calibrating an eyetracker according to the teachings herein.
[0118] DESCRIPTION OF SOME EMBODIMENTS OF THE INVENTION
[0119] Some aspects of the teachings herein relate to methods and devices useful in the field of ophthalmology and, in some particular embodiments, useful for the non-invasive treatment and / or prevention of refractive errors, particularly myopia and / or decreasing the rate of eye growth. Some embodiments of the teachings herein are useful for one or more of: preventing the development of refractive errors, stopping the progression of extant refractive errors and reducing the severity of extant refractive errors, particularly myopia, hyperopia and astigmatism. Some aspects of the teachings herein relate to the field of eye tracking and, more particularly, to devices that comprise an eye-tracker and methods of using an eyetracker.
[0120] As discussed above, there exist methods and devices useful for treatment and / or prevention of refractive errors (collectively a therapeutic effect) that include displaying to a subject a display image generated from a base image where at least some of the non-central vision portion of the display image has an image quality that is lower than the image quality of the central-vision portion of the display image, for example, US 11,918,284.
[0121] Without wishing to be held to any one theory, it is currently believed that the greatest therapeutic effect is achieved when the non-central vision portion of the display image comprises a ring-shaped portion of the image having an inner diameter of about 6° from the gaze direction and an outer diameter of about 10° from the gaze direction so that the part of the image perceived by the foveal vision (a cone of less than about 5° centered around the gaze direction) is not degraded but the part of the image perceived by a ring surrounding the foveal vision is degraded. It is also believed that to achieve a substantial therapeutic effect the degradation of the ring-shaped portion must be greater than some threshold. If there is only a low amount of degradation that is below the threshold, there is little or no therapeutic effect. However, as the degree of degradation of the ring-shaped portion increases, the degradation is increasingly noticeable and irritating which leads to reduced compliance by the subject which, in turn, leads to a reduced therapeutic efficacy.
[0122] It is also currently believed that the optimal size of the ring-shaped portion and the degradation threshold are difficult, if not impossible, to determine as these depend on many factors including the nature of the base image and on the subject and are assumed to change over time.It is therefore currently believed that it is important to ensure that the degree of degradation of the ring-shaped portion be as great as possible but at the same time be completely or almost unnoticeable to a subject viewing the display. As a result, there will be increased compliance, the subject will use the invention often which will increase the total treatment time during which the degradation is greater than the threshold.
[0123] Thus, according to an aspect of some embodiments of the teachings herein, there is provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0124] a. determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from a received digital base image, wherein the display image includes:
[0125] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0126] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and c. displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen,
[0127] further comprising:
[0128] determining the value of an image characteristic of part of the base image; and during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base image.
[0129] As known in the art, video is the serial display of a series of frames, each frame being an image. In some embodiments of the teachings herein when applied to a video, each frame to be displayed is treated as an individual base image and is processed as described above, including determining the value of an image characteristic of part of the base image (i.e., the frame). In some embodiments, to reduce the use of computational resources, the value of an image characteristic of part of the frame is not determined for all frames. Instead, it is assumed that the value of an image characteristic of part of a given frame and of the immediately following frame or frames is usually the same.Thus, according to an aspect of some embodiments of the teachings herein, there is also provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0130] displaying a video as a sequentially-displayed series of frames on a display screen, each frame provided to a computer processor as a digital base image, the method comprising for each provided digital base image:
[0131] a. determining a gaze direction of a first eye of a subject viewing an image on the display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from the digital base image that was provided, wherein the display image includes:
[0132] i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0133] ii. a non-central vision portion that is different from the central -vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to visual characteristics of a corresponding portion in the base image, and
[0134] c. displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen
[0135] further comprising, for a first group of the frames:
[0136] determining a value of an image characteristic of part of the base image; and during the generating of the display image, at least one characteristic of the non- central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image, and
[0137] for a second group of the frames:
[0138] during the generation of the display image, the generation of the non-central vision portion of the display image is dependent on a determined value of the characteristic of the part of a previously-provided base image that is a member of the first group. In some embodiments, immediately after the display of a display image generated from a frame belonging to the first group of the frames, a number of one or more display images generated from frames belonging to the second group is displayed. In some embodiments, the number is one, that is to say, there is an alternating display of a display image generated from a frame belonging to the first group and a display image generatedfrom a frame belonging to the second group.
[0139] Additionally, or alternatively, in some embodiments, during display of the video, when a gaze direction is determined to change from a reference gaze-direction by more than a predetermined angular shift, the immediately following frame is assigned to be a member of the first group of frames, wherein the predetermined angular shift is greater than about 10°.
[0140] In some embodiments, the reference gaze-direction is the immediately-previously determined gaze direction.
[0141] Alternatively, in some embodiments, the reference gaze-direction is an average of a number of previously-determined gaze directions. In preferred such embodiments, when a gaze direction is determined to change from a base gaze-direction by more than a predetermined angular shift (e.g., greater than about 10°), the reference gaze-direction is reset.
[0142] The methods can be implemented on any suitable device or combination of devices. In some embodiments, the method is implemented using a device according to the teachings herein as described hereinabove. In some such embodiments, such a device comprises a computer processor functionally associated with a display screen and an eye tracker, the processor comprising a computer-readable storage medium having instructions stored thereon, when executed, the instructions cause the computer processor to perform the steps required for implementing the method. In some embodiments, such a device comprises a device comprising a computer processor functionally associated with a display screen and an eye tracker, the device configured to implement the method.
[0143] In Figure 1 is schematically depicted a device 10 according to the teachings herein comprising a computer processor 12 functionally associated with a display screen 14 and an eye tracker 16, eye tracker 16 configured for determining a gaze direction of a first eye 18a of a subject 18 viewing an image on display screen 14 and for providing a determined gaze direction to computer processor 12. Device 10 and computer processor 12 are configured (in the usual way, with hardware and software) to implement an embodiment of the method according to the teachings herein.
[0144] Figure 2 is a flowchart 100 depicting a general embodiment of the method according to the teachings herein.
[0145] In box 102, a gaze direction of a first eye 18a of a subject 18 viewing an image on display screen 14 is determined using eye tracker 16 and provided to computer processor 12.
[0146] In box 104, computer processor 12 receives a digital base image for display (e.g., from the Internet, stored in a memory of computer processor 12, or generated by a program / application running on device 10).
[0147] In box 106, computer processor 12 determines a value of an image characteristic of part of the base image.
[0148] In box 108, based on the gaze direction received from eye tracker 16 and on the determined value of the image characteristic of the part of the base image, computer processor 12 generates a display image for display to the first eye on display screen 14 from the received base image.
[0149] In box 110, the generated display image is displayed on display screen 14 so that the first eye of the subject views the display image on display screen 14.
[0150] A base image 20 is schematically depicted in Figure 3A. Base image 20 is a digital file that in the context of the teachings herein is not ordinarily displayed on a display screen.
[0151] An embodiment of a display image 22 that is generated from base image 20 is schematically depicted in Figure 3B. In Figure 3B, display image 22 is depicted displayed on a display screen 14.
[0152] Display image 22 includes a central -vision portion 22a that corresponds to a portion of the field of view of first eye 18a that includes a determined gaze direction 26 and is generated from a corresponding portion 20a of base image 20.
[0153] Display image 22 includes a non-central vision portion 22b (shaded gray in Figure 3B) that is different from central -vision portion 22a and is generated from a corresponding portion 20b of base image 20. Visual characteristics of non-central vision portion 22b of display image 22 are degraded compared to corresponding visual characteristics of corresponding non-central vision portion 20b of base image 20. Further, in accordance with the teachings herein at least one characteristic of non-central vision portions 22b of display image 22 is dependent on a determined value of a characteristic of a part 20c of base-image 20.
[0154] Central -vision portion of the display image
[0155] In some embodiments of the method or the configuration of the device, the centralvision portion of the display image is unmodified compared to a corresponding portion in the base image. In some alternative embodiments of the method or of the configuration of the device, the central-vision portion of the display image is modified so that visual characteristics of the central-vision portion of the display image are changed compared to corresponding visual characteristics of a corresponding portion in the base image which modification improves the image quality of the central -vision portion relative to thecorresponding portion in the base image.
[0156] Part of the base image for which an image characteristic is determined
[0157] The part of the base image for which the value of an image characteristic is determined is any suitable part.
[0158] In preferred embodiments, the part of the base image for which the value of an image characteristic is determined comprises a portion of the base image that corresponds to the non-central vision portion of the display image.
[0159] In some embodiments, the part of the base image for which the value of an image characteristic is determined is the entire base image, that is to say, the value of the characteristic is determined for the entire base image. Such embodiments are relatively simple to implement but, depending on the image characteristic for which value is determined, can lead to a heavy processor load.
[0160] Alternatively, in some embodiments, the part of the base image for which the value of an image characteristic is determined comprises (and in some embodiments, consists of) the entire portion of the base image that corresponds to the non-central vision portion of the display image. Such embodiments are preferred because the value of an image characteristic of the base image that corresponds to the non-central vision portion of the display image is directly relevant to how noticeable a degraded non-central vision portion of a display image is.
[0161] In some embodiments, the part of the base image for which the value of an image characteristic is determined comprises only a fraction of the portion of the base image that corresponds to the non-central vision portion of the display image. In some instances, such embodiments are preferred for requiring fewer computational resources. In some such embodiments, the part of the base image for which the value of an image characteristic is determined also includes portions of the base image that correspond to the central vision portion of the display image, but preferably the part of the base image for which the value of an image characteristic is determined does not include portions of the base image that correspond to the central vision portion of the display image.
[0162] Dependence of display-image characteristic on base-image characteristic
[0163] As noted above, at least one characteristic of the non-central vision portion of the display image is dependent on the determined value of the characteristic of the part of the base-image, that is to say, the determined value is used as a parameter for generating thedisplay image and particularly, for determining the characteristics of the non-central vision portion.
[0164] In preferred embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of the characteristic of the part of the base-image is the degree of degradation of the non-central vision portion. In such embodiments, a general guideline is that the degree of degradation of the non-central vision potion of a display image is greater when it is less likely to be noticed by a subject and the degree of degradation is lesser when it is more likely to be noticed by the subject. In such a way, the degradation of the non-central vision portion of the display image is less obtrusive, reduces the chance that the subject notices the degradation that can be irritating, leading to reduced compliance.
[0165] The value of any suitable image characteristic or suitable combination of image characteristics of the part of the base image is determined. In some embodiments of the methods and / or devices, the image characteristic of the part of the base image for which a value is determined is a characteristic selected from the group consisting of sharpness, contrast, frequency and combinations thereof.
[0166] As known in the art, there exist no-reference objective methods for determining numerical values for image characteristics. Some such methods determine a value for only one specific image characteristic while others concurrently determine a value for two or more image characteristics. Such methods are well-known to a person having ordinary skill in the art of image processing, for instance, routines for determining a numerical value for sharpness, contrast and frequency can be found in MATLAB® by MathWorks, Inc. (Natick, Massachusetts, USA) or Mathemetica by Wolfram Research (Champaign, IL, USA).
[0167] Image sharpness
[0168] In some embodiments, the determining of the value of the characteristic of the part of the base image comprises (and in some embodiments consists of) determining the sharpness of the part of the base image, wherein: the non-central vision portion of the display image is degraded more when a determined sharpness is lower and is degraded less when a determined sharpness is higher. Additionally or alternatively, in some such embodiments, the non-central vision portion of the display image is smaller when a determined sharpness is lower and is larger when a determined sharpness is higher.
[0169] As used herein, the term "sharpness" is used as known in the art of imaging processing. Sharpness can be determined in any suitable method using any suitable algorithmfor instance, Laplacian Variance, Tennengrad (Sobel gradient magnitude), Modulatio Transfer Function, Edge width measurement or analysis of the frequency domain image after Fourier Transform where sharp images have more high-frequency components.
[0170] In some such embodiments, during generation of a display image in the viewing session, the determined value of the sharpness of the part of the base image is compared to a pre-determined sharpness threshold. If the determined value is higher (sharper) than the sharpness threshold, the non-central vision portion of the display image is degraded by a predetermined low degree of degradation. If the determined value is lower (less sharp) than the sharpness threshold, the non-central vision portion of the display image is degraded by a predetermined high degree of degradation (which is a greater degree of degradation than the low degree of degradation). Additionally or alternatively, in some embodiments, during generation of a display image in the viewing session, if the determined sharpness value is higher than the sharpness threshold, the size of the non-central vision portion of the display image is set to a larger size and if the determined sharpness value is lower than the sharpness threshold the size of the non-central vision portion of the display image is set to a smaller size.
[0171] In such embodiments, the pre-determined values: three or five of sharpness threshold, low-degree degradation value, high-degree degradation value, larger size and smaller size are set in any suitable way. In some such embodiments, prior to an actual viewing session, the three or five values are determined for a given subject.
[0172] In some embodiments, prior to one or more viewing sessions the sharpness threshold, low-degree degradation value and high-degree degradation value are determined in a previewing session. In some embodiments of a pre-viewing session, the subject views a series (e.g., as a video, as a slide show) of high-sharpness display images, e.g., black text on a white background, where the degree of degradation of the non-central vision portion is progressively increased. The low-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the high-sharpness display images. The subject then views a series of low-sharpness display images, e.g., a live-action movie, while the degree of degradation of the non-central vision portion is progressively increased from the set low-degree degradation value. The high-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the low-sharpness display images. The subject then views a series of display images where the base images have different levels of sharpness and the degradation of the non-central vision portion of the corresponding display images is the set high-degree degradation. The sharpnessthreshold is set to be the sharpness of the highest-sharpness base image which the subject does not notice when the non-central vision portion of the corresponding display image is generated by degradation with the set high-degree degradation value.
[0173] In some embodiments, prior to one or more viewing sessions the sharpness threshold, larger size and smaller size are determined in a pre-viewing session. In some embodiments of a pre-viewing session, the subject views a series (e.g., as a video, as a slide show) of high-sharpness display images, e.g., black text on a white background, where the size of the noncentral vision portion is progressively decreased. The larger size is set to be the largest size of the non-central vision portion that the subject does not notice when viewing the high-sharpness display images. The subject then views a series of low-sharpness display images, e.g., a live-action movie, while the size of the non-central vision portion is progressively decreased from the set largest size. The smaller size is set to be the smallest size of the non-central vision portion that the subject does not notice when viewing the low-sharpness display images. The subject then views a series of display images where the bases images have different levels of sharpness and the size of the non-central vision portion of the corresponding display images is the set to the smaller size. The sharpness threshold is set to be the sharpness of the highest-sharpness base image which the subject does not notice when the non-central vision portion of the corresponding display image is of the smaller size.
[0174] Contrast
[0175] Additionally or alternatively, in some embodiments, the determining of the value of the characteristic of the part of the base image comprises (and in some embodiments consists of) determining the contrast of the part of the base image, wherein: the non-central vision portion of the display image is degraded more when a determined contrast is lower and is degraded less when a determined contrast is higher. Additionally or alternatively, in some such embodiments, the non-central vision portion of the display image is smaller when a determined contrast is lower and is larger when a determined contrast is higher.
[0176] As used herein, the term "contrast" refers to the color intensity or grayscale differentiation of the part of the base image. Contrast can be determined using any suitable method or algorithm.
[0177] In some such embodiments, during generation of a display image in the viewing session, the determined value of the contrast of the part of the base image is compared to a pre-determined contrast threshold. If the determined value is higher (greater contrast) than the contrast threshold, the non-central vision portion of the display image is degraded by a pre-determined low degree of degradation. If the determined value is lower (less contrast) than the contrast threshold, the non-central vision portion of the display image is degraded by a pre-determined high degree of degradation. Additionally or alternatively, in some embodiments, during generation of a display image in the viewing session, if the determined contrast value is higher than the contrast threshold, the size of the non-central vision portion of the display image is set to a larger size and if the determined contrast value is lower than the contrast threshold the size of the non-central vision portion of the display image is set to a smaller size.
[0178] In such embodiments, the pre-determined values: three or five of contrast threshold, low-degree degradation value, high-degree degradation value, larger size and smaller size are set in any suitable way. In some such embodiments, prior to an actual viewing session, the three or five values are determined for a given subject.
[0179] In some embodiments, prior to one or more viewing sessions the contrast threshold, low-degree degradation value and high-degree degradation value are determined in a previewing session. In some embodiments of a pre-viewing session, the subject views a series (e.g., as a video, as a slide show) of high-contrast display images, e.g., black text on a white background, where the degree of degradation of the non-central vision portion is progressively increased. The low-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the high-contrast display images. The subject then views a series of low-contrast display images, e.g., a live-action movie, while the degree of degradation of the non-central vision portion is progressively increased from the set low-degree degradation value. The high-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the low-contrast display images. The subject then views a series of display images where the base images have different levels of contrast and the degradation of the non-central vision portion of the corresponding display images is the set high-degree degradation. The contrast threshold is set to be the contrast of the highest-contrast base image which the subject does not notice when the non-central vision portion of the corresponding display image is generated by degradation with the set high-degree degradation value.
[0180] In some embodiments, prior to one or more viewing sessions the contrast threshold, larger size and smaller size are determined in a pre-viewing session. In some embodiments of a pre-viewing session, the subject views a series of high-contrast display images, e.g., black text on a white background, where the size of the non-central vision portion is progressively decreased. The larger size is set to be the largest size of the non-central vision portion that thesubject does not notice when viewing the high-contrast display images. The subject then views a series of low-contrast display images, e.g., a live-action movie, while the size of the non-central vision portion is progressively decreased from the set largest size. The smaller size is set to be the smallest size of the non-central vision portion that the subject does not notice when viewing the low-contrast display images. The subject then views a series of display images where the bases images have different levels of contrast and the size of the non-central vision portion of the corresponding display images is the set to the smaller size. The contrast threshold is set to be the contrast of the highest-contrast base image which the subject does not notice when the non-central vision portion of the corresponding display image is of the smaller size.
[0181] Frequency
[0182] Additionally or alternatively, to sharpness and / or contrast, in some embodiments, the determining of the value of the characteristic of the part of the base image comprises (and in some embodiments consists of) determining the frequency of the part of the base image, wherein: the non-central vision portion of the display image is degraded more when a determined frequency is lower and is degraded less when a determined frequency is higher. Additionally or alternatively, in some such embodiments, the non-central vision portion of the display image is smaller when a determined frequency is lower and is larger when a determined frequency is higher.
[0183] The term "frequency" is as known in the art of image processing. Frequency can be determined using any suitable method or algorithm, for example, generating a frequencydomain image using Fourier transform, and then analyzing the frequency-domain image to decide whether the image is a high-frequency image with only a few discrete frequencies (e.g., text) or is a low-frequency image with many different frequencies (e.g., photo).
[0184] In some such embodiments, during generation of a display image in the viewing session, the determined value of the contrast of the part of the base image is compared to a pre-determined contrast threshold. If the determined value is higher (higher frequency) than the contrast threshold, the non-central vision portion of the display image is degraded by a pre-determined low degree of degradation. If the determined value is lower (lower frequency) than the frequency threshold, the non-central vision portion of the display image is degraded by a pre-determined high degree of degradation. Additionally or alternatively, in some embodiments, during generation of a display image in the viewing session, if the determined frequency value is higher than the frequency threshold, the size of the non-central visionportion of the display image is set to a larger size and if the determined frequency value is lower than the frequency threshold the size of the non-central vision portion of the display image is set to a smaller size.
[0185] In such embodiments, the pre-determined values: three or five of frequency threshold, low-degree degradation value, high-degree degradation value, larger size and smaller size are set in any suitable way. In some such embodiments, prior to an actual viewing session, the three or five values are determined for a given subject.
[0186] In some embodiments, prior to one or more viewing sessions the frequency threshold, low-degree degradation value and high-degree degradation value are determined in a previewing session. In some embodiments of a pre-viewing session, the subject views a series of high-frequency display images, e.g., black text on a white background, where the degree of degradation of the non-central vision portion is progressively increased. The low-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the high-frequency display images. The subject then views a series of low-frequency display images, e.g., a live-action movie, while the degree of degradation of the non-central vision portion is progressively increased from the set low-degree degradation value. The high-degree degradation value is set to be the highest degree of degradation that the subject does not notice when viewing the low-frequency display images. The subject then views a series of display images where the base images have different levels of frequency and the degradation of the non-central vision portion of the corresponding display images is the set high-degree degradation. The frequency threshold is set to be the frequency of the highest-frequency base image which the subject does not notice when the non-central vision portion of the corresponding display image is generated by degradation with the set high-degree degradation value.
[0187] In some embodiments, prior to one or more viewing sessions the frequency threshold, larger size and smaller size are determined in a pre-viewing session. In some embodiments of a pre-viewing session, the subject views a series of high-frequency display images, e.g., black text on a white background, where the size of the non-central vision portion is progressively decreased. The larger size is set to be the largest size of the non-central vision portion that the subject does not notice when viewing the high-frequency display images. The subject then views a series of low-frequency display images, e.g., a live-action movie, while the size of the non-central vision portion is progressively decreased from the set largest size. The smaller size is set to be the smallest size of the non-central vision portion that the subject does not notice when viewing the low-frequency display images. The subject then views a series ofdisplay images where the bases images have different levels of frequency and the size of the non-central vision portion of the corresponding display images is the set to the smaller size. The frequency threshold is set to be the frequency of the highest- frequency base image which the subject does not notice when the non-central vision portion of the corresponding display image is of the smaller size.
[0188] Type and Degree of degradation
[0189] The type of degradation applied to the non-central image portion of the base image to generate the non-central image portion of the display image is any suitable type or combination of types of degradation, for instance as described in WO 2023 / 126827 which is included by reference as if fully set forth herein. In some embodiments, the type of degradation is selected from the group consisting of blurring (reduced sharpness), reduced resolution; reduced contrast; reduced brightness, reduced color intensity; reduced or changed color palette and combinations thereof.
[0190] As noted above, in preferred embodiments at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of an image characteristic of part of the base image is the degree of degradation of the non-central vision portion, that is to say, the degree that non-central vision portion is degraded depends on the determined value. Further as noted above, in some embodiments, the degree of degradation during a viewing session is one of two predetermined values: a low degree of degradation and a high degree of degradation.
[0191] Blurring / reduced sharpness
[0192] In some embodiments, the non-central vision portion of the display image is modified so that the visual characteristics of the non-central vision portion that is degraded compared to corresponding visual characteristics of a corresponding portion in the base image is sharpness, so that the non-central vision portion of the display image is more blurred compared to the corresponding portion of the base image. Such blurring is achieved using any suitable blurring algorithm or subroutine, e.g. "Blur" in Mathematica by Wolfram. In some such embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of the characteristic of the part of the base-image is the sharpness, that is to say the degree of blurring is dependent on the determined value of the characteristic of the part of the base-image. In such embodiments where the degree of degradation during a viewing session is one of two predetermined valuesthere is a low degree of degradation where the sharpness is reduced a first amount and and a high degree of degradation where the reduced is reduced by a second amount, the second amount being greater than the first amount. In some preferred embodiments, the second amount is twice that of the first amount. In some embodiments, the high degree of degradation leads to half the sharpness of the low degree of degradation.
[0193] Reduced resolution
[0194] In some embodiments, the non-central vision portion of the display image is modified so that the visual characteristics of the non-central vision portion that is degraded compared to corresponding visual characteristics of a corresponding portion in the base image is resolution, so that the non-central vision portion of the display image has a lower resolution compared to the corresponding portion of the base image. Such resolution reduction is achieved using any suitable resolution reduction algorithm or subroutine, e.g. "ImageAdjust" in Mathematica by Wolfram. In some such embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of the characteristic of the part of the base-image is the resolution, that is to say the degree of resolution reduction is dependent on the determined value of the characteristic of the part of the base-image. In such embodiments where the degree of degradation during a viewing session is one of two predetermined values there is a low degree of degradation where the resolution is reduced by a first amount and and a high degree of degradation where the resolution is reduced by a second amount, the second amount being greater than the first amount. In some preferred embodiments, the second amount is twice that of the first amount. In some embodiments, the high degree of degradation leads to half the resolution of the low degree of degradation.
[0195] Reduced contrast
[0196] In some embodiments, the non-central vision portion of the display image is modified so that the visual characteristics of the non-central vision portion that is degraded compared to corresponding visual characteristics of a corresponding portion in the base image is contrast, so that the non-central vision portion of the display image has a lower contrast compared to the corresponding portion of the base image. Such contrast reduction is achieved using any suitable resolution reduction algorithm or subroutine, e.g. "ImageAdjust" in Wolfram Mathematica by Wolfram Research (Champaign, Illinois, USA). In some such embodiments, at least one characteristic of the non-central vision portion of the display imagethat is dependent on the determined value of the characteristic of the part of the base-image is the contrast, that is to say the degree of contrast reduction is dependent on the determined value of the characteristic of the part of the base-image. In such embodiments where the degree of degradation during a viewing session is one of two predetermined values there is a low degree of degradation where the contrast is reduced by a first amount and and a high degree of degradation where the contrast is reduced by a second amount, the second amount being greater than the first amount. In some preferred embodiments, the second amount is twice that of the first amount. In some embodiments, the high degree of degradation leads to half the contrast of the low degree of degradation.
[0197] Reduced brightness
[0198] In some embodiments, the non-central vision portion of the display image is modified so that the visual characteristics of the non-central vision portion that is degraded compared to corresponding visual characteristics of a corresponding portion in the base image is brightness, so that the non-central vision portion of the display image has a lower brightness compared to the corresponding portion of the base image. Such brightness reduction is achieved using any suitable resolution reduction algorithm or subroutine, e.g. "ImageAdjust" in Mathematica by Wolfram. In some such embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of the characteristic of the part of the base-image is the brightness, that is to say the degree of brightness reduction is dependent on the determined value of the characteristic of the part of the base-image. In such embodiments where the degree of degradation during a viewing session is one of two predetermined values there is a low degree of degradation where the brightness is reduced by a first amount and and a high degree of degradation where the brightness is reduced by a second amount, the second amount being greater than the first amount. In some preferred embodiments, the second amount is twice that of the first amount. In some embodiments, the high degree of degradation leads to half the brightness of the low degree of degradation.
[0199] Reduced color intensity
[0200] In some embodiments, the non-central vision portion of the display image is modified so that the visual characteristics of the non-central vision portion that is degraded compared to corresponding visual characteristics of a corresponding portion in the base image is color intensity, so that the non-central vision portion of the display image has a lower colorintensity compared to the corresponding portion of the base image. Such color intensity reduction is achieved using any suitable resolution reduction algorithm or subroutine, e.g. "ImageAdjust" in Mathematica by Wolfram. In some such embodiments, at least one characteristic of the non-central vision portion of the display image that is dependent on the determined value of the characteristic of the part of the base-image is the color intensity, that is to say the degree of reduction of the color intensity is dependent on the determined value of the characteristic of the part of the base-image. In such embodiments where the degree of degradation during a viewing session is one of two predetermined values there is a low degree of degradation where the color intensity is reduced by a first amount and and a high degree of degradation where the color intensity is reduced by a second amount, the second amount being greater than the first amount. In some preferred embodiments, the second amount is twice that of the first amount. In some embodiments, the high degree of degradation leads to half the color intensity of the low degree of degradation.
[0201] Degradation of one, some or all color channels
[0202] The degradation of the non-central image portion of the display image can be for one, some or all of the color channels of the base image, for example only one color channel or only two color channels.
[0203] Accordingly, in some embodiments the generating of the display image from the base image is such that the visual characteristics of only a single color channel of the non-central vision portion of the display image are degraded compared to the visual characteristics of the same color channel of the corresponding portion of the base image, e.g., only the red channel, only the green channel or only the blue channel is degraded. Preferably, in such embodiments the other color channels of the display image are generated in substantially in the same way as the central-vision portion of the display image.
[0204] In some embodiments the generating of the display image from the base image is such that visual characteristics of only two color channels of the non-central vision portion of the display image are degraded compared to the visual characteristics of the same two color channels of the corresponding portion of the base image, e.g., only the red and green channels, only the red and blue channels, or only the green and blue channels. Preferably, in such embodiments the other color channels of the display image are generated in substantially in the same way as the central-vision portion of the display image.
[0205] In some embodiments the generating of the display image from the base image is such that visual characteristics of all color channels of the non-central vision portion of the displayimage are degraded compared to the visual characteristics of the same color channels of the corresponding portion of the base image.
[0206] In preferred embodiments, the teachings herein are applied symmetrically to both eyes, that is to say, a display image generated based on determining the gaze direction of the first eye is also displayed to the second eye, for example, both eyes view the same display image on the same screen although in some embodiments both eyes view the same display image on a different screen (e.g., when viewing on a device that includes a separate screen for each eye. In some alternative embodiments, concurrently with the described above for the first eye, the gaze direction of the second eye of the subject is determined, a second display image is generated based on the determined gaze direction of the second eye and the second display image is displayed to the second eye of the subject, where the second display image is generated in substantially the same way, mutatis mutandis, as the display image is generated.
[0207] As known in the art, an eye-tracker is often used to determine the gaze direction of an eye looking at a display screen. A period of time during which a subject looks at a display screen for some reason during which period of time an eye-tracker determines the gaze direction of an eye of the subject is called a session. Immediately prior to a session an eyetracker is typically calibrated using a calibration sequence. A calibration sequence typically involves a series of calibration events. Each calibration event comprises the display of a discrete calibration object on the display screen while the eye-tracker monitors the eyes of the subject. A controller controlling the eye-tracker correlates the location of each calibration object with the respective input received from the eye-tracker, thereby calibrating the eyetracker for that session. Typically, the location of the calibration target of each calibration event of a calibration sequence is different.
[0208] As is known in the art, during a single calibration event an eye-tracker acquires a set comprising a number of calibration images of an eye while the subject is presumed to be looking at a discrete calibration object. Although in some instances the number of calibration images in a set is one, more typically the number of calibration images in a set is greater than one, e.g., ten to twenty images. Since calibration images are typically acquired at a rate of at least 30 Hz, ten to twenty calibration images correspond to looking at the calibration object for around 0.33 to 0.66 seconds. The acquired calibration images of a set are combined by a processor to provide a single reference that is stored that represents how the eye appears to the eye-tracker when looking at the location of the screen where the calibration object is displayed. During actual use of the eye-tracker to determine a gaze direction, an image of the eye is acquired and compared to the stored references to determine the gaze direction. Insome instances, one or more of the number of acquired calibration images of a set that are outliers are discarded to provide a better reference.
[0209] Dedicated hardware eye-trackers generally maintain acceptable calibration throughout a session, even a session that lasts a number of hours.
[0210] Since dedicated hardware eye-trackers are not necessarily readily available, it is known to use a software eye-tracker which determines gaze direction of one or both eyes of a user by analyzing images acquired by a visible-light camera, for example a general-purpose camera such as a webcam or the integral camera of a computer or smartphone. Examples of commercially-available eye-tracking software include software from iMotions Lab (Copenhagen, Denmark) or software from Eyeware Tech SA (Martigny, Switzerland). A disadvantage of software eye-trackers is that these have been found to be more sensitive to the position, orientation and distance of the head relative to the camera as well as lighting conditions. As a result, software-based eye tracking is typically less accurate than hardware eye-tracking. When used in the context of treatment of refractive errors as described herein or in US 11,918,284 where a part of a displayed image is degraded as a function of a determined gaze direction, the inaccuracy of a software eye-tracker can lead to one or more of reduced-efficacy, subject irritation and reduced compliance.
[0211] According to an aspect of some embodiments of the teachings herein, there is provided a method of calibrating an eye-tracker that tracks the gaze direction of at least one eye of a subject who is viewing content displayed on a display screen, comprising:
[0212] providing a display device including:
[0213] a graphic-user interface (GUI) comprising a display screen and a user-command input component;
[0214] an eye-tracker for tracking the gaze direction of at least one eye of a subject looking at content displayed on the display screen; and
[0215] a controller comprising a computer processor for controlling other components of the display device including displaying content on the display screen and receiving input from the input component and the eye-tracker;
[0216] in a session during which the controller displays content on the display screen, the controller periodically receiving a gaze-direction of at least one eye of the subject as determined by the eye-tracker;
[0217] at least one time during the session, when the controller receives a user-command through the GUI at a single location of the display screen which command lasts longer than a minimal threshold, the controller initiating an eye-tracker-calibration eventwith the single location as a calibration target.
[0218] The method can be implemented using any suitable device or combination devices. In some preferred embodiments, the method is implemented using a display device according to the teachings herein for tracking the gaze direction to at least one eye of a subject who is viewing content displayed on a display screen, an embodiment of which, display device 30 is schematically depicted in Figure 4 and another embodiment of which, display device 32, is schematically depicted in Figure 5.
[0219] Display devices 30 and 32 comprise:
[0220] a graphic-user interface 34 (GUI) comprising a display screen 36 and a user-command input component 38;
[0221] an eye-tracker 40, 40a, 40b for tracking the gaze direction of at least one eye of a subject looking at content displayed on display screen 36; and
[0222] a controller 42 comprising a computer processor 44 for controlling other components of display devices 30 and 32 including displaying content on display screen 36, receiving input from input component 38 and from eye-tracker 40, 40a, 40b,
[0223] wherein controller 42 is configured so that in a session during which controller 42 displays content on display screen 36, controller 42 periodically receives a gaze-direction of at least one eye of the subject determined by eye-tracker 40, 40a, 40b;
[0224] at least one time during the session, when controller 42 receives a user-command from input component 38 through GUI 34 at a single location 46 of display screen 36 which command lasts longer than a minimal threshold, controller 42 initiates an eye-tracker calibration event with single location 46 as a calibration target.
[0225] Display device 30 depicted in Figure 4 is a generic smartphone such as a Samsung S25 Plus. GUI 34 comprising display screen 36 and input component 38 is the touchscreen of the smartphone. Controller 42 is the controller of the smartphone, including hardware and software with at least one computer processor 44. In device 30, eye-tracker 40 is the integral visible-light camera of the smartphone together with suitable software.
[0226] Display device 32 depicted in Figure 5 is a generic laptop computer such as a Lenovo Legion 7i Gen 9. GUI 34 comprises display screen 36, the integral display screen of the computer, and input component 38, a computer mouse functionally-associated with the computer. Controller 42 is the controller of the computer, including hardware and software with at least one computer processor 44. Device 32 comprises two different eye-trackers. A user can select to use one or the other eye-tracker for a given session. A first eye-tracker 40a is the integral visible-light camera of the computer together with suitable software. A secondeye-tracker 40b is a dedicated hardware eye-tracker from Tobii AB (Stockholm, Sweden). An embodiment of the method according to the teachings herein implemented using an embodiment of a display device according to the teachings herein is discussed with reference to flowchart 200 depicted in Figure 6.
[0227] A subject is using a display device to view content (e.g., play a game, watch a video, edit text) during a session.
[0228] In the usual way, controller 42 both periodically receives a gaze direction determined by eye-tracker 40, 40a, 40b and continuously monitors receipt of user input from input component 38, box 202.
[0229] When input is received from input component 38, controller 42 monitors the duration of the received input command, for example, how long a finger / stylus presses single location 46 on display screen 36 of device 30 or how long the left button of mouse 38 is depressed while the cursor is located at single location 46 on display screen 36 of device 32, box 204.
[0230] When the duration of the received input command lasts longer than a minimal threshold 206, controller 42 initiates an eye-tracker calibration event with single location 46 as the calibration target, box 208.
[0231] In some embodiments, the calibration event is an active calibration event that is initiated by the subject, for example, because the subject feels that a calibration event is necessary. In order to avoid confusion between a regular user command entered via GUI 34 to perform some action that is unrelated to the teachings herein and a user command entered via GUI 34 to initiate a calibration event in accordance with the teachings herein, the minimal threshold of an active calibration event is relatively long, in some embodiments greater than about 0.5 seconds.
[0232] As is discussed in greater detail herein below, in some embodiments the calibration event is a passive calibration event that is automatically initiated. In such passive calibration events, the minimal threshold which the command lasts is preferably the same as a normal GUI command, for example, greater than about 0.001 seconds and even greater than about 0.05 seconds. Typically, concurrently with initiating an eye-tracker calibration event, the controller also treats the user-command received from the input component in the usual way independently of initiating a passive calibration event in accordance with the teachings herein.
[0233] In some embodiments, the method of the teachings herein is implemented only with active calibration events. In some embodiments, the method is implemented only withpassive calibration events. In some embodiments, the method is implemented with both passive and active calibration events.
[0234] In some embodiments, a device according to the teachings herein is configured to implement only active calibration events. In some embodiments, a device according to the teachings herein is configured to implement only passive calibration events. In some embodiments, a device according to the teachings herein is configured to implement both passive and active calibration events.
[0235] In the teachings herein, it is assumed that a subject who enters a command through a GUI is looking at the location of the command on the display screen while entering the command. Specifically, a subject using a touchscreen to enter a command presses the location of the command with a finger while looking at the finger. A subject using a mouse to enter a command looks at the cursor which is located at the location of the command on the display screen while clicking on the left button of the mouse to enter the command.
[0236] The display device is any suitable display device, for example a tablet, a smartphone (e.g., device 30), a laptop computer (e.g., device 32), a desktop computer and dedicated display device for a particular use.
[0237] The method is implemented using and the display device comprises any suitable eyetracker. In some embodiments the method is implemented using and the display device comprises a dedicated hardware eye-tracker (e.g., eye-tracker 40b of device 32). In some embodiments the method is implemented using or the display device comprises a software eye-tracker, including a visible-light camera to acquire images of a subject and software that determines a gaze direction of at least one eye from a visible-light image acquired by the visible-light camera, for example, a webcam, a dedicated camera of a computer (e.g., as commonly found on a laptop computer), a camera of a smartphone, tablet or similar device or a camera of a specialized display device (e.g., eye-tracker 40 of device 30 or eye-tracker 40b of device 32).
[0238] The GUI is any suitable GUI. In some embodiments, the display screen and the usercommand input component are a touchscreen (e.g., as in device 30). In some embodiments the display screen is a computer screen and the user-command input component is any suitable pointing component, for example a mouse, a light pen, a trackball, a keyboard, a joystick, a touchpad, and a track point (e.g., as in device 32).
[0239] The controller (which in some embodiments comprises a single computer processor and in some embodiments comprises multiple computer processors that work together, together with necessary peripheral hardware and software (such as an operating system)necessary for proper operation of the controller) is typically the controller of the display device. In some alternative embodiments the controller comprises or consists of an additional computer processor that is functionally-associated with the other components, for example, via a USB connector.
[0240] A session is as defined above, a period of time during which a subject looks at a display screen for some reason during which period of time an eye-tracker determines the gaze direction of an eye of the subject. For example, in some embodiments a session is playing a game, watching video content, reading text and editing text. During a session, the controller periodically receives a gaze-direction of at least one eye of the subject determined by the eye-tracker. In some embodiments, by "periodically" is meant receiving a gazedirection at regular intervals. In some alternative embodiments, by "periodically" is mean receiving a gaze-direction from time to time but not necessarily at regular intervals.
[0241] As noted above, at least one time during the session, when the controller receives a user-command through the GUI which command lasts longer than a minimal threshold at a single location of the display screen, the controller initiates an eye-tracker-calibration event with the single location as the calibration target.
[0242] Active calibration event
[0243] As noted above, in some embodiments, the calibration event is an active calibration event where the subject chooses to initiate a calibration event at any location on the display screen without any specific graphical target which is often required to initiate a command. In such an active calibration event, the minimal threshold which the command lasts is preferably longer than a normal GUI command, in some embodiments greater than about 0.5 seconds and even greater than about 1 second. Accordingly, when the user feels that it is necessary to initiate a calibration event, the user inputs a long GUI command (e.g., a long touch on a touch screen, a long press on a mouse right-button, left button and / or center button as configured).
[0244] Passive calibration event
[0245] As noted above, in some embodiments the calibration event is a passive calibration event that is automatically-initiated.
[0246] A passive calibration event is initiated when the controller identifies an input event which is assumed to have a long enough fixation of the eyes over a single location of the display screen. For instance, any time a single location of a display screen, such as an icon or text box, is selected by a user using an in input component such as by touching a touch screenor clicking a mouse button, it is assumed the user is fixating on single location during the selection and for a period of time before and after the selection.
[0247] In some embodiments, every time that the controller receives a user-command from the input component through the GUI at a single location of the display screen which command lasts longer than a minimal threshold, the controller initiates a passive calibration event. In some embodiments, there are additional conditions for initiating a passive calibration event. For instance, in some preferred embodiments, for a controller to initiate a passive calibration event a command must be no longer than a maximum duration, in some preferred embodiments being not longer than 0.2 seconds and in some embodiments even no longer than 0.15 seconds. In some instances, such embodiments initiate an excessive number of passive calibration events, leading to an undesired burden on the processor. To avoid initiation of excessive passive calibration events, in preferred embodiments the number of passive calibration events that can be initiated in a period of time is limited. For example, in some embodiments, following every passive calibration event, the controller initiates a rest period having a duration during which no additional passive calibration event can be initiated. As soon as the rest period is over, the controller is ready to accept the next received usercommand to initiate a new passive calibration event. In some such embodiments the rest period is not less than about 10 seconds. In some such embodiments the rest period is not less than about 5 minutes.
[0248] As discussed above, a prior art calibration event of an eye-tracker includes:
[0249] a. displaying on a display screen a discrete calibration object located at a single location;
[0250] b. while the subject is looking at the calibration object, an eye-tracker acquires a set comprising a number of calibration images (the set typically comprising between 1 and 20 images); and
[0251] c. the calibration images of the set are combined by a processor to provide a single reference that represents how the eye appears to the eye-tracker when looking at the single location of the display screen where the calibration object is displayed.
[0252] In some embodiments, a calibration event initiated according to the teachings herein (passive or active) is similar or identical to prior art calibration events that is associated with the specific eye-tracker used to implement the teachings herein.
[0253] In some embodiments, an initiated calibration event (passive or active) according to the teachings herein includes acquisition of a single calibration image. In some embodiments, the single calibration image is an image acquired after initiation of the calibration event, insome embodiments immediately after initiation of the calibration event. Alternatively, in some embodiments, the single calibration image is an image acquired prior to initiation of the calibration event, in some embodiments immediately prior initiation of the calibration event.
[0254] In some preferred embodiments, a calibration event comprises acquisition of at least two calibration images, at least one of which is acquired after initiation of the calibration event, preferably a series of consecutive calibration images acquired immediately after initiation of the calibration event. The number of calibration images acquired after initiation of the calibration event is any suitable number and is typically limited to be less than the number of calibration images that are acquired within 0.3 seconds subsequent to the receipt of the user-command through the GUI. As a result, for example eye-trackers having a rate of 30 frames per second (30 fps) the number of such calibration images is not greater than ten images while for example eye-trackers having a rate of 60 fps the number of such calibration images is not greater than twenty images.
[0255] Additionally, or alternatively, in some preferred embodiments, a calibration event comprises acquisition of at least two calibration images, at least one of which is acquired prior to initiation of the calibration event, preferably a series of consecutive calibration images acquired immediately prior to initiation of the calibration event. The number of calibration images acquired prior to initiation of the calibration event is any suitable number and is typically limited to be less than the number of calibration images that are acquired within 0.3 seconds prior to the receipt of the user-command through the GUI. As a result, for example eye-trackers having a rate of 30 frames per second (30 fps) the number of such calibration images is not greater than ten images while for example eye-trackers having a rate of 60 fps the number of such calibration images is not greater than twenty images. In such embodiments, the eye-tracker acquires images of the eye with no connection to receipt of a command to initiate calibration and the controller designates previously-acquired images as calibration images retrospectively during an initiated calibration event. In some embodiments, the eye-tracker continuously acquires images of the eye and only the desired number of the most recently-acquired images are stored in a buffer as potential calibration images. For example, in some preferred embodiments, a circular buffer for storing only the desired number of images is provided. Once the buffer is filled, the following-acquired image overwrites the oldest image stored in the buffer so at any given moment the buffer stores the most recently acquired desired number of images.
[0256] The acquired calibration images (acquired before or after initiation of the calibration event) together constitute the set of calibration images that are combined by the processor toprovide a reference for the location on the display screen where the calibration target is located. In some embodiments where the set of calibration images includes images that were acquired after receipt of the command, the last-acquired calibration image or images are checked against the provided references to identify if these are outliers and, if yes, a new reference is provided by combining a set of images that does not include the outliers. Additionally, or alternatively, in some embodiments where the set of calibration images includes images that were acquired prior to receipt of the command, the oldest acquired calibration image or images are checked against the provided references to identify if these are outliers and, if yes, a new reference is provided by combining a set of images that does not include the outliers.
[0257] In the art, for example, US 2022 / 0057651 and in US 11,918,284 as well as herein above are disclosed methods for treatment and / or prevention of ophthalmological conditions that include generating a display image from a base image, where in some embodiments a portion of the display image is degraded, i.e., of lower quality than a corresponding portion of the base image.
[0258] In such methods, the size of a degraded portion is generally pre-defined. Further, in such methods the degree and / or type of degradation (e.g., selected from the group consisting of: reduced resolution; blurring; reduced contrast; reduced / increased brightness; reduced color intensity; reduced or changed color palette and combinations thereof) is generally predetermined.
[0259] According to an aspect of some embodiments of the teachings herein, the identity of a subject is used as an input parameter for generating a display image from a base image.
[0260] In such embodiments, the identity of the subject is provided to a computer processor. For example, in some embodiments, the subject is asked to input their identity; in some embodiments the subject must log-in and is thereby identified by a computer processor; in some embodiments, an image of the subject is captured using a camera and the image is analyzed to identify the subject.
[0261] In some such embodiments, one or more of the size of the degraded portion, the type of degradation and the degree of degradation that is used to generate the display image from the base image is determined also based on the identity of the subject provided to the computer processor.
[0262] The specific reasons to select a give degraded portion size, degradation type or degradation degree include:
[0263] a decision by a health-care professional;output of a dedicated computer program (e.g., expert system, Artificial Intelligence) based on data relating to the specific subject or subject characteristics;
[0264] the susceptibility of the subject to viewing the display images, e.g., as determined by monitoring the historical effect the display images have on the subject;
[0265] previously recorded subject preferences; and
[0266] previously recorded patterns of eye-movement during viewing of display images. As noted above, in the art, for example, US 2022 / 0057651 and in US 11,918,284 as well as hereinabove are disclosed methods for treatment and / or prevention of ophthalmological conditions that include generating a display image from a base image, where the display image comprises a central -vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and a non-central vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image. It has been found that it can be advantageous that when the content of the portion of the base image that corresponds to the central vision portion is text, the horizontal dimensions of the central vision portion are greater than when the content is not text due to the natural horizontal scanning movement of the eye during reading.
[0267] Thus, according to an aspect of some embodiments of the teachings herein, there is provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0268] a. determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from a received digital base image, wherein:
[0269] i. there is a central -vision portion of the display image that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0270] ii. there is a non-central vision portion of the display image that is different from the central-vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to corresponding visual characteristics of a corresponding portion in the base image; and
[0271] c. displaying the generated display image on the display screen so that the first eye ofthe subject views the display image on the display screen,
[0272] further comprising:
[0273] analyzing the content of the base image in the area that corresponds to the central vision portion and:
[0274] if the content is not-text, the shape of the central -vision portion is first shape having a first vertical dimension and a first horizontal dimension; and
[0275] if the content is text, the shape of the central-vision portion is second shape different from the first shape having a second vertical dimension and a second horizontal dimension, where the second horizontal dimension is greater than the first horizontal dimension.
[0276] For example, in some such embodiments, the first shape is a circle with the first vertical dimension equal to the first horizontal dimension and the second shape is an oval with second vertical dimension equal to the first vertical dimension and the second horizontal dimension greater that the first horizontal dimension.
[0277] According to an aspect of some embodiments of the teachings herein, there is also provided a device comprising a display screen, a computer program and software configured to implement the method described immediately hereinabove. In some such embodiments, there is provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0278] a computer processor functionally-associated with a display screen and an eye-tracker, the eye-tracker configured for determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to the computer processor, the computer processor comprising a computer-readable storage medium having instructions stored thereon, when executed the instructions cause the computer processor to perform the following:
[0279] - based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from a received digital base image, wherein:
[0280] i. there is a central -vision portion of the display image that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and ii. there is a non-central vision portion of the display image that is different from the central-vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to corresponding visual characteristics of a corresponding portion in the base image;- displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen; and
[0281] - analyzing the content of the base image in the area that corresponds to the central vision portion and:
[0282] if the content is not-text, the shape of the central -vision portion is first shape having a first vertical dimension and a first horizontal dimension; and
[0283] if the content is text, the shape of the central -vision portion is second shape different from the first shape having a second vertical dimension and a second horizontal dimension, where the second horizontal dimension is greater than the first horizontal dimension.
[0284] As noted above, in the art, for example, US 2022 / 0057651 and in US 11,918,284 as well as herein above are disclosed methods for treatment and / or prevention of ophthalmological conditions that include generating a display image from a base image, where the display image comprises a central -vision portion that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and a non-central vision portion that is modified so that visual characteristics of the non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in the base image. Instead of analyzing the content of the base image which analysis can be resource intensive and cause delay in display of the desired content, it is herein disclosed that the degree of degradation of the non-central vision portion and / or the size of the non-central vision portion is dependent on the program (e.g., application) which is being displayed at the portion of the base image which corresponds to the non-central vision portion.
[0285] Thus, according to an aspect of some embodiments of the teachings herein, there is provided a method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0286] a. determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to a computer processor; b. subsequent to 'a', based on the determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on the display screen from a received digital base image, wherein:
[0287] i. there is a central -vision portion of the display image that corresponds to a portion of the field of view of the first eye that includes the determined gaze direction, and
[0288] ii. there is a non-central vision portion of the display image that is differentfrom the central-vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to corresponding visual characteristics of a corresponding portion in the base image, and
[0289] c. displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen
[0290] further comprising:
[0291] determining the program that is generating the content that is displayed on the portion of the base image that corresponds to the non-central vision portion; and
[0292] during the generating of the display image, the generating of the non-central vision portion of the display image is further dependent on the determined program.
[0293] In some embodiments, if the determined program is primarily a text-displaying program (e.g., a text-editing program, a spreadsheet) then the degree of degradation and / or the size of the non-central vision portion is as described above when high-frequency image quality is determined and if the determined program is primarily an image-displaying program (for example, Youtube or TikTok which are primarily used for displaying video) then the degree of degradation and / or the size of the non-central vision portion is as described above when low-frequency image quality is determined.
[0294] According to an aspect of some embodiments of the teachings herein, there is also provided a device comprising a display screen, a computer program and software configured to implement the method described immediately hereinabove. In some such embodiments, there is provided a device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:
[0295] a computer processor functionally-associated with a display screen and an eye-tracker, the eye-tracker configured for determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing the determined gaze direction to the computer processor, the computer processor comprising a computer-readable storage medium having instructions stored thereon, when executed the instructions cause the computer processor to perform the following:
[0296] - based on the determined gaze direction of the first eye, generating a display image for display to the first eye on the display screen from a received digital base image, wherein:
[0297] i. there is a central -vision portion of the display image that corresponds to a portion of the field of view of the first eye that includes the determined gazedirection, and
[0298] ii. there is a non-central vision portion of the display image that is different from the central-vision portion that is modified so that visual characteristics of the non-central vision portion of the display image are degraded compared to corresponding visual characteristics of a corresponding portion in the base image;
[0299] - displaying the generated display image on the display screen so that the first eye of the subject views the display image on the display screen; and
[0300] - determining the program that is generating the content that is displayed on the portion of the base image that corresponds to the non-central vision portion; and during the generating of the display image, generating the non-central vision portion of the display image also dependent on the determined program.
[0301] In the art, for example, US 11,064,882, US 2022 / 0057651 and in US 11,918,284 as well as hereinabove are disclosed methods for treatment and / or prevention of ophthalmological conditions, the methods including the use of an eye-tracker to determine a gaze direction of one or both eyes of a subject which gaze direction is used as input for preparing a display image from a base image.
[0302] In some instances, it is not possible to determine the gaze direction. For instance, the eyes of the subject cannot be detected by the eye-tracker, for instance, the subject is wearing glasses that block detection of the eyes, there is insufficient light, there is light that illuminates the subject in a way that prevents detection of the eyes or there is a reason that prevents the eye-tracker from focusing on the subject.
[0303] In some instances, the eyes cannot be detected due to incidental reasons, such as lighting conditions in a room where the subject is sitting. In some cases, the eyes cannot be detected due to an intentional decision, e.g., a subject does not look at the screen or outside of the detectable area in front of the eye-tracker.
[0304] According to an aspect of some embodiments of the teachings herein, there is provided a method of operating a camera as an eye-tracker to determine the gaze direction of at least one eye of a subject who is viewing content on a display screen, the method comprising:
[0305] with an eye-tracker, attempting to determine the gaze direction of at least one eye of a subject viewing content displayed on a display screen;
[0306] if the attempt to determine the gaze direction succeeds, the computer processor returning the determined gaze direction; andif the attempt to determine the gaze direction fails, the computer processor returning a value that a gaze direction was not determined.
[0307] When the computer processor returns a determined gaze direction, the display of the content proceeds as usual with regards to the determined gaze direction. For example, in some embodiments where a determined gaze direction is used as input to help generate a display image from a base image, the display image having a non-central vision portion of lower quality than a central vision portion (as described herein and in US 11,918,284, then the display image is generated as usual.
[0308] In some embodiments, where a determined gaze direction is used as input to help generate a display image from a base image, the display image having a non-central vision portion of lower quality than a central vision portion (as described herein and in US 11,918,284, the computer processor returning a value that that a gaze direction was not determined comprises displaying the base image as a display image.
[0309] In some embodiments, where a determined gaze direction is used as input to help generate a display image from a base image, the display image having a non-central vision portion of lower quality than a central vision portion (as described herein and in US 11,918,284, the computer processor returning a value that that a gaze direction was not determined comprises one or more of: the size of the non-central vision portion is smaller than if the gaze direction had been determined; the degree of the degradation of the non-central vision portion is less than if the gaze directions had been determined; and a subsequent display image is generated using a pre-determined screen coordinate as a surrogate for a determined gaze direction (e.g., the center of the screen).
[0310] The above-two embodiments are particularly suitable when there is an incidental failure to determine the gaze direction.
[0311] In some instances, the failure to determine the gaze direction is not incidental. For instance, the subject is in a room with inappropriate illumination or is wearing glasses that cover the eyes. In such instances, the failure to determine the gaze direction can be solved, for example, by improving the illumination in the room or removing the glasses.
[0312] Accordingly, in some embodiments, a computer processor analyzes the image and identify the suspected reason for no detection such as low illumination, reflection from glasses, or closed eyes, records the number of times the computer processor returns a value that that a gaze direction was not determined, and, if the number of times is greater than a predetermined number, the computer processor generating a specific warning according to the analyzed reason. In some such embodiments, a computer processor records the number ofconsecutive times the computer processor returns a value that that a gaze direction was not determined, and, if the number of times is greater than a predetermined number, the computer processor generating a warning.
[0313] In some embodiments, the number of times is greater than 1. In some embodiments, the number of times corresponds to at least 1 second of content-viewing.
[0314] In some embodiments, generating a warning comprises displaying a visible message on the display screen. In some embodiments, generating a warning comprises displaying a visible message on the display screen of a different device, for example, in the smartphone of a parent. In some such embodiments, the visible warning is a pop-up (as known in the art of graphical user interfaces).
[0315] Additionally, or alternatively, in some embodiments, generating a warning comprises stopping display of the content.
[0316] In some embodiments, the eye-tracker is a software eye-tracker that analyzes image of the subject acquired by a camera. In such embodiments, the camera is any suitable camera for example a webcam or camera such as found on smartphone, tablet, laptop computer or desktop computer. The software eye-tracker is any suitable software that can be used to determine a gaze direction based on an acquired image, for example, software from Eyeware Tech SA (Marti gny, Switzerland) or from iMotions Lab (Copenhagen, Denmark).
[0317] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention pertains. In case of conflict, the specification, including definitions, takes precedence.
[0318] As used herein, the terms “comprising”, “including”, "having" and grammatical variants thereof are to be taken as specifying the stated features, integers, steps or components but do not preclude the addition of one or more additional features, integers, steps, components or groups thereof.
[0319] As used herein, the indefinite articles "a" and "an" mean "at least one" or "one or more" unless the context clearly dictates otherwise.
[0320] As used herein, when a numerical value is preceded by the term "about", the term "about" is intended to indicate + / -10%.
[0321] As used herein, a phrase in the form “A and / or B” means a selection from the group consisting of (A), (B) or (A and B). As used herein, a phrase in the form “at least one of A, B and C” means a selection from the group consisting of (A), (B), (C), (A and B), (A and C), (B and C) or (A and B and C).
[0322] Embodiments of methods and / or devices described herein may involve performing orcompleting selected tasks manually, automatically, or a combination thereof. Some methods and / or devices described herein are implemented with the use of components that comprise hardware, software, firmware or combinations thereof. In some embodiments, some components are general-purpose components such as general purpose computers or digital processors. In some embodiments, some components are dedicated or custom components such as circuits, integrated circuits or software.
[0323] For example, in some embodiments, some of an embodiment is implemented as a plurality of software instructions executed by a data processor, for example which is part of a general-purpose or custom computer. In some embodiments, the data processor or computer comprises volatile memory for storing instructions and / or data and / or a non-volatile storage, for example, a magnetic hard-disk and / or removable media, for storing instructions and / or data. In some embodiments, implementation includes a network connection. In some embodiments, implementation includes a user interface, generally comprising one or more of input devices (e.g., allowing input of commands and / or parameters) and output devices (e.g., allowing reporting parameters of operation and results.
[0324] It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination or as suitable in any other described embodiment of the invention. Certain features described in the context of various embodiments are not to be considered essential features of those embodiments, unless the embodiment is inoperative without those elements.
[0325] Although the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the scope of the appended claims.
[0326] Citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the invention.
[0327] Section headings are used herein to ease understanding of the specification and should not be construed as necessarily limiting.
Claims
CLAIMS:
1. A method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:a. determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing said determined gaze direction to a computer processor; b. subsequent to 'a', based on said determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on said display screen from a received digital base image, wherein said display image includes:i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes said determined gaze direction, andii. a non-central vision portion that is different from said central -vision portion that is modified so that visual characteristics of said non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in said base image, andc. displaying said generated display image on said display screen so that the first eye of the subject views said display image on said display screen,further comprising:determining a value of an image characteristic of part of said base image; and during said generating of said display image, at least one characteristic of said non- central vision portion of said display image is dependent on said determined value of said characteristic of said part of said base-image.
2. A method useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:displaying a video as a sequentially-displayed series of frames on a display screen, each said frame provided to a computer processor as a digital base image, the method comprising for each provided said digital base image:a. determining a gaze direction of a first eye of a subject viewing an image on said display screen and providing said determined gaze direction to a computer processor; b. subsequent to 'a', based on said determined gaze direction of the first eye, with a computer processor generating a display image for display to the first eye on said display screen from said digital base image that was provided, wherein said display image includes:i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes said determined gaze direction, andii. a non-central vision portion that is different from said central -vision portion that is modified so that visual characteristics of said non-central vision portion of said display image are degraded compared to visual characteristics of a corresponding portion in said base image, andc. displaying said generated display image on said display screen so that the first eye of the subject views said display image on said display screen,further comprising, for a first group of said frames:determining a value of an image characteristic of part of said base image; and during the generating of said display image, at least one characteristic of said non- central vision portion of said display image is dependent on said determined value of said characteristic of said part of said base-image andfor a second group of said frames:during said generation of said display image, said generation of said non-central vision portion of said display image is dependent on said determined value of said characteristic of said part of a previously-provided base image that is a member of said first group.
3. The method of any one of claims 1 and 2, wherein said characteristic of said part of said base image for which a value is determined is a characteristic selected from the group consisting of sharpness, contrast, frequency and combinations thereof.
4. The method of any one of claims 1 to 3, wherein at least one characteristic of said non-central vision portion of said display image that is dependent on said determined value is the degree of degradation of said non-central vision portion.
5. The method of claim 4, wherein said determining of said value of said characteristic of said part of said base image comprises determining the sharpness of said part, wherein: said non-central vision portion of said display image is degraded more when a determined sharpness is lower and is degraded less when a determined sharpness is higher.
6. The method of any one of claims 4 to 5, wherein said determining of said value of said characteristic of said part of said base image comprises determining the contrast of saidpart, wherein:said non-central vision portion of said display image is degraded more when a determined contrast is lower and is degraded less when a determined contrast is higher.
7. The method of any one of claims 4 to 6, wherein said determining of said value of said characteristic of said part of said base image comprises determining the frequency of said part, wherein:said non-central vision portion of said display image is Please replace with the finalized text describing frequency8. The method of any one of claims 1 to 7, wherein at least one characteristic of said non-central vision portion of said display image that is dependent on said determined value of said image characteristic is the size of said non-central vision portion.
9. The method of claim 8, wherein said determining of said value of said characteristic of said part of said base image comprises determining the sharpness of said part, wherein: the size of said non-central vision portion of said display image is larger more when a determined sharpness is lower and is smaller when a determined sharpness is higher.
10. The method of any one of claims 8 to 9, wherein said determining of said value of said characteristic of said part of said base image comprises determining the contrast of said part, wherein:the size of said non-central vision portion of said display image is larger when a determined contrast is lower and is smaller when a determined contrast is higher.
11. The method of any one of claims 8 to 10, wherein said determining of said value of said characteristic of said part of said base image comprises determining the sharpness of said part comprises determining the frequency of said part, wherein:the size of said non-central vision portion of said display image is larger Same here12. A device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:a computer processor functionally associated with a display screen and an eye tracker, said eye tracker configured for determining a gaze direction of a first eye of a subject viewing animage on a display screen and providing said determined gaze direction to said computer processor; said computer processor comprising a computer-readable storage medium having instructions stored thereon, when executed, said instructions cause the computer processor to perform the following steps:a. receive a gaze direction of a first eye of a subject viewing an image on said display screen determined by said eye tracker;b. subsequent to 'a', based on said determined gaze direction of the first eye, generate a display image for display to the first eye on said display screen from a received digital base image, wherein said display image includes:i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes said determined gaze direction, andii. a non-central vision portion that is different from said central -vision portion that is modified so that visual characteristics of said non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in said base image, andc. display said generated display image on said display screen so that the first eye of the subject views said display image on said display screen,and to also:determine a value of an image characteristic of part of said base image; and then during said generating of said display image from the base image, at least one characteristic of said non-central vision portion of said display image is dependent on said determined value of said characteristic of said part of said base-image.
13. A device useful for the treatment of existing refractive errors and / or prevention of the development of refractive errors in a human subject, comprising:a computer processor functionally associated with a display screen and an eye tracker, said eye tracker configured for a determining a gaze direction of a first eye of a subject viewing an image on a display screen and providing said determined gaze direction to said computer processor; said computer processor configured to display a video as a sequentially-displayed series of frames on said display screen, each frame provided to a computer processor as a digital base image, the processor comprising a computer-readable storage medium having instructions stored thereon, when executed, said instructions cause the computer processor to perform the following steps:a. receive a gaze direction of a first eye of a subject viewing an image on said displayscreen determined by said eye tracker;b. subsequent to 'a', based on said determined gaze direction of the first eye, generating a display image for display to the first eye on said display screen from a received digital base image, wherein said display images includes:i. a central-vision portion that corresponds to a portion of the field of view of the first eye that includes said determined gaze direction, andii. a non-central vision portion that is different from said central -vision portion that is modified so that visual characteristics of said non-central vision portion are degraded compared to corresponding visual characteristics of a corresponding portion in said base image, andc. displaying said generated display image on said display screen so that the first eye of the subject views said display image on said display screen,further comprising, for a first group of the frames:determining a value of an image characteristic of part of said base image; and during said generating of said display image, at least one characteristic of said non- central vision portion of said display image is dependent on said determined value of said characteristic of said part of said base-image, andfor a second group of the frames:during said generating of said display image, said generating of said non-central vision portion of said display image is dependent on a determined value of said characteristic of said part of a previously-provided base image that is a member of said first group.
14. The device of any one of claims 12 to 13, wherein said characteristic of said part of said base image for which a value is determined is a characteristic selected from the group consisting of sharpness, contrast, frequency and combinations thereof.
15. The device of any one of claims 12 to 14, wherein at least one characteristic of said non-central vision portion of said display image that is dependent on said determined value is the degree of degradation of said non-central vision portion.
