A system and method for evaluating visual cognitive function.

Abstract

A computer implementation method for evaluating at least one aspect of a user's visual cognitive function, comprising: displaying multiple stimuli on the display screen of a handheld computing device; detecting the user's response or lack of response to the multiple stimuli; determining at least one attribute related to the user's response, each attribute indicating the difficulty level associated with viewing or processing the multiple stimuli; recording at least one attribute; and enabling evaluation of at least one aspect of the user's visual cognitive function.

Description

Technical Field

[0001] The present invention relates to a computer-implemented method and system for evaluating at least one aspect of a user's visual function.

Background Art

[0002] The evaluation of visual perception function is essential for understanding the health status and disease progression of a patient's eyes, vision, and cognitive system, and for understanding whether visual correction, medical intervention, or lifestyle intervention is necessary. Visual perception function is defined as the ability to acquire and interpret / process visual information. Therefore, visual perception function can be affected by a decline in the related visual system or cognitive function involved in a specific activity.

[0003] Accurately evaluating visual perception function is important for early detection of eye and brain diseases and prompt initiation of treatment. This is particularly difficult in the case of children, elderly patients, and patients with visual and / or cognitive impairments, and the results of visual acuity tests are inherently more variable. If a decrease in visual acuity is not detected, it may sometimes lead to blindness immediately. This can have a significant impact on individuals, society, and the economy.

[0004] The measurement of visual perception function and visual function is fraught with difficulties leading to variability and inaccuracy inherent in the measurement due to the limitations of conventional test charts. Variability in the examination occurs due to variations in the illumination of the printed chart and differences in the method of conducting the examination (e.g., the degree of encouragement given to the patient). If there are large individual steps in the difficulty levels shown on the visual acuity chart, it leads to a loss of measurement accuracy, further magnifying the variability in the results and impairing the identification of small or early changes in the visual state.

[0005] Common clinical visual function tests (such as the Snerlen visual acuity chart) rely on letter recognition. For children and individuals with learning disabilities or cognitive impairments, identifying and verbalizing all rows of letters and symbols is difficult, resulting in inaccurate results.

[0006] Initially, when large stimuli such as letters and symbols are presented, most users can easily distinguish them and maintain high motivation. However, as the test progresses to smaller letters and symbols in conventional vision tests, users find them harder to see and lose confidence. When users become distracted, lower levels are recorded, making it difficult for clinicians to determine whether this is due to distraction or an underlying visual problem.

[0007] When a patient reads a standard eye chart, the results are recorded as if they "correctly" read as many letters / symbols as possible, meaning there are two possible outcomes for identifying each letter / symbol: correct or incorrect. However, clinicians often report that patients with early-stage vision problems or impaired vision can often identify the symbols on the eye chart, but at a slower pace or with greater difficulty. Unfortunately, conventional eye charts and scoring methods lose this subtle and nuanced information about "difficulty," resulting in the failure to capture small changes in visual acuity. [Overview of the project] [Problems that the invention aims to solve]

[0008] The present invention provides a computer-based method and system that aims to improve the potential accuracy and precision in visual perception tests and to correct some or all of these deficiencies. [Means for solving the problem]

[0009] Several aspects of the present invention are described in the attached independent and dependent claims. Combinations of features from the dependent claims may be combined with features from the independent claims as needed, as well as if expressly described in the claims.

[0010] Understanding visual function and visual perception is fundamental to two medical specialties: ophthalmology and neurology. This invention provides a method and system for evaluating a wide range of visual perception functions, not limited to the evaluation of standard visual acuity (synonymous with letter charts), but capable of providing not only optical information but also information on neural processing of information from within the brain itself—that is, "visual cognition" information. Preferably, this invention discloses a method and system that can be performed by a user at home, as well as a method and system that provides indicators of visual perception function that are only available in specialized hospital clinics or vision research institutes.

[0011] According to a first aspect of the present invention, a computer implementation method is provided for evaluating at least one aspect of a user's visual cognitive function, the method comprising displaying a plurality of stimuli on the display screen of a computing device or system. For ease of reference, the term "device" will be used below. In a preferred embodiment, the computing device may consist of a handheld computing device.

[0012] This method may further include detecting at least one response from the user to multiple stimuli, or the absence of a response.

[0013] The method may further include determining at least one attribute related to at least one user response or lack thereof. Each attribute may indicate difficulty related to seeing or processing multiple stimuli. "Determine" may include one or more actions of measuring, detecting, or otherwise processing data related to at least one attribute. The term "attribute" may be used interchangeably with "metric."

[0014] The method may further include recording at least one attribute so that at least one aspect of the user's visual cognitive function can be evaluated. The term “evaluation” may include measuring, recording, and / or deriving data relating to at least one aspect of the user's visual cognitive function. Accordingly, embodiments of the present invention may include technical solutions for generating, measuring, processing, and / or storing data relating to at least one aspect of the user's visual cognitive function.

[0015] The term “stimulus” (plural or singular) will be understood to refer to any image, animation, or visual object that can be presented on the display screen of a handheld computing device. In some embodiments, a stimulus (singular) may include multiple images, animations, or visual objects. Optionally, the terms “target” or “image” may be used interchangeably with the term “stimulus.”

[0016] Optionally, this method may include detecting the user's response to each stimulus presented on the display screen, or the absence of a response.

[0017] Optionally, multiple stimuli may be presented on the display screen for a predetermined display time, and this method may include detecting the user's response to these multiple stimuli, or the absence of a response. These multiple stimuli may be presented repeatedly on the display screen, and a user's response or absence of a response may be detected each time they are presented.

[0018] It will be understood that attributes may be determined for each response. These attributes may indicate the difficulty associated with seeing or processing each stimulus.

[0019] In some embodiments, this attribute may be associated with a lack of user response. For example, if a user does not respond to a stimulus but approaches the screen (as described below), this may be detected as an attribute.

[0020] In one or more embodiments, the difficulty level associated with one or more stimuli among a group of stimuli may be adjusted or modified when the group of stimuli is subsequently presented to the user. In some embodiments, the difficulty level associated with all of the group of stimuli may be adjusted. The difficulty level may be adjusted or modified based on attributes previously determined for one or more stimuli. For example, if a previous presentation of a stimulus is a result of the user bringing the device close to their eyes, and therefore the attribute of distance is detected or measured, a larger version of one or more stimuli may be provided in a subsequent presentation. In another example, if a presentation of a stimulus leads to a determination of a slow reaction time, in a subsequent presentation, the stimulus may move or change in color or flashing. Subsequently determined data related to attributes (including multiple attributes) can be re-recorded. Thus, this method may include a step of (dynamically) changing the difficulty level based on at least one attribute predetermined based on the user's response or lack of response. One or more embodiments of the present invention may be configured to start with a high difficulty level and operate by making one, several, or all of the stimuli more visible in at least one subsequent presentation to the user.

[0021] Multiple stimuli may include multiple different or individual stimuli. In other embodiments, a block or section of text may be considered a single stimulus in the present invention. However, since the present invention is not directed toward measuring reading speed, reading speed is not an example of an attribute according to the present invention.

[0022] In the present invention, the evaluation of at least one aspect of the user's visual perception function is not based only on whether the user can see each stimulus, as was common in the prior art, but is based on how the user is reacting to the stimulus. Advantageously, in the present invention, at least one attribute of the user's reaction is also determined, and thus, this provides additional, perhaps more subtle, or more nuanced information on which the evaluation of the visual perception function can be at least partially based.

[0023] At least one attribute related to the user's reaction to each stimulus may provide quantitative information related to the user's reaction. (Previously, it could only be recorded qualitatively) At least one attribute may be any characteristic related to the user's reaction that provides quantitative information indicative of the visual perception function.

[0024] In some cases, monitoring at least one attribute related to the user's reaction to each stimulus can provide an early warning or early indication of potential problems or degradation of the visual perception function, which otherwise would not have been detected. ch

[0025] Optionally, at least one attribute may include one or more of response time or average response time, number of incorrect responses, pattern or order of received responses, amount of movement of the handheld computing device relative to the user's eyes when a response is received, distance of movement of the handheld computing device relative to the user's eyes when a response is received. It will be understood that this is not an exhaustive list. The attributes will be described in more detail below.

[0026] The method may include evaluating at least one aspect of the user's visual perception function based at least in part on at least one attribute.

[0027] This method may include evaluating at least one aspect of the user's visual perception function based on at least one attribute and the response or lack of response to each stimulus. For example, this evaluation may be performed based on at least one attribute recorded about the user's response and whether this response indicates that the user can see each stimulus.

[0028] Optionally, detecting a response from the user includes receiving an input from the user indicating the proposed position of each stimulus on the display screen. In some embodiments, the user input may be received by the user's input device.

[0029] The at least one attribute may include the accuracy of the proposed position compared to the actual position of the stimulus on the display screen.

[0030] This method may include determining whether the response from the user indicates that the user has seen each stimulus. This may be done by determining whether the proposed position of the stimulus is within a predetermined range of the actual position of the stimulus on the display screen.

[0031] Optionally, the at least one attribute includes the response time or the average response time. Determining the at least one attribute may include determining the response time for each response, which is the elapsed time between the display time when the stimulus is presented on the display screen and the time when the response from the user is detected.

[0032] It will be understood that the term "reaction" may be used interchangeably with "response" throughout the present invention.

[0033] The time it takes for the user to respond to a stimulus can be an indicator of the visual perception function. A short response time may indicate that the user can easily see the stimulus. Therefore, the response time itself can provide useful information regarding the visual perception function.

[0034] In conventional technology, user reaction time is often measured solely for the purpose of evaluating whether or not the user "saw" the stimulus, and if the reaction time exceeds a predetermined limit, it is determined that the user did not see the stimulus. In conventional technology, reaction time itself is neither recorded nor evaluated as providing useful information about visual cognitive function.

[0035] For example, measuring and recording a user's reaction time to each stimulus may provide early signs of declining visual function. This is because a longer reaction time indicates that the user is not seeing the stimulus clearly, even if they are correctly identifying or reacting to it. Therefore, a system that simply detects whether or not a user can see a stimulus may miss this crucial aspect, as it does not record response time as a qualitative measure of how well (or how quickly) the user can see each stimulus.

[0036] Optionally, the method may include determining the user's average response time. For example, a first overall average response time may be determined for the user's right eye, and a second overall average response time may be determined for the user's left eye. In some embodiments, the overall average response time for both eyes may be determined together. Optionally, the overall average response times for the right eye and / or left eye may be compared with the overall average response time for both eyes.

[0037] While at least one attribute of a user's response may provide useful information on its own (i.e., as an instantaneous or one-off assessment of visual function), in some embodiments, at least one attribute may be monitored over time. Therefore, it may be a trend in at least one attribute of the user's response that provides useful information about visual function.

[0038] This method may include adjusting the response time determined to account for learning effects. It will be understood that response times generally improve (decrease) as users become familiar with the test or the test mechanism. This may provide a false indication that users are finding the stimuli more easily. Therefore, it may be desirable to consider this learning effect.

[0039] Optionally, the method includes recording a value indicating the number of evaluations completed by the user (i.e., the number of times a visual test or program was performed or completed by the user); or recording a value indicating the calendar period during which the user performed evaluations, or the number of stimuli presented to the user. It will be understood that each session in which stimuli are presented on the display screen may be defined as an evaluation. The method includes applying a scaling scheme to the determined response time in order to account for learning effects, and this scaling scheme is at least in part based on the values ​​described above.

[0040] Optionally, this method may include recording the number of ratings completed by the user or the number of stimuli presented to the user.

[0041] This may include applying a scaling factor to the determined response time, taking into account the learning effect, and this scaling factor is based on the number of assessments completed by the user or the number of stimuli presented to the user.

[0042] This method may include comparing the determined at least one attribute with stored data. Optionally, this method may include comparing the determined at least one attribute with stored data for that user, such as data stored for the user from a previous evaluation.

[0043] Therefore, this method may include monitoring at least one attribute related to the user's response over a long period of time. This method may also include monitoring at least one determined attribute so that it can be assessed whether there has been a change in the user's visual cognitive function over time. A significant change in at least one attribute compared to the user's mean data (or previous data) may indicate a challenge or decline in visual cognitive function, even if the user is still performing relatively well in terms of seeing the stimulus.

[0044] Optionally, the method may include comparing at least one determined attribute to an age-standard database consisting of age-matched average data. Thus, the method may include monitoring user responses over a long period of time compared to the age-matched average "standard".

[0045] Optionally, this method may include saving the date and time of the evaluation. This method may also include comparing the determined at least one attribute with saved data from at least one past evaluation performed by the user.

[0046] Optionally, the determination of at least one attribute may be the determination of an inaccurate response received from the user. Each inaccurate response may indicate that the user did not see the stimulus or did not see one of several stimuli.

[0047] For example, this method may include detecting the number of errors made by the user. If a user shows hesitation, looks all over the screen before seeing a stimulus, or presses anywhere on the screen that does not correspond to any stimulus, this may indicate that the user has difficulty seeing the stimulus compared to a user who makes fewer (or fewer) errors.

[0048] Optionally, this method may include determining the type of error or inaccurate response made by the user. This method may include recording at least the response time or the position on the display screen of each inaccurate response received from the user.

[0049] This method may include determining the accuracy of responses received from the user based on the number of inaccurate responses received. For example, the ratio of inaccurate responses to "accurate" responses received, where an accurate response is defined as a response in which the user is judged to have recognized a stimulus (e.g., seeing or pressing the location of a stimulus on the display screen).

[0050] Optionally, determining at least one attribute involves measuring the movement of the handheld computing device when each response from the user is detected. For example, this movement may be detected by an accelerometer or camera within the handheld computing device.

[0051] Optionally, determining at least one attribute includes determining the distance between the user or the user's eyes and the display screen when each response from the user is detected. This distance can be determined using a camera, which is coupled to or integrated into the handheld computing device. When the user moves the display screen closer to or further away from their eyes to view a given stimulus, this provides additional information representing their visual function.

[0052] Optionally, determining at least one attribute involves determining the order or pattern in which user responses to multiple stimuli are received. For example, at least one attribute may indicate the order in which multiple stimuli are determined to be seen by the user, or the order in which responses indicating that the user saw each stimulus are received.

[0053] The order in which a user views stimuli presented on a screen, or the order in which a user indicates they have viewed stimuli, can provide useful information that reveals at least one aspect of their visual function. For example, users with poor visual function often interact with stimuli starting with the easiest to see and progressing to those that are more difficult to see. Therefore, the order in which a user interacts with stimuli provides additional information indicating how easily the user can see each stimulus.

[0054] For example, compared to users with poor eyesight, users with good eyesight may start interacting with all stimuli on one side of the display screen, regardless of how easy or difficult each stimulus is to see, and then gradually move to the other side of the display screen.

[0055] Optionally, determining at least one attribute includes determining the location of the display screen or device the user is looking at when each user response is detected.

[0056] Optionally, determining at least one attribute may include determining the user's facial expressions while the user identifies and / or responds to a stimulus.

[0057] The stimuli may include stimuli specifically presented for the purpose of evaluating visual cognitive function. Additionally, or alternatively, the stimuli may include display elements or variations thereof that are typically encountered during normal use of a handheld computing device.

[0058] Each stimulus may have at least one visual characteristic. This at least one visual characteristic may have a predetermined value selected to evaluate at least one aspect of visual cognitive function.

[0059] This at least one visual characteristic may include one or more of the following: position on the display screen, contrast, color, level of detail, shape, size, or movement of the stimulus on the display screen.

[0060] Optionally, this visual property of at least one stimulus has a predetermined value selected to assess at least one aspect of visual function. Optionally, since the multiple stimuli do not have the same predetermined value for this at least one visual property, this visual property may differ among the multiple stimuli. This at least one visual property of a stimulus may change during assessment.

[0061] Optionally, at least one visual characteristic of this stimulus includes one or more of the following: position on the display screen (including, but not limited to, position relative to other stimuli on the display screen), contrast, color, detail, shape, size, or movement of the stimulus on the display screen.

[0062] Optionally, at least one aspect of this visual cognitive function includes one or more of the following: visual acuity, central visual field, contrast sensitivity, stereopsis, color vision, detection sensitivity, spatial resolution or resolution sensitivity including static or dynamic orientation discrimination, recognition sensitivity, differential sensitivity, superresolution, temporal resolution and / or spectral resolution.

[0063] Optionally, multiple aspects of visual cognitive function are measured using multiple stimuli. Therefore, multiple aspects of visual cognitive function may be measured simultaneously.

[0064] Optionally, two or more of the multiple stimuli may be displayed on the screen simultaneously. Optionally, only one stimulus may be displayed on the screen at any given time. Therefore, multiple stimuli may be displayed on the screen simultaneously or at different times.

[0065] Optionally, multiple stimuli are the same stimulus, and one or more visual properties of the stimulus are adjusted for each presentation (or version) of the stimulus.

[0066] Optionally, the multiple stimuli consist of at least two different stimuli, and one or more visual properties of each stimulus are adjusted each time a stimulus is presented.

[0067] Optionally, the method further includes repeatedly presenting one or more of a group of stimuli on a display screen. One or more visual characteristics of each stimulus may be adjusted each time the stimulus is presented.

[0068] Optionally, the stimulus is presented on the display screen or repeatedly presented until a threshold is determined for at least one aspect of the user's visual cognitive function.

[0069] This method may include comparing at least one attribute related to the user's response to a stimulus close to the user's threshold for a given aspect of visual cognitive function with at least one attribute related to the user's response to a stimulus above the user's threshold for the same aspect of visual cognitive function.

[0070] It will be understood that stimuli exceeding the threshold of the user's visual function will be visible to the user. Conversely, stimuli below the threshold of visual function will not be visible to the user.

[0071] Optionally, the display screen includes a touchscreen, and detection of user responses includes detecting points of contact from the user on the touchscreen.

[0072] Optionally, detecting user responses may include monitoring the user's eye movements using a camera. Thus, the handheld computing device may be configured to evaluate whether the user has looked at each stimulus using preferred eye-tracking technology.

[0073] Preferably, each stimulus is presented on a display screen within a gamified environment. This can make the evaluation more interesting and engaging, especially for children, potentially leading to improved results.

[0074] Optionally, the method may include storing in memory at least one determined attribute related to the user's response to each stimulus. Optionally, all data resulting from the evaluation may be stored in memory.

[0075] Optionally, the method may include transmitting at least one determined attribute related to the user's response to a remote server and / or remote electronic device via a communication channel. This communication channel may be a wireless communication channel.

[0076] This method may include performing an evaluation of the user's first eye while covering the user's second eye, and then repeating the evaluation of the user's second eye while the first eye is still covered.

[0077] Optionally, the method may include comparing at least one determined attribute related to the user's response to each stimulus for the first eye with at least one determined attribute related to the user's response to each stimulus for the second eye.

[0078] This method may include determining several attributes related to the user's response to each stimulus.

[0079] Optionally, a primary assessment of visual function may be possible by determining whether the user's response indicates that the user has seen the stimulus. A secondary assessment of visual function may be possible by determining at least one attribute related to the user's response to each stimulus. At least one aspect of visual function assessed by the primary and secondary assessments may be the same or different.

[0080] In a second aspect, the present invention provides a handheld computing device for evaluating at least one aspect of a user's visual cognitive function. The handheld computing device includes a display screen, a processor, and memory, the memory containing executable instructions that, as a result of execution by the processor, cause the handheld computing device to execute a computer implementation method of any embodiment or example of the first aspect of the present invention.

[0081] The display screen may consist of a touchscreen. To detect user responses, the handheld computing device may be configured to detect user touch points on the touchscreen.

[0082] Optionally, the handheld computing device may be equipped with a camera. This camera may be configured to monitor the user's eye movements in order to detect responses from the user. Thus, the handheld computing device may be configured to use preferred looking techniques.

[0083] Optionally, the handheld computing device may be a mobile phone, smartphone, or tablet computer. [Brief explanation of the drawing]

[0084] Embodiments of the present invention will be described below with reference only to the accompanying drawings, where similar reference numerals relate to similar elements.

[0085] [Figure 1A] Figure 1A is an explanatory diagram of the display screen of a handheld computing device that performs visual evaluation according to one embodiment of the present invention. [Figure 1B] Figure 1B is an explanatory diagram of the display screen of a handheld computing device that performs visual evaluation according to another embodiment of the present invention. [Figure 2] Figure 2 is a block diagram showing a handheld computing device according to an embodiment of the present invention. [Figure 3] Figure 3 is a flowchart showing a computer implementation method according to an embodiment of the present invention. [Figure 4] Figure 4 is a flowchart showing a part of a computer implementation method according to another embodiment of the present invention. [Modes for carrying out the invention]

[0086] Currently, visual acuity is typically measured as a threshold determined by difficulty level. For example, in traditional visual acuity charts, the smallest line of letters / symbols the patient can identify may be used as the lower limit of visual ability. However, it is becoming increasingly recognized that visual acuity tests may not always detect vision loss in its early stages. The thresholds used in traditional visual acuity measurements are too coarse and likely to miss subtle vision declines experienced by patients.

[0087] Visual acuity refers to the central part of the retina and macula, known as the "fovea" (or "cone cells"), which is finely tuned for seeing details. Subtle vision loss can occur near the cones and may therefore be "missed" by conventional visual acuity tests that focus on the details in the central part of vision.

[0088] Because a broad area of ​​the macula is used for visual stabilization during image detection and recognition, partial defects in the surrounding macula may preferentially affect image localization and stabilization. Such defects are mitigated by nearby healthy retina, and therefore often result in normal visual acuity. However, the defect may affect ease of viewing and may take longer to accurately identify images. This is likely to manifest as a time delay and / or hesitant and / or inaccurate responses in the patient.

[0089] Depending on the location and / or nature of the lesion in the visual pathway, the degree of visual impairment also varies in different aspects of visual function. For example, in patients who have recovered from optic neuritis, visual acuity is maintained despite impaired retinal function as measured by electrophysiological tests. In early glaucoma and early cataracts, normal visual acuity is often maintained despite decreased sensitivity to contrast stimuli and increased variability in responses. Such measurements may be useful in themselves for mapping disease progression or recovery.

[0090] In fact, certain aspects of visual function may not only indicate changes in the retina, but also neurological changes in related pathways.

[0091] This invention aims to improve upon the shortcomings of many prior art visual evaluation methods and systems.

[0092] Embodiments of the present invention will be described below with reference to the accompanying drawings.

[0093] Figure 1A shows a handheld computing device 100 comprising a display screen 102 and a camera 104. In some embodiments, the handheld computing device 100 may not include the camera 104, or the camera 104 may not be integrated with the handheld computing device 100. In some embodiments, the camera 104 may be a webcam or other camera, which is coupled to the handheld computing device 100 via a wired or wireless connection. The display screen 102, or at least a portion of the display screen 102, may be a touchscreen.

[0094] The handheld computing device 100 shown in Figure 1A is performing an assessment of the user's visual cognitive function. Six stimuli 106 are displayed on the display screen 102. Each stimulus 106 may have at least one visual characteristic selected to measure at least one aspect of visual cognitive function. This at least one visual characteristic includes, but is not limited to, the location, contrast, color, detail, shape, size, or movement of the stimulus on the display screen. The display screen 102 may be configured to display a background or background image that may change during the assessment.

[0095] In Figure 1A, for simplification, the stimulus 106 is represented as a different shape. It will be understood that the shape or form is not limited to those shown in Figure 1. Instead, any visual stimulus may be presented on the display screen. Furthermore, although six stimuli 106 are shown in Figure 1, any number of stimuli may be presented simultaneously or sequentially on the display screen 102.

[0096] In some embodiments, the same stimulus 106 may be repeatedly presented to the user on the display screen 102, with at least one visual characteristic of the stimulus changing with each presentation. In some embodiments, one or more stimuli 106 may be configured to move on the display screen 102. In some embodiments, one or more stimuli 106 may remain stationary on the display screen 102.

[0097] Preferably, the stimulus 106 is presented within a gamified environment. Therefore, the assessment can take the form of a computer game played by the user on a handheld computing device 100. This can make the assessment more interesting and engaging, especially for children, and may improve the assessment results because the user's attention is maintained longer than in conventional vision tests.

[0098] The handheld computing device 100 may be, but is not limited to, a mobile phone, a smartphone, or a tablet computer. The handheld computing device 100 consists of memory and at least one processor.

[0099] The evaluation or visual acuity test shown in Figure 1A may be performed by an application or computer program downloaded and installed on the handheld computing device 100. The computer program may be defined by a set of computer executable instructions stored in the memory of the handheld computing device 100.

[0100] Figure 1B shows another embodiment in which the evaluation is performed using stimuli including display elements or their deformations that are typically encountered during normal use of the handheld computing device 100. In one embodiment, the evaluation is performed as a “background” application during the normal operation of the handheld computing device 100, so that the user may not be aware that the evaluation is being performed. Thus, once the application is installed on the handheld computing device 100, the user can start the evaluation without opening the application. Alternatively, the evaluation may be started or performed while the user is performing a predetermined task on the handheld computing device 100.

[0101] As shown in Figure 1B, stimulus 106 may include an email notification icon and another symbol indicating a notification or alert (e.g., a message or an incoming call). The method of the present invention may also involve detecting the user's response to these stimuli 106 encountered while using the handheld computing device 100 and determining at least one attribute related to the user's response, in which case each attribute indicates the difficulty associated with viewing or processing the multiple stimuli. At least one attribute is then recorded, enabling an assessment of at least one aspect of the user's visual cognitive function.

[0102] Figure 3 is a flowchart illustrating a method for evaluating at least one aspect of visual cognitive function according to one embodiment of the present invention. Although not shown in Figure 3, the first step of this method is for the user to cover one eye, for example, using an eye patch or screen. Thus, at least one aspect of visual function can be evaluated separately for each eye. Subsequently, the user can begin the evaluation by entering personal information (such as a username and password) or biometric information such as a fingerprint, for example, to log in to a user account. This allows the evaluation to be associated with the user, ensuring that the correct person is being evaluated. Furthermore, the evaluation can be customized for specific users.

[0103] In step 302, the method includes presenting at least one stimulus on the display screen of a handheld computing device 100, 200. In one embodiment, only a single stimulus may be presented on the screen at any given time. In other embodiments, multiple stimuli may be presented simultaneously. It will be understood that if multiple icons or images are presented simultaneously, they may also be considered a single stimulus. Each stimulus may have at least one respective visual characteristic. The visual characteristics of each stimulus may be defined by a computer program or an algorithm that controls the evaluation.

[0104] In step 304, the method includes detecting a response from the user to at least one stimulus, or the absence of a response. This response may also be referred to as a reaction. The method may also include detecting multiple responses to multiple stimuli, or a single response to multiple stimuli. It will be understood that if the user cannot see or distinguish a stimulus, there may be no response to that stimulus. Therefore, step 304 may also include detecting the absence of a response from the user.

[0105] In some embodiments, the method determines whether a user's response indicates that the user has seen at least one stimulus (step 306). For example, the response may be a "correct" response, such as touching the location of the stimulus or looking at the stimulus. This step is not included in all embodiments and may not be included in embodiments that focus particularly on the attributes of the user's response.

[0106] There are numerous different ways in which the handheld computing device 100 can detect user responses. In one embodiment, the handheld computing device 100 includes a camera 104 configured to monitor the user's eye movements. Based on the user's eye movements, the camera 104 can determine whether the user has looked at each stimulus presented on the display screen. These techniques are known in the field of visual assessment. This method may be preferable for infants and people with physical or cognitive impairments that may make verbal or physical responses difficult. Therefore, the assessment may not require the user to select different stimuli or make verbal or physical decisions. Instead, the user only needs to look at a stimulus if it is visible. Accordingly, the present invention may use, for example, eye-tracking and / or gaze tracking to assess preferred gaze.

[0107] In other embodiments, the handheld computing devices 100, 200 may be configured to receive user input (other than the user's eye movements). In one embodiment, the display screen 102 may be a touchscreen. The user may be asked to press, tap, or touch the touchscreen at the location of what they believe to be a stimulus currently being presented. If the location where the user presses, taps, or touches the touchscreen is within a predetermined tolerance range of the correct location of the stimulus on the display screen, it may be determined that the user has seen the stimulus. In other embodiments, user input may be received by a user input device other than the display screen 102, such as a keypad, controller, or other input device.

[0108] It will be understood that the method for detecting user responses will vary among users depending on their needs and preferences. For example, the method for detecting user responses may be associated with the user's account or profile.

[0109] Step 308 involves determining at least one attribute associated with each response from the user. Each attribute indicates the difficulty level associated with seeing or processing the stimulus. Thus, in addition to the "yes" or "no" determination of whether the user responded to the stimulus, this attribute provides additional, preferably qualitative, information about how the user saw or responded to the stimulus. This can provide very useful information that can provide an early warning of a potential decline or problem in visual cognitive function.

[0110] In one embodiment, at least one attribute may include response time (i.e., the time required from when a stimulus is displayed on the screen until the user responds to the stimulus), which is explained in more detail in Figure 4.

[0111] Since this invention is not aimed at observing how long it takes a user to read block text, it will be understood that at least one attribute does not include reading time.

[0112] Similarly, the handheld computing devices 100, 200 may include motion sensors such as accelerometers. The motion sensors may detect the movement of the handheld computing devices 100, 200. Thus, in some embodiments, at least one attribute may include the movement of the handheld computing device at or around the time a user response is received. In some embodiments, this attribute may include a value indicating any movement detected by the motion sensor during a predetermined time period before, after, or both of the time periods before a user response is received. For example, if the handheld computing device is shaking or moving around, this may be an early sign of impaired vision, as people with impaired vision often shake or move the screen in an attempt to improve their visual ability by catching light or changing the position of stimuli in their field of vision.

[0113] In one embodiment, at least one attribute may include the distance between the user (or the user's eyes) and the handheld computing devices 100, 200. This distance may be measured by the camera 104. It will be understood that the user may move the display screen closer to or further away from their eyes (depending on their visual function) in an attempt to improve their visual ability.

[0114] In one embodiment, at least one attribute may include the order (or pattern) in which user responses are received. Each stimulus may be assigned a number or identifier indicating the order in which user responses to that stimulus were detected.

[0115] For example, referring to Figure 1A, assuming that all of these stimuli 106 are presented on the screen at some point, if the user has relatively good visual function, they will respond to each stimulus by starting from one side of the screen and moving to the other side, responding to each stimulus in the order in which they appear on the screen (e.g., left to right: smiley face, large 6-point star, owl, 16-point star, sock, small 6-point star; or right to left: small 6-point star, sock, 16-point star, owl, large 6-point star, smiley face).

[0116] Conversely, if a user has relatively poor visual function, they may not respond to stimuli in the same order as a user with good visual function. Instead, the user may respond to stimuli starting with the easiest to see and then moving to the most difficult. Therefore, the pattern or order in which a user responds to stimuli can provide valuable insights into the user's visual function. These stimuli may be presented specifically for the purpose of assessing visual function, but text and images presented during normal use of mobile devices can also be used for this purpose.

[0117] In one embodiment, at least one attribute may include measuring the number or type of errors made by the user. Thus, step 308 may include measuring the number of times the user touches the display screen 102 or otherwise responds in a location where stimulus 106 is not presented. If the user makes such errors frequently or in large numbers, it may indicate that the user is randomly pressing or looking at various parts of the screen and not actually seeing the presented stimulus. This may indicate that the assessment results are not accurate or reliable, or that the user's visual function may be worse than indicated (some stimuli judged to have been seen by the user may be false positives).

[0118] In one embodiment, stimuli may be presented as part of a game, and the user may be required to select from different stimuli according to predetermined conditions. For example, the user may be prompted by audio and / or visual instructions from a handheld computing device to select a stimulus that satisfies predetermined conditions. Thus, measuring the number of different types of mistakes the user makes may be measuring the number of incorrect stimuli selected by the user (i.e., the number of responses from the user indicating stimuli that do not meet the given conditions). While this type of game may not be suitable for all users, such as young children or people with severe learning disabilities, it may be useful for others because it can collect useful information more quickly than other types of assessments.

[0119] In one embodiment, at least one attribute may include a measure of the accuracy of responses received from the user. For example, this may include the ratio of the number of errors made by the user to the total number of responses received from the user during the evaluation. Conversely, this may include the ratio of the number of stimuli determined to have been seen by the user to the total number of responses received from the user during the evaluation.

[0120] In step 310, the method includes recording at least one attribute so that at least one aspect of the user's visual cognitive function can be evaluated. This may include storing the attribute data in the memory of a handheld computing device or transmitting the data to a remote server or computing device.

[0121] In one embodiment, a primary assessment of at least one aspect of the user's visual cognitive function may be provided based on whether or not the user responds to each stimulus. At least one attribute determined from the user's responses may be used to provide a secondary assessment of at least one aspect of the user's visual cognitive function. In one embodiment, this secondary assessment may be a more general or qualitative (e.g., less specific) assessment of the user's visual cognitive function.

[0122] In one embodiment, the results of the user's response to each stimulus and at least one attribute of the determined user's response may be combined into a single assessment of at least one aspect of visual cognitive function. In another embodiment, the determined at least one attribute can be used to adjust or influence the assessment of at least one aspect of visual cognitive function.

[0123] In an additional step (not shown in Figure 3), the method may include comparing the measurement data with stored data. This stored data may be stored in the memory of a handheld computing device or retrieved from external memory or storage resources.

[0124] In one embodiment, the method may include comparing the evaluation results with stored data from the same user in previous evaluations. Thus, at least one determined attribute of the user's response may be monitored over time. This may provide additional useful information compared to standalone data.

[0125] For example, if at least one attribute includes the average distance from the user to the handheld computing device, comparing this to historical data associated with the same user could potentially detect any changes in habitual viewing distance. Changes in habitual viewing distance may be an early sign of changes in visual function.

[0126] In other examples, if at least one attribute is a measure of the accuracy of the user's response, then changes in user accuracy over time, such as a decrease in the consistency or accuracy of the user's response, may be an early sign of a change in visual function.

[0127] In one embodiment, the stored data may include age-matched average data, allowing the user's results to be compared to established averages for people of the same age.

[0128] In step 312, the method (i.e., steps 302 to 310) is repeated for subsequent stimuli presented on the screen. In some embodiments, if multiple stimuli are presented on the screen in step 302, step 312 is unnecessary. The method may optionally continue until a predetermined number of stimuli are presented to the user.

[0129] In step 314, the assessment (e.g., steps 302 to 312) may be repeated for the user's other eye. For example, the user may adjust an eye patch or other covering to cover the other eye and repeat the method described above. In this way, the user's visual function may be accessed individually for each eye.

[0130] Figure 4 shows a flowchart of another method for evaluating at least one aspect of visual function according to one embodiment of the present invention, which follows step 306 in Figure 3.

[0131] Step 408 includes measuring the user's response time for each response. As described above, the response time is defined as the elapsed time from when the stimulus is first displayed until the user's response to that stimulus is received. Thus, in this embodiment, at least one attribute is the response time. The method may optionally include a step of determining (or recording) one or more additional attributes of the user's response (not shown in Figure 4).

[0132] In one embodiment, step 408 may actually occur before step 306, because the user's response time may be used (at least partially) to determine whether the user has seen (or responded to) the stimulus.

[0133] In step 410, the measured response times (from step 408) are adjusted to account for the learning effect. Since this is the first time the user is performing the assessment using a handheld computing device, they are unfamiliar with its settings and requirements. Over time, the user gains experience and becomes accustomed to the assessment and how to respond to stimuli. Therefore, even without a change in visual function, the user's reaction time to a given stimulus is likely to be longer in the first assessment than in the nth assessment. This is what is referred to as the "learning effect" in this invention. If this learning effect is not taken into account, the assessment may incorrectly report improvements in the user's visual cognitive function over time.

[0134] To account for learning effects, the system of the present invention can record the number of times a particular user has performed a visual function assessment, or the number of stimuli presented to that user. This number can be associated with the user's profile. This number, or a value derived from it, can be used to scale the measured response time to account for learning effects. Such adjustments can be made, for example, by scaling the measured response time using a population-level factor that reflects the change in mean response time with increasing number of assessments (or elapsed time since the first assessment or most recent assessment) in the demographic to which a particular user belongs.

[0135] Step 412 involves comparing the adjusted response time with stored data. As mentioned above, the stored data may be data from past evaluations performed by the user. This allows for monitoring of the user's reaction time over time. If the user takes longer on average to respond to the same stimulus, even if the user is still responding to that stimulus, this may be an early sign of a decline in visual cognitive function. For example, if the user takes longer to look at a stimulus, this can provide additional information about which aspects of the user's visual function are affected.

[0136] It will be understood that step 410 is an optional step. If this step is omitted, the response time mentioned in step 412 will be the actual measured response time.

[0137] Optionally, for example, if a user's response time deviates significantly from the user's past average response time by a predetermined threshold, the handheld computing device may output a warning or prompt to the user to seek expert assistance.

[0138] In step 414, the method provides an evaluation based on the user's response and the measured response time.

[0139] Following step 414, it will be understood that the evaluation can be repeated for other users.

[0140] Accordingly, a computer implementation system and method are provided for evaluating at least one aspect of a user's visual cognitive function, which involves displaying multiple stimuli on the display screen of a handheld computing device, detecting a response or lack of response from the user for each stimulus, determining at least one attribute related to the user's response, each attribute indicating the difficulty level associated with viewing and processing the multiple stimuli, and recording at least one attribute so as to evaluate at least one aspect of the user's visual cognitive function.

[0141] While specific embodiments of the present invention have been described, it will be understood that many modifications, additions, and / or substitutions may be made within the scope of the claims. [Examples]

[0142] Exemplary computing environment Figure 2 shows a possible computing environment for carrying out exemplary embodiments of the present invention. In particular, Figure 2 shows a block diagram of one embodiment of a handheld computing device 200 according to the present invention. The handheld computing device 200 may be the same as the handheld computing device 100 in Figure 1A or Figure 1B. The handheld computing device 200 is associated with executable instructions for causing the handheld computing device to perform one or more of the methodologies described herein. The handheld computing device 200 may operate as a data model or one or more computing resources for performing the methods of the present invention. In other implementations, the handheld computing device 200 may be connected to other machines in a local area network (LAN), intranet, extranet, or the internet (for example, it may be network-connected). The computing device may operate as a server or client machine in a client-server network environment, or in a peer-to-peer (or distributed) network environment.

[0143] An exemplary handheld computing device 200 includes a processor 202, main memory 204 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM (RDRAM), static memory 206 (e.g., flash memory, static random access memory (SRAM), etc.), and secondary memory (e.g., data storage device 218), which communicate with each other via a bus 230.

[0144] The processor 202 is represented by one or more general-purpose processors such as a microprocessor, a central processing unit (CPU), or similar. More specifically, the processor 202 may be a composite instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor that executes other instruction sets, or a processor that executes a combination of instruction sets. The processor 202 may be one or more dedicated processors (processors) such as an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), a network processor, or similar. The processor 202 is configured to execute processing logic (instructions 222) for performing the operations and steps described herein.

[0145] The handheld computing device 200 may further include a network interface device 208. The handheld computing device 200 also includes a display unit 210 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 212 (e.g., a keyboard or touchscreen), a cursor control device 214 (e.g., a touchscreen), and optionally, an audio device 216 (e.g., a speaker).

[0146] The data storage device 218 may include one or more machine-readable storage media (or more specifically, one or more non-temporary computer-readable storage media) 228 containing one or more instruction sets 222 that embody one or more of the methodologies or functions described herein. The instruction sets 222 may also reside entirely or at least partially in the main memory 204 and / or the processor 202 during execution by the computer system 200, and the main memory 204 and the processor 202 also constitute computer-readable storage media.

[0147] The various methods described above may be implemented by computer programs. A computer program may include computer code arranged to instruct a computer to perform the functions of one or more of the various methods described above. Such computer programs and / or code for implementing these methods may be provided to a device such as a computer on one or more computer-readable media, or more generally, on a computer program product. The computer-readable media may be temporary or non-temporary. One or more computer-readable media may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or a propagation medium for data transmission, such as a medium for downloading code over the Internet. Alternatively, this one or more computer-readable media may take the form of one or more physical computer-readable media, such as semiconductor or solid-state memory, magnetic tape, removable computer diskettes, random-access memory (RAM), read-only memory (ROM), rigid magnetic disks, and optical disks such as CD-ROMs, CD-R / Ws, or DVDs.

[0148] In some implementations, the modules, components, and other functions described herein may be implemented as individual components or integrated into the functions of hardware components such as ASICS, FPGAs, DSPs, or similar devices.

[0149] A “hardware component” is a tangible (e.g., non-temporary) physical component (e.g., a set of one or more processors) capable of performing a specific operation, and may be configured or arranged in a specific physical manner. A hardware component may include dedicated circuits or logic circuits permanently configured to perform a specific operation. A hardware component may be or include dedicated processors such as field-programmable gate arrays (FPGAs) or SASICs. A hardware component may include programmable logic or circuits temporarily configured by software to perform a specific operation.

[0150] Therefore, the term “hardware component” should be understood to encompass tangible entities that are physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate or perform specific operations as described herein.

[0151] Furthermore, modules and components can be implemented as firmware or functional circuits within hardware devices. Moreover, these modules and components can be implemented in any combination of hardware devices and software components, or solely in software (e.g., code stored in or otherwise embodied in machine-readable or transmission media).

[0152] Unless otherwise specified, as will be apparent from the following description, throughout this specification, any use of terms such as “provide,” “calculate,” “computate,” “identify,” “detect,” “establish,” “train,” “determine,” “store,” “generate,” “verify,” and “obtain” is understood to mean operations and processes performed by a computer system or similar electronic computer. A computer system or similar electronic computer manipulates and transforms data represented as physical (electronic) quantities in the registers and memory of the computer system, and data similarly represented as physical quantities in the memory or registers or other information storage, transmission, and display devices of the computer system.

[0153] The following are, but are not limited to, the listed provisions illustrating embodiments of the present invention. Any feature described in one provision below may be incorporated into or combined with any other provision.

[0154] Section 1 The steps include displaying multiple stimuli on the display screen of a (handheld) computing device or system, A step of detecting at least one response or lack of response from the user to these multiple stimuli, A step of determining at least one attribute related to the user's response, wherein each attribute indicates or relates to the difficulty level related to the perception or processing of multiple stimuli, The method includes a step of recording at least one attribute so that at least one aspect of the user's visual cognitive function can be evaluated. A computer implementation method for evaluating at least one aspect of a user's visual cognitive function.

[0155] Section 2 The computer implementation method described in paragraph 1, i) A step of changing multiple stimuli to change the difficulty level associated with viewing or processing multiple stimuli, ii) The step of presenting the modified stimuli on the display screen of a (handheld) computing device or system, iii) The step of determining at least one attribute relating to the user's response to the modified multiple stimuli, Preferably, modifying multiple stimuli includes a step of reducing the difficulty level so that the multiple stimuli are easier for the user to see and process. Computer implementation method.

[0156] Section 3 A computer implementation method described in paragraph 1 or 2, The method further includes a step of evaluating, at least partially, at least one aspect of the user's visual cognitive function based on at least one attribute. Computer implementation method.

[0157] Section 4 • A computer implementation method as described in paragraph 2 or 3, At least one attribute is, Response time or mean response time; The number of inaccurate responses received from users; Display of the pattern or order of the received responses; The amount of movement of the (handheld) computing device or system relative to the user's eyes when receiving a response; and / or The distance between the (handheld) computing device, system, or display screen and the user or the user's eyes when a response is received or not received. A computer implementation method which is one or more of the following.

[0158] Section 5 A computer implementation method according to any of paragraphs 1 through 4, Detecting user responses involves receiving user input indicating the proposed location of each stimulus on the display screen. Computer implementation method.

[0159] Section 6 A computer implementation method according to paragraph 5, wherein at least one attribute includes the accuracy of the proposed position compared with the actual position of the stimulus on the display screen.

[0160] Section 7 A computer implementation method according to paragraph 5 or 6, further comprising determining whether a user response indicates that the user has seen each stimulus by determining whether the proposed location of the stimulus is within a predetermined range of the actual location of the stimulus on the display screen.

[0161] Section 8 A computer implementation method described in any of paragraphs 1 to 7, A computer implementation method in which determining at least one attribute is to determine the response time for each response, where the response time is the elapsed time between the display time the stimulus is presented on the display screen and the time when a response from the user is detected.

[0162] Section 9 A computer implementation method according to any one of paragraphs 1 to 8, further comprising adjusting the response time determined in consideration of the learning effect.

[0163] Section 10 The computer implementation method described in paragraph 9, A computer implementation method that records a value indicating the number of evaluations completed by the user or the number of stimuli presented to the user, applies a scaling scheme to response times determined to account for learning effects, wherein the scaling scheme is at least partially based on the aforementioned value.

[0164] Section 11 A computer implementation method described in any of paragraphs 1 through 10, A computer implementation method further comprising comparing at least one determined attribute with stored data, and / or monitoring the at least one determined attribute over a period of time or over a number of evaluations performed by the user.

[0165] Section 12 The computer implementation method described in paragraph 11, Comparing the determined at least one attribute with the stored data, comparing the determined at least one attribute with the user's stored data, and / or A computer implementation method comprising comparing at least one determined attribute with an age-specific database containing average data that matches age.

[0166] Section 13 A computer implementation method described in any of paragraphs 1 through 12, A computer implementation method in which determining at least one attribute involves determining an inaccurate response received from the user, where each inaccurate response indicates that the user did not see the stimulus or did not see one of several stimuli.

[0167] Section 14 The computer implementation method described in paragraph 13, A computer implementation method further comprising recording at least one of the time of receipt and the position on the display screen of each inaccurate response from a user, and / or determining the accuracy of a response received from a user based on the number of inaccurate responses received.

[0168] Section 15 A computer implementation method described in any of paragraphs 1 through 14, Determining at least one attribute is A computer implementation method comprising measuring the movement of a (handheld) computing device or system when each response from the user is detected, and / or determining the distance between the user or the user's eyes and the display screen each time a response from the user is detected.

[0169] Section 16 A computer implementation method described in any of paragraphs 1 through 15, Determining at least one attribute is Determine the order or pattern in which user responses to multiple stimuli are received, and / or Each time a user response is detected, the location of the display screen or device the user is looking at is determined. and / or A computer implementation method that determines the user's facial expressions while the user is identifying and / or responding to a stimulus.

[0170] Section 17 A computer implementation method described in any of paragraphs 1 through 16, A computer implementation method in which multiple stimuli are stimuli specifically presented for the purpose of evaluating visual cognitive function, and / or display elements or modifications thereof that are typically encountered during normal use of a handheld computing device.

[0171] Section 18 Each stimulus has at least one of its respective visual characteristics. A computer implementation method wherein at least one visual characteristic has a predetermined value selected to evaluate at least one aspect of visual cognitive function, and / or at least one visual characteristic is one or more of position on a display screen; contrast; color; detail; shape; dimensions; or movement of a stimulus on a display screen.

[0172] Section 19 A computer implementation method described in any of paragraphs 1 through 18, One or more of the multiple stimuli are repeatedly presented on the display screen, and a response or lack of response from the user is detected each time they are presented, and / or Multiple stimuli are presented on the display screen, or repeatedly presented, until a threshold is determined for at least one aspect of the user's visual cognitive function. A computer implementation method comprising comparing at least one attribute related to the user's response to a stimulus near a threshold for a given aspect of visual cognitive function with at least one attribute related to the user's response to a stimulus above a threshold for the same aspect of visual cognitive function.

[0173] Section 20 A computer implementation method described in any of paragraphs 1 through 19, The display screen consists of a touchscreen, and the computer implementation method for detecting user responses involves detecting the user's touch points on the touchscreen.

[0174] Section 21 A computer implementation method described in any of paragraphs 1 through 20, A computer-based method for detecting user responses involves monitoring the user's eye movements using a camera.

[0175] Section 22 A computer implementation method described in any of paragraphs 1 through 21, A computer implementation method that includes presenting multiple stimuli on a display screen within a gamified environment.

[0176] Section 23 A computer implementation method described in any of paragraphs 1 through 22, Store at least one determined attribute in memory, and / or A computer implementation method further comprising transmitting at least one determined attribute to a remote server and / or remote electronic device via a wireless communication channel.

[0177] Section 24 A computer implementation method described in any of paragraphs 1 through 23, A computer implementation method comprising performing an evaluation of the user's first eye while covering the user's second eye, and then repeating the evaluation of the user's second eye while covering the first eye.

[0178] Section 25 A computing device or system for evaluating at least one aspect of a user's visual cognitive function, wherein the handheld computing device is display screen; Processor; and Memory containing executable instructions that, as a result of execution by the processor, cause a handheld computing device to perform the computer implementation method described in any of paragraphs 1 through 24. A computing device or system consisting of the following. This computing device or system may include a handheld component / computing device.

[0179] Section 26 A computing device or system according to paragraph 25, wherein the display screen is a touchscreen, and the computing device / system is configured to detect the user's touchpoints on the touchscreen in order to detect a user response.

[0180] Section 27 A handheld computing device as described in paragraph 25 or 26, wherein the computing device / system includes a camera, the camera being configured to monitor the user's eye movements and detect responses from the user.

Claims

1. The steps include displaying multiple stimuli on the screen of a handheld computing device, The steps include detecting at least one response or lack of response from the user to these multiple stimuli, A step of determining at least one attribute related to the user's response, wherein each attribute indicates or relates to the difficulty level related to the perception or processing of multiple stimuli, The system includes a step to record at least one attribute so that at least one aspect of the user's visual cognitive function can be evaluated. A computer implementation method for evaluating at least one aspect of a user's visual cognitive function.

2. A computer implementation method according to claim 1, i) A step of changing the difficulty level associated with viewing or processing multiple stimuli by changing multiple stimuli, ii) The step of presenting the modified multiple stimuli on the display screen of a handheld computing device, iii) comprising the step of determining at least one attribute relating to the user's response to the modified multiple stimuli. Computer implementation method.

3. A computer implementation method according to claim 1 or 2, further comprising the step of evaluating, at least partially, one aspect of a user's visual cognitive function based on at least one attribute.

4. A computer implementation method according to any one of claims 1, 2, or 3, At least one attribute is, Response time or mean response time; The number of inaccurate responses received from users; Display of the pattern or order of the received responses; The amount of movement of the handheld computing device relative to the user's eyes when a response is received; and / or The distance between the handheld computing device and the user or the user's eyes when the response is received. A computer implementation method which is one or more of the following.

5. A computer implementation method according to any one of claims 1 to 4, wherein detecting a user response includes receiving user input indicating the proposed position of each stimulus on a display screen.

6. A computer implementation method according to claim 5, wherein at least one attribute includes the accuracy of the proposed position compared with the actual position of the stimulus on the display screen.

7. A computer implementation method according to claim 5 or 6, further comprising determining whether a user response indicates that the user has seen each stimulus by determining whether the proposed location of the stimulus is within a predetermined range of the actual location of the stimulus on the display screen.

8. A computer implementation method according to any one of claims 1 to 7, wherein determining at least one attribute is to determine the response time for each response, the response time being the elapsed time between the display time the stimulus is presented on the display screen and the time when a response from the user is detected.

9. A computer implementation method according to any one of claims 1 to 8, further comprising adjusting the response time determined in consideration of the learning effect.

10. A computer implementation method according to claim 9, comprising recording a value indicating the number of evaluations completed by the user or the number of stimuli presented to the user, and applying a scaling method to a response time determined to take learning effects into consideration, wherein the scaling method is at least partially based on the value.

11. A computer implementation method according to any one of claims 1 to 10, further comprising comparing at least one determined attribute with stored data, and / or monitoring the at least one determined attribute over a period of time or over a number of evaluations performed by the user.

12. A computer implementation method according to claim 11, wherein comparing a determined at least one attribute with stored data includes comparing the determined at least one attribute with the user's stored data and / or comparing the determined at least one attribute with an age-specific database containing average data corresponding to age.

13. A computer implementation method according to any one of claims 1 to 12, wherein determining at least one attribute includes determining an inaccurate response received from a user, each inaccurate response indicating that the user did not see a stimulus or did not see one of a plurality of stimuli.

14. A computer implementation method according to claim 13, further comprising recording the time of receipt and the position on the display screen of each inaccurate response from a user, and / or determining the accuracy of a response received from a user based on the number of inaccurate responses received.

15. A computer implementation method according to any one of claims 1 to 14, wherein determining at least one attribute includes measuring the movement of a handheld computing device when each response from a user is detected, and / or determining the distance between the user or the user's eyes and the display screen each time a response from a user is detected.

16. A computer implementation method according to any one of claims 1 to 15, wherein determining at least one attribute is to determine the order or pattern in which user responses to a plurality of stimuli are received, and / or the position of a display screen or device to which the user is looking each time a response from the user is detected, and / or the facial expression of the user while the user is identifying and / or responding to a stimulus.

17. A computer implementation method according to any one of claims 1 to 16, wherein the plurality of stimuli are stimuli specifically presented for the purpose of evaluating visual cognitive function, and / or display elements or modifications thereof that are typically encountered during normal use of a handheld computing device.

18. A computer implementation method according to any one of claims 1 to 17, wherein each stimulus has at least one respective visual characteristic, the at least one visual characteristic has a predetermined value selected to evaluate at least one aspect of visual cognitive function, and / or the at least one visual characteristic is one or more of position, contrast, color, detail, shape, dimensions, or movement of the stimulus on the display screen.

19. A computer implementation method according to any one of claims 1 to 18, wherein one or more of a plurality of stimuli are repeatedly presented on a display screen, and a response or lack of response from the user is detected each time the stimuli are presented, and / or a threshold is determined for at least one aspect of the user's visual cognitive function, the plurality of stimuli are presented on the display screen or are repeatedly presented, and the method includes comparing at least one attribute related to the user's response to stimuli near the threshold for a predetermined aspect of the visual cognitive function with at least one attribute related to the user's response to stimuli above the threshold for the same aspect of the visual cognitive function.

20. A computer implementation method according to any one of claims 1 to 19, wherein the display screen consists of a touchscreen, and detecting a user response is to detect a user's touch point on the touchscreen.

21. A computer implementation method according to any one of claims 1 to 20, wherein detecting a response from a user is a method in which the user's eye movements are monitored using a camera.

22. A computer implementation method according to any one of claims 1 to 21, comprising presenting a plurality of stimuli on a display screen within a gamified environment.

23. A computer implementation method according to any one of claims 1 to 22, further comprising storing the determined at least one attribute in memory and / or transmitting the determined at least one attribute to a remote server and / or remote electronic device via a wireless communication channel.

24. A computer implementation method according to any one of claims 1 to 23, comprising performing an evaluation of the user's first eye while covering the user's second eye, and then repeating the evaluation of the user's second eye while covering the first eye.

25. A computing device for evaluating at least one aspect of a user's visual cognitive function, wherein the handheld computing device is Display screen; Processor; and A memory including executable instructions that, as a result of execution by the processor, cause a handheld computing device to execute the computer implementation method described in any one of claims 1 to 24. A computing device consisting of [components].

26. A computing device according to claim 25, wherein the display screen is a touchscreen, and the handheld computing device is configured to detect the user's touch point on the touchscreen in order to detect a response from the user.

27. A handheld computing device according to claim 25 or 26, wherein the computing device comprises a camera, the camera configured to monitor the user's eye movements and detect responses from the user.

Images