Augmented Reality-based Eye Movement Measurement and Quantification System and Method

Abstract

The present invention relates to an augmented reality-based eye movement measurement and quantification system, and more specifically, comprises: a wearable device configured to be worn by a subject for eye movement measurement and equipped with an eye-tracking function to collect eye movement information of said subject; an image collection unit capable of collecting image information according to the gaze of said subject wearing said wearable device; a gyroscope sensor unit installed in said wearable device to measure head movement information of said subject; a location information collection unit installed in said wearable device to measure location information of said subject; and an eye movement analysis server that receives said eye movement information, image information, head movement information, and location information to analyze said eye movement, said eye movement analysis server is characterized by enabling said eye movement to be quantified so that it can be used for analyzing the central nervous system function of said subject. In addition, according to the present invention, there is an effect of quantifying eye movement information so that it can be used for analyzing the central nervous system function of a subject.

Description

Technology Field

[0001] The present invention relates to an augmented reality-based eye movement measurement and quantification system and method, and more specifically, to an augmented reality-based eye movement measurement and quantification system and method capable of measuring and quantifying eye movements through an augmented reality-based head-mounted display (HMD) and a gyroscope sensor. Background Technology

[0002] The purpose of the eyes is to accurately see the object being viewed; to this end, a total of 12 eye muscles—six in each eye—move precisely to maintain the vision necessary to see objects clearly. Functionally classifying eye movements, they include saccades (rapidly shifting the gaze to a desired object), smooth pursuit (smoothly following an object), vestibular eye movements (associated with vestibular senses), vergence (movement of both eyes toward opposite directions), optokinetic eye movements (following objects moving repeatedly up, down, left, and right), and fixation (fixing the gaze at a single point). For example, much of the eye movement in daily life, such as reading a book or watching a movie, is accomplished through saccades. Since vestibular eye movements occur in response to head movements, vision can be maintained even when the head moves while walking or running. Vergence occurs when looking at a fast-moving train, while vergence is required to look at nearby objects.

[0003] Each of these functional eye movements possesses a unique neural circuit, which extends in a complex and extensive manner from the cerebral cortex through the cerebellum to the brainstem. These circuits are closely interconnected and move both eyes independently or in cooperation. Consequently, precisely measuring each eye movement allows for the verification of the function of the related neural circuits, and by synthesizing these results, the function of the central nervous system extending from the cerebrum to the cerebellum and brainstem can be assessed. By quantifying these measured values, it becomes possible to measure and quantify the function of an individual's central nervous system as well.

[0004] Ultimately, the quantitative measurement and characteristics of eye movements can serve as a tool for identifying and assessing diseases of the central nervous system. Representative examples include dementia and Parkinson's disease, which are neurodegenerative diseases of the central nervous system extending from the cerebrum to the brainstem. While early diagnosis is crucial for these neurological diseases, they cannot be detected even with precise brain imaging tests such as MRI or CT scans when only mild neurological abnormalities are present in the early stages. Consequently, diagnostic methods capable of identifying neurological dysfunction at an early stage are critical. Since the neural circuits associated with eye movements consist of complex pathways distributed throughout the entire central nervous system corresponding to specific functional movements, precise measurement of these circuits can aid in the diagnosis of early-stage neurodegenerative diseases. This is merely one example, but it enables the characterization of neurological diseases for the purpose of discovery or diagnosis. Furthermore, it holds significance in that it allows for the measurement of brain function by identifying individual characteristics prior to the onset of disease, as it quantifies an individual's central nervous system function. While hospitals and research institutes have medical or research devices capable of measuring individual eye movements, there is a limitation in that they cannot measure eye movements that occur in daily life.

[0005] As a prior art document for measuring such eye movements, Korean Registered Patent Publication No. 10-2120643 discloses an eye movement resistance and force measuring device.

[0006] However, conventional technology has a problem in that it is difficult to verify central nervous system function using standardized diagnostic devices that measure customized eye movements optimized for an individual's abilities and environment. Prior art literature

[0007] (Prior Art 1) Korean Patent No. 10-2120643 (June 3, 2020) The problem to be solved

[0008] The present invention has been devised to solve the problems of the prior art described above, and its purpose is to quantitatively verify eye movements measured within an individual's daily environment and to identify the characteristics of a disease and the function of an individual's central nervous system by analyzing the quantitative data. means of solving the problem

[0009] In an augmented reality-based eye movement measurement and quantification system according to a preferred embodiment of the present invention, the system comprises: a wearable device configured to be worn by a subject for eye movement measurement and equipped with an eye-tracking function to collect eye movement information of said subject; an image collection unit configured to collect image information according to the gaze of said subject wearing the wearable device; a gyroscope sensor unit installed in the wearable device to measure head movement information of said subject; a location information collection unit installed in the wearable device to measure location information of said subject; and an eye movement analysis server that receives said eye movement information, image information, head movement information, and location information to analyze said eye movement, and said eye movement analysis server configured to quantify said eye movement so that it can be used for analyzing the central nervous system function of said subject. Effects of the invention

[0010] By means of the solution to the above problem, the present invention has the effect of quantifying eye movement information so that it can be used for the analysis of the central nervous system function of a subject being measured.

[0011] In addition, the present invention has the effect of collecting eye movement information from the daily life environment of the subject and enabling the identification of central nervous system function from eye movements optimized for the individual's abilities and environment. Brief explanation of the drawing

[0012] FIG. 1 is a configuration diagram of an augmented reality-based eye movement measurement and quantification system according to a first embodiment of the present invention. FIG. 2 is a flowchart of an augmented reality-based eye movement measurement and quantification method according to a first embodiment of the present invention. FIG. 3 is a flowchart of the eye movement measurement step of the augmented reality-based eye movement measurement and quantification method according to the first embodiment of the present invention. Specific details for implementing the invention

[0013] The terms used in this specification will be briefly explained, and the invention will be described in detail.

[0014] The terms used in this invention have been selected based on currently widely used general terms while considering their functions within the invention; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Therefore, the terms used in this invention should be defined not merely by their names, but based on their meanings and the overall context of the invention.

[0015] When a part of a specification is described as “comprising” a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0016] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein.

[0017] Specific details regarding the problem to be solved by the present invention, the means for solving the problem, and the effects of the invention are included in the embodiments and drawings described below. The advantages and features of the present invention, and the methods for achieving them, will become clear by referring to the embodiments described below in detail together with the accompanying drawings.

[0018] Hereinafter, the augmented reality-based eye movement measurement and quantification system of the present invention will be described in detail with reference to the attached drawings.

[0019] Referring to FIG. 1, an augmented reality-based eye movement measurement and quantification system according to a preferred first embodiment of the present invention comprises: a wearable device (100) which is provided to be worn by a subject for eye movement measurement and is equipped with an eye-tracking function to collect eye movement information of said subject; an image collection unit (200) which collects image information according to the gaze of said subject wearing the wearable device (100); a gyroscope sensor unit (300) installed in the wearable device (100) to measure head movement information of said subject; a location information collection unit (400) installed in the wearable device to measure location information of said subject; and an eye movement analysis server (500) which receives the eye movement information, image information, head movement information, and location information and analyzes the eye movement of said subject. And, the eye movement analysis server (500) enables the eye movement to be quantified so that it can be used to analyze the central nervous system function of the subject.

[0020] More specifically, the present invention enables the collection and analysis of eye movement information based on the subject's daily life or augmented reality images, using a wearable device (100), which is an augmented reality device provided to be worn on the head of a subject for eye movement measurement. The eye movements include saccade, which involves rapidly shifting one's gaze to a desired object; smooth pursuit, which involves smoothly following the object; vestibular eye movement associated with vestibular sensation; vergence, in which both eyes move in opposite directions; optokinetic eye movement, in which the subject follows an object moving repeatedly up, down, left, and right; and fixation, in which the gaze is fixed on one spot. For example, a significant portion of eye movements in daily life, such as reading a book or watching a movie, are performed through saccade. Since vestibular eye movement occurs in response to head movements, vision can be maintained even when the head moves while walking or running. When looking at a fast-moving train, optokinetic eye movement occurs, and vergence must be performed to look at nearby objects. And when such eye movement information is quantified, the function of the central nervous system can be verified. That is, the present invention aims to enable the measurement and quantification of the subject's central nervous system function by quantifying the subject's eye movement information. Furthermore, the present invention enables eye movements to be measured during the user's daily life, thereby allowing for the measurement of eye movements optimized for the subject's abilities and environment.

[0021] For example, the wearable device (100) is configured to be worn on the subject's head, including the eyes. Additionally, the wearable device (100) is equipped with an eye-tracking function to track the subject's gaze and collect eye movement information. Furthermore, the wearable device (100) receives an augmented reality image from the eye movement analysis server (500) and enables the augmented reality-based image to be displayed to the subject.

[0022] In addition, the image collection unit (200) is installed on the wearable device (100) and serves to collect image information regarding the living environment and augmented reality-based images viewed by the subject wearing the wearable device (100). For example, the image collection unit (200) may be provided in the form of a small camera and may be provided in various forms within the scope of this embodiment.

[0023] In addition, the gyroscope sensor unit (300) is installed in the wearable device (100) and serves to measure head movement information including the head rotation speed and tilt of the subject. Thus, eye movement information according to the subject's head position and angle and gaze can be collected simultaneously.

[0024] The above location information collection unit (400) is installed in the wearable device (100) to collect location information of the subject. The above location information collection unit (400) may be provided in the form of a GPS. That is, the above location information collection unit (400) enables location information, such as the subject's 3D position and altitude, to be transmitted in real time to the eye movement analysis server (500).

[0025] Finally, the eye movement analysis server (500) plays a role in quantifying the subject's eye movements based on the eye movement information, image information, and location information. More specifically, the eye movement analysis server (500) enables the analysis and quantification of eye movements through the eye movement information, including saccade (quickly shifting gaze to a desired object), smooth pursuit (smooth following), vestibular eye movement (vestibular eye movement associated with vestibular sense), vergence (movement of both eyes to opposite directions), optokinetic eye movement (following an object moving repeatedly up, down, left, and right), and fixation (fixing gaze to one place). Additionally, the eye movement analysis server (500) enables an augmented reality-based image to be output through the wearable device (100). At this time, the eye movement analysis server (500) is equipped with an information storage DB so that various data including augmented reality image data, eye movement information, video information, and location information can be stored.

[0027] Below, we will describe an augmented reality-based eye movement measurement and quantification method using an augmented reality-based eye movement measurement and quantification system.

[0028] With reference to FIGS. 2 and 3, the augmented reality-based eye movement measurement and quantification method according to the first embodiment of the present invention includes an eye movement measurement step (S100) in which eye movement information of a subject is measured by the wearable device (100), and a quantification step (S200) in which eye movement information is quantified by the eye movement analysis server (500).

[0029] First, the eye movement measurement step (S100) serves to measure eye movement information from a subject wearing the wearable device (100). At this time, the eye movement measurement step (S100) includes an everyday life-based eye movement measurement step (S110) that measures eye movements occurring in an everyday life environment, and an augmented reality-based eye movement measurement step (S120) that measures eye movements occurring through an augmented reality image, thereby enabling not only the measurement of eye movement information in an everyday life environment but also the measurement of eye movement information based on augmented reality.

[0030] For example, in the daily life-based eye movement measurement step (S110), eye movement information is measured in accordance with the gaze and head movements in the subject's daily life environment. Additionally, the daily life-based eye movement measurement step (S110) collects eye movement information regarding saccades through the absence of head movement or head movement in the same direction as the eyes. Additionally, the daily life-based eye movement measurement step (S110) collects eye movement information regarding vestibular eye movements associated with vestibular senses through the movement of the eyes in the opposite direction to the head and at the same speed as the head movement (eyeball velocity 100° / sec to 500° / sec, acceleration / deceleration data measurement). Additionally, the daily life-based eye movement measurement step (S110) collects eye movement information regarding smooth pursuit through the continuous movement of the subject's eyes (speed within 100° / sec). In addition, the above daily life-based eye movement measurement step (S110) collects eye movement information regarding vergence by moving the eyes in opposite directions (1m or more, duration 1sec).

[0031] In addition, in the augmented reality-based eye movement measurement step (S120), an augmented reality-based image is displayed to the subject to induce their gaze toward the image, thereby allowing eye movement information to be measured. Furthermore, the augmented reality-based eye movement measurement step (S120) generates augmented reality images in stages to induce the subject's gaze to move left, right, up, and down with an amplitude of 5° to 30°, and collects eye movement information regarding the saccade. Additionally, the augmented reality-based eye movement measurement step (S120) generates augmented reality images in stages to allow the head movement to move in stages within a speed of 20° / sec to 200° / sec, and collects eye movement information regarding vestibular eye movement associated with vestibular sense. In addition, the augmented reality-based eye movement measurement step (S120) collects eye movement information for smooth pursuit by generating augmented reality images in stages so that the subject's gaze can move 20° to the left, right, up, and down. In addition, the augmented reality-based eye movement measurement step (S120) collects eye movement information for vergence by causing augmented reality images to be generated repeatedly at intervals of 2m and 35cm from the front of the subject. At this time, the generated augmented reality images may be provided in the form of distinct yellow or red circles or fruits so that the subject can easily recognize them, and are based on a reference point being set at an interval of 2m in front of the subject and provided with a diameter of approximately 5cm.

[0032] Next, the quantification step (S200) quantifies the eye movement information by digitizing information including gaze movement, head movement, position, velocity, and acceleration based on the eye movement information measured from the eye movement measurement step (S100). Additionally, the quantification step (S200) enables the subject's central nervous system ability to be compared and analyzed by comparing the eye movement information measured in the augmented reality-based eye movement measurement step (S120) with pre-entered eye movement information.

[0033] The embodiments described above should be understood as exemplary in all respects and not limiting, and the scope of the invention is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the invention. Explanation of the symbols

[0034] 100 : Wearable device 200 : Video Acquisition Department 300 : Gyro sensor unit 400 : Location Information Collection Unit 500 : Eye Movement Analysis Server

Claims

Claim 1 A wearable device configured to be worn by a subject for eye movement measurement and equipped with an eye-tracking function capable of collecting eye movement information of said subject; an image collection unit capable of collecting image information according to the gaze of a subject wearing said wearable device; a gyroscope sensor unit installed in said wearable device for measuring head movement information of said subject; and a location information collection unit installed in said wearable device for measuring location information of said subject. and includes an eye movement analysis server that receives the eye movement information, image information, head movement information, and location information, analyzes the eye movements of the subject, enables an augmented reality-based image to appear to the subject through the wearable device to induce the subject's gaze to be directed toward the image, and measures the eye movements generated by the augmented reality image; wherein the eye movement analysis server enables the eye movements to be quantified so that they can be used for analyzing the central nervous system functions of the subject, and the wearable device, by means of the eye movement analysis server, enables an augmented reality-based image to appear to the subject, generates augmented reality images in stages to induce the subject's gaze to move left, right, up, and down with an amplitude of 5° to 30°, thereby collecting eye movement information regarding saccades, and generates augmented reality images in stages to enable head movements to move in stages within a speed of 20° / sec to 200° / sec, thereby collecting vestibular eye movement information associated with vestibular sense, and the subject's An augmented reality-based eye movement measurement and quantification system characterized by collecting eye movement information for smooth pursuit by generating augmented reality images in stages so that the gaze can move 20° left, right, up, and down, and collecting eye movement information for vergence by generating augmented reality images repeatedly at intervals of 2m and 35cm from the front of the subject. Claim 2 A method for measuring and quantifying augmented reality-based eye movements using an augmented reality-based eye movement measurement and quantification system of claim 1 comprises: an eye movement measurement step in which eye movement information of a subject is measured by an augmented reality-based wearable device for measuring eye movements; and a quantification step in which eye movement information is quantified by an eye movement analysis server; wherein the eye movement measurement step comprises an daily life-based eye movement measurement step for measuring eye movements occurring in a daily life environment; The method comprises an augmented reality-based eye movement measurement step, wherein an augmented reality-based image is displayed to the subject to induce the subject's gaze to be directed toward the image, and the eye movements generated by the augmented reality image are measured; wherein the augmented reality-based eye movement measurement step is characterized by generating augmented reality images in stages to guide the subject's gaze so that the subject's gaze moves with an amplitude of 5° to 30° in the left-right and up-down directions to collect eye movement information regarding saccades, generating augmented reality images in stages to allow the head to move in stages within a speed of 20° / sec to 200° / sec to collect eye movement information regarding vestibular eye movements associated with vestibular senses, generating augmented reality images in stages to allow the subject's gaze to move 20° in the left-right and up-down directions to collect eye movement information regarding smooth pursuit, and generating augmented reality images repeatedly at intervals of 2m and 35cm from the front of the subject to collect eye movement information regarding vergence. Augmented reality-based eye movement measurement and quantification method. Claim 3 delete Claim 4 delete Claim 5 delete

Images