Method and apparatus for diagnosing vertigo by measuring eye movement based on virtual reality, recording medium having a program for implementing the same stored therein, and computer program stored therein

A VR-based system tracks head and eye movements to diagnose dizziness by filtering meaningful nystagmus, addressing the high cost of nystagmometers and enhancing dizziness diagnosis efficiency.

JP2025500310AInactive Publication Date: 2025-01-09IND ACADEMIC COOP FOUND HALLYM UNIV +1
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2024537027
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-12-22
Filing Date
2022-06-08
Publication Date
2025-01-09
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing nystagmometers for diagnosing vestibulo-ocular reflex and oculomotor functions are expensive, limiting their widespread use, and commercially available VR devices lack the capability to accurately measure and transmit eye movements for dizziness diagnosis.

Method used

A VR-based system that tracks head and eye movements, filters meaningful nystagmus from raw data, and calculates the relative ratio of head and eye movements to diagnose dizziness, utilizing a headset-type VR device with integrated sensors and cameras to process and transmit eye movement videos.

Benefits of technology

Enables cost-effective dizziness diagnosis using affordable VR equipment, reducing unnecessary medical costs and providing accurate dizziness information through real-time optokinetic nystagmus measurement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025500310000001_ABST
    Figure 2025500310000001_ABST
Patent Text Reader

Abstract

The present invention relates to a technology for examining eye movement and diagnosing dizziness, and more particularly to a method and device for diagnosing dizziness by measuring eye movement based on virtual reality, which uses a commercially available VR device to measure, examine, and transmit eye movement, measures optokinetic nystagmus based on the movements of various gaze points (objects) generated in virtual reality, and diagnoses dizziness based on the measured nystagmus, a recording medium storing a program for implementing the same, and a computer program stored on the recording medium.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a technology for diagnosing dizziness by examining eye movement, and more particularly, to a method and device for diagnosing dizziness by measuring eye movement based on virtual reality, which uses a commercially available VR device to measure, examine, and transmit eye movement, while measuring optokinetic nystagmus through various gaze point (object) movements generated in virtual reality, and based on which dizziness is diagnosed, a recording medium storing a program for implementing the same, and a computer program stored on the recording medium. [Background technology]

[0002] Dizziness is a general term for any symptom in which one feels as if one is moving even though oneself or the things around oneself are standing still, and is mainly caused by abnormalities in the peripheral and central vestibular systems. Clinically, it is judged whether or not there is an abnormality in vestibular function based on the interaction between the vestibular system and vision, that is, the vestibular-ocular reflex. The vestibular-ocular reflex refers to the ability to fixate on something regardless of changes in head position, and if there is an abnormality in the vestibular system, the loss of fixation causes dizziness, as if the world is spinning around.

[0003] This type of vestibular-ocular reflex has the ability to fixate in response to rapid head position changes, but it is known that it cannot play a major role in extremely slow head position changes (rotations), and fixation during extremely slow head position changes that the vestibular-ocular reflex cannot handle is handled by the oculomotor function. This allows the human body to recognize space and maintain balance by maintaining the appropriate interrelationship between the oculomotor function and the vestibular-ocular reflex. Nystagmometers are commonly used as devices to test for abnormalities in the function of the vestibulo-ocular reflex and ocular movement. However, because nystagmometers are manufactured based on hardware, they are relatively expensive to manufacture. Due to the economic burden associated with this, many restrictions inevitably come into play in their use. Therefore, there was a need for an alternative technology that could test for abnormalities in the function of the vestibulo-ocular reflex and ocular movement as an alternative to the expensive nystagmometer.

[0004] As an alternative technology to the existing nystagmus meter, a headset-type VR (virtual reality) device currently on the market can be used. Most VR devices are equipped with a function to track eye movements. Such eye movement tracking functions are mainly used for gaming and marketing purposes, and are also used for some medical purposes, although to a limited extent. In addition, existing medical devices that measure nystagmus have a structure that is substantially similar to that of currently commercialized HMDs (Head Mounted Displays), so they can be used as nystagmus meters. However, the eye trackers built into most VR devices are only capable of vector tracking, and it is virtually impossible to use them to transmit eye images to the outside. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent No. 10-1978548 [Patent Document 2] Korean Patent No. 10-1898414 Summary of the Invention [Problem to be solved by the invention]

[0006] Therefore, an object of the present invention is to provide an apparatus and method for diagnosing dizziness that can measure and test the vestibulo-ocular reflex and optokinetic nystagmus, replacing the expensive nystagmusmeters conventionally used to test for abnormalities in the vestibular-ocular reflex and oculomotor function.

[0007] Another object of the present invention is to provide an apparatus and method for diagnosing dizziness that can test the vestibulo-ocular reflex and optokinetic nystagmus by utilizing VR equipment.

[0008] It is another object of the present invention to provide an apparatus and method for diagnosing vertigo that can detect head position and movement, measure vestibulo-ocular reflexes, process raw data acquired through eye tracking and an internal camera, and test for optokinetic nystagmus.

[0009] Another object of the present invention is to provide a recording medium storing a program for implementing the dizziness diagnosis method, and a computer program stored in the recording medium.

[0010] Furthermore, the present invention is not limited to the above-mentioned objects, and various other objects can be further provided by the techniques described in the following examples and claims. [Means for solving the problem]

[0011] In an embodiment for achieving the above-mentioned object, the present invention provides a virtual reality-based dizziness diagnosis device using eye movement measurement, including a head movement detection unit that detects the movement of a patient's head in response to a signal detected by a head tracker attached to a VR device and detecting the position and movement of the patient's head, an eye movement video acquisition unit that receives raw data obtained by photographing the movement of the patient's eyes from an eye tracker attached to the VR device and acquires an eye movement video, an eye movement video transmission unit that transmits the eye movement video acquired from the eye movement video acquisition unit, a nystagmus detection unit that receives the eye movement video, filters saccades from the eye movement video, detects only nystagmus, and filters out meaningless eye movements that cannot be measured because they are too slow or the eyes are hidden by blinking from the detected nystagmus, thereby detecting only meaningful nystagmus, and a diagnosis unit that diagnoses the patient's dizziness based on the meaningful nystagmus detected by the nystagmus detection unit.

[0012] Also, the eye movement video acquisition unit may process raw data on eye movements captured using an internal camera of the eye tracker using a processing program to acquire an eye movement video.

[0013] In addition, the head movement detection unit may further include a calculation unit that calculates the relative ratio between head movement and eye movement by a method of dividing a head movement angle detected in response to a change in the patient's head by an eye movement angle obtained in response to the head change.

[0014] Furthermore, the diagnosis unit can determine that there is an abnormality in the vestibular function if the relative ratio calculated by the calculation unit is not "1."

[0015] The device may further include a graph output unit that displays the nystagmus detected by the nystagmus detection unit on three axes (horizontal / vertical / rotational).

[0016] The virtual reality device may further include a gaze guidance point providing unit that provides a gaze point for guiding a gaze through a display installed in the virtual reality device.

[0017] The gaze point of the line of sight may be curtain-shaped or point-shaped.

[0018] Also, the device may further include a posture adjustment guide for providing a patient with a correct posture required for each examination through the VR device.

[0019] In addition, in another embodiment to achieve the above-mentioned object, the present invention provides a method for diagnosing dizziness by measuring eye movement based on virtual reality, including: (a) a step of detecting the patient's head movement by receiving a signal detected from a head tracker attached to a VR device and detecting the position and movement of the patient's head; (b) a step of receiving raw data obtained by photographing the patient's eye movement from an eye tracker attached to the VR device, acquiring and transmitting an eye movement video; (c) a step of distinguishing between saccades and nystagmus from the eye movement video, filtering out meaningless eye movements that cannot be measured because they are too slow or the eyes are hidden by blinking from the detected nystagmus, and detecting only meaningful nystagmus; and (d) a step of diagnosing the type of dizziness of the patient based on the detected meaningful nystagmus.

[0020] In step (b), raw data of eye movements captured by the internal camera of the eye tracking device can be processed using a processing program to obtain and transmit an eye movement video.

[0021] In step (d), the head movement angle detected in step (a) corresponding to the head change is divided by the eye movement angle which moves in response to the head change to calculate a relative ratio between the head movement and the eye movement, and if the calculated relative ratio does not reach "1" or a self-set normal value, it can be determined that there is an abnormality in the vestibular function.

[0022] The method may further include a step (e) of graphically representing the nystagmus detected in the step (c) using three axes (horizontal / vertical / rotation).

[0023] Also, the method may further include, before the step (b), a step of (f) providing a gaze point for guiding a gaze through the VR device.

[0024] The gaze point of the line of sight may be curtain-shaped or point-shaped.

[0025] Also, the method may further include (g) providing the patient with an accurate posture required for each examination through the VR device after the step (a).

[0026] In order to achieve the above-mentioned object, according to another embodiment of the present invention, there is provided a computer-readable recording medium storing a program for implementing the above-mentioned virtual reality-based eye movement measurement method for diagnosing dizziness.

[0027] In order to achieve the above-mentioned object, according to another embodiment of the present invention, there is provided a computer program stored on a computer-readable recording medium for implementing the above-mentioned virtual reality-based eye movement measurement method for diagnosing dizziness. Effect of the Invention

[0028] As described above, according to the device and method for diagnosing dizziness by measuring eye movement based on virtual reality according to the embodiment of the present invention, it is possible to easily test for dizziness using a relatively inexpensive VR device by acquiring and transmitting an eye movement video using a commercially available VR device. Also, by diagnosing dizziness through a simple test, it is possible to obtain information for diagnosing dizziness in a simple manner.

[0029] In addition, according to the virtual reality-based eye movement measurement dizziness diagnosis device and method according to the embodiment of the present invention, raw signal data (raw signal data for vector tracking) captured through the internal camera of the eye tracker is recombined to externally transmit eye movement video in real time and measure optokinetic nystagmus, thereby replacing the role of existing expensive nystagmus meters, and in the case of dizziness patients, wasteful medical expenses due to unnecessary image tests can be minimized, thereby contributing to public health. [Brief description of the drawings]

[0030] [Figure 1] 1 is a block diagram showing a dizziness diagnosis device according to an embodiment of the present invention. [Diagram 2] 2 is a diagram illustrating a simplified example of the configuration of the VR device illustrated in FIG. 1. [Diagram 3] 2 is a diagram illustrating a schematic hardware configuration of the eyeball tracking device illustrated in FIG. 1. [Figure 4] FIG. 2 is a simplified diagram illustrating the processing of raw signal data according to the present invention. [Diagram 5] FIG. 2 shows a nystagmus graph according to the present invention. [Figure 6] FIG. 2 shows a nystagmus graph according to the present invention. [Figure 7] FIG. 2 is a diagram showing a simplified view of a gaze point according to the present invention. [Figure 8] 1 is a flowchart illustrating a method for diagnosing dizziness according to an embodiment of the present invention. [Figure 9] 4 is a flow chart illustrating further steps of a method for diagnosing dizziness according to an embodiment of the present invention. [Figure 10] 4 is a flow chart illustrating further steps of a method for diagnosing dizziness according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] The advantages and features of the present invention and the methods for achieving them will become apparent from the following detailed description of the embodiments together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and may be embodied in various different forms, which are provided to fully inform those skilled in the art of the present invention of the scope of the invention, and the present invention is defined by the scope of the claims.

[0032] In addition, the terms used in this specification are for the purpose of describing the embodiments, and are not intended to limit the present invention. In this specification, the singular form includes the plural form unless otherwise specified. For example, as used in this specification, "comprises" (or "comprises") and / or "comprises" (or "comprises") can include the mentioned components and steps. The same reference numerals refer to the same components throughout the specification. "And / or" includes each and every combination of one or more of the mentioned items.

[0033] In addition, unless otherwise specified, all terms (including technical and scientific terms) used in this specification can be used in a manner that can be commonly understood by those with ordinary knowledge. In addition, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly and specifically defined.

[0034] FIG. 1 is a block diagram showing a dizziness diagnosis device according to an embodiment of the present invention.

[0035] 1, a dizziness diagnosis device 10 according to an embodiment of the present invention uses a commercially available VR device, for example, a HMD (Head Mounted Display), to measure the position and movement of the head, measure the movement (movement) of the eyeball, and transmit the results to the outside to test the vestibular ocular reflex and optokinetic nystagmus. As a result, the commercially available VR device can be used to replace the nystagmus meter, which has been widely used as a conventional eye movement test device.

[0036] FIG. 2 is a diagram illustrating an example of the configuration of the VR device illustrated in FIG.

[0037] As shown in Figures 1 and 2, the VR equipment according to the present invention includes a head tracker 11 that tracks the position and movement of the head, an eye tracker 12 that tracks the movement of the eyes, and a display (monitor) 13 that outputs images to the patient, and may further include a video camera 14 that captures the real world, an image generation unit 15 that generates images (e.g., graphic images) corresponding to the position and movement of the head tracked by the head tracker 11, and an image combination unit 16 that combines the images of the real world captured by the video camera 14 with the images generated by the image generation unit 15 and transfers them to the display 13.

[0038] FIG. 3 is a diagram illustrating a schematic hardware configuration of the eyeball tracking device illustrated in FIG.

[0039] 3, the eye tracker 12 includes an internal camera 121 that captures the movement of the eye 1. In this case, the internal camera 121 can capture the movement of the eye 1 through a reflecting mirror 124, and the light source 123 can be, for example, an NIR light source.

[0040] 1, head tracker 11 includes a sensor that detects the position and movement of the head, and the position and movement of the head tracked through the sensor is detected by head movement detector 17. That is, head movement detector 17 detects the position and movement of the head tracked by head tracker 11 and processes information on the position and movement of the head.

[0041] 1, in the embodiment of the present invention, the head movement detection unit 17 is configured as a separate component from the head tracker 11, but this is only an example and it can also be configured as an integrated component within the head tracker 11. That is, the head tracker 11 is composed of a sensor that detects the position and movement of the head, and the head movement detection unit 17 can be composed of software that detects the position and movement of the head upon receiving a detection signal detected by the sensor.

[0042] The dizziness diagnosis apparatus 10 according to the embodiment of the present invention also includes an eye movement video capture unit 18 for processing the eye movements tracked by the eye tracker 12.

[0043] The eye movement video acquisition unit 18 can also be integrated into the eye tracking device 12 and operated to recombine the raw signal data of the eye 1 captured via the internal camera 121 and transmit the video of the actual eye movement, i.e., the eye movement video, to the outside.

[0044] An example of the raw data format of the signal transferred from the internal camera 121 is as follows: [Table 1]

[0045] FIG. 4 is a simplified diagram illustrating the process of processing raw signal data according to the present invention.

[0046] 1 and 4, when the eyeball moves based on the raw data of the signal provided from the internal camera 121, a process is required to track the vertical, horizontal and rotational (torsion) aspects of the eyeball and confirm the movement of the eyeball (pupil). However, SDKs provided by general HMD companies do not provide eyeball rotation (torsion) information. In order to obtain eyeball rotation information, images of the internal eyeball movement must be transmitted to the outside in real time while wearing the HMD, and the rotation information must be confirmed by self-image processing.

[0047] As shown in Fig. 4, a processing program is required to process raw data captured through the internal camera 121 of the eye tracker 12. For example, the processing program may be an SDK for the HMD. The SDK processing program has a common structure including an eye camera module and an eye prediction module in the form of software to receive and process eye image information captured through the internal camera 121 for tracking the eye.

[0048] The SDK uses openCV to generate an image transfer function, divides the eye image captured through the internal camera 121 into image frames, and transfers the divided image frames to the prediction module. At this time, the image frame is modified by modifying the openCV function to load image frame data into a pipe and transmit it. Also, the client side can implement the receiving end of this pipe to extract image frames (Raw Eye Image data).

[0049] The eye movement video acquisition unit 18 receives the signal transmitted from the eye tracker 12, and then recombines it according to the processing method shown in FIG. 4 to acquire the actual eye movement video. The eye movement video thus acquired is then transmitted via the eye movement video transmission unit 19.

[0050] On the other hand, as shown in FIG. 1, the nystagmus detection unit 20 is for detecting visual motility (eye movement function) and detects meaningful nystagmus necessary for diagnosing dizziness from eye movements in the eye movement video provided via the eye movement video transmission unit 19.

[0051] Nystagmus means an involuntary movement of the eyes. For example, when sitting on a chair rotating clockwise, the eyes rotate clockwise and then return to their original position repeatedly, without our awareness, according to the speed of the chair. In this case, the eye movement that returns to the original position is usually fast, and this is called the "fast component". Thus, nystagmus is composed of a "fast component" and a "slow component". By the way, there are eye movements that look like nystagmus, but are not nystagmus, such as the eyes moving quickly to the right and then quickly returning to their original position, or moving slowly to the right and then slowly returning to the left. This is not called nystagmus, but is usually called "saccade". Saccade is a pathological finding that suggests an abnormality in the central-vestibular-optic pathway, so it is very important to distinguish it from nystagmus. Even if it is nystagmus, if the strength (the speed of the slow component of the eye movement) is too weak, less than 2 to 3 deg / sec, or if the eyes are hidden by blinking, etc., nystagmus cannot be measured correctly. The same is true for saccades.

[0052] Therefore, the nystagmus detection unit 20 filters the eye movements in the eye movement video transmitted by the eye movement video transmission unit 19, and detects only meaningful nystagmus. That is, the nystagmus detection unit 20 can distinguish between saccades and nystagmus, and includes a function of detecting only nystagmus excluding meaningless eye movements (movements that are too slow or cannot be measured because the eyes are hidden by blinking, etc.).

[0053] In addition, since nystagmus is a movement of the eyeball along the time axis, if the patient closes his or her eyes and nystagmus is not detected for a certain period of time, the function of predicting the nystagmus movement pattern can be included based on the pattern just before closing the eyes and after opening the eyes and measuring again. For example, in the case of navigation used while driving a car, the nystagmus movement pattern can be predicted in the same way as the method of displaying the route of the car based on the speed and position before entering the tunnel even though the GPS is not working after entering the tunnel. In addition, in the case of saccades, the function of warning the car and stopping the examination and recommending radiography, etc. can be included.

[0054] Any significant nystagmus detected by the nystagmus detection unit 20 is transferred to a graph output unit 21.

[0055] 5 and 6 are diagrams showing nystagmus graphs according to the present invention.

[0056] As shown in Fig. 1 and Fig. 5, the graph output unit 21 generates and outputs a nystagmus graph for the patient based on the nystagmus detected by the nystagmus detection unit 20. The nystagmus graph is a graph of eyeball movement over time, and the eyeball moves on three axes: horizontal (right / left), vertical (up / down), and rotation (clockwise / counterclockwise). Here, in Fig. 5, Hor(horizontal)L(left) means the horizontal of the left eye, Ver(vertical)L(left) means the vertical of the left eye, and Tor(torsional)L(left) means the rotation of the left eye, and the same applies to the right eye. Also, as shown in Fig. 6, the eyeball graph is displayed separately into three parts: horizontal, vertical, and rotation.

[0057] Meanwhile, as shown in Fig. 1, the dizziness diagnosis device 10 according to the embodiment of the present invention may further include a gaze guidance point providing unit 22. The gaze guidance point providing unit 22 presents a gaze point (target point) for guiding the gaze in virtual reality in order to measure optokinetic nystagmus.

[0058] FIG. 7 is a diagram showing an example of a gaze point of the line of sight according to the present invention in a simplified manner.

[0059] 1 and 7, the gaze guidance point providing unit 22 can output a gaze point for guiding the gaze in the virtual reality to measure optokinetic nystagmus through the display 13. Of course, instead of the display 13, a separate display device can be used.

[0060] The gaze guidance gaze point providing unit 22 outputs a gaze point having a certain shape via the display 13 to induce optokinetic nystagmus, and the gaze point may be curtain-shaped (see FIG. 7(a)) or dot-shaped (see FIG. 7(b)). In this case, the gaze point may be provided in the form of horizontal or vertical rotation or intermittent movement at a certain speed or various speeds. In addition, the movement of the nystagmus that moves corresponding to the gaze point may be tracked, and the tracked movement of the nystagmus may be output to the graph output unit 21.

[0061] As shown in Fig. 1, the dizziness diagnosis device 10 according to the embodiment of the present invention may further include a calculation unit 23. The calculation unit 23 divides the head movement angle detected by the head movement detection unit 17 by the eye movement angle to calculate a relative ratio between the head movement and the eye movement. Here, the head movement angle is the angle of head movement changed when the patient moves his / her head, and means the angle of head movement based on a reference value (initial head reference position). The eye movement angle is the angle of eye movement corresponding to the angle of head movement due to the change in the patient's head, and may be provided by the eye movement video transmission unit 19 or the eye movement video acquisition unit 18.

[0062] Calculation unit 23 calculates a relative ratio by dividing the head movement angle detected by head movement detection unit 17, i.e., the angle by which the head has moved from a reference value, by the eye movement angle. The relative ratio thus calculated by calculation unit 23 is provided to diagnosis unit 24.

[0063] Diagnosis unit 24 judges whether there is an abnormality in the vestibular function using the relative ratio calculated by calculation unit 23. For example, if the value obtained by dividing the head movement angle detected in head movement detection unit 17 corresponding to the head change by the eye movement angle, i.e., the calculated relative ratio, is not "1", it can be determined that there is an abnormality in the vestibular function.

[0064] For example, when the head (neck) is moved 20° to the right in one second, the eyes move 20° in the opposite direction to the normal movement for the same time. For example, if the head is moved 30° to the right for one second and the eyes move 20° in the opposite direction for the same time, the calculation unit 23 divides the head movement angle (20°) by the nystagmus movement angle (30°), and if the divided value is not "1", the diagnosis unit 24 determines that there is an abnormality in the right vestibular function. However, this process is merely an example, and the normal value of the calculated relative ratio is not necessarily "1", and the normal value is input differently by the expert who uses this, and abnormalities can be distinguished according to the input normal value.

[0065] The diagnosis unit 24 can diagnose the type of dizziness of the patient based on the nystagmus detected by the nystagmus detection unit 20. In order to diagnose the type of dizziness of the patient, information about the dizziness is stored and registered in a database, and the diagnosis unit 24 can diagnose the type (symptoms) of dizziness by comparing the currently measured nystagmus of the patient with the already registered dizziness information.

[0066] Meanwhile, the dizziness diagnosis device 10 according to the embodiment of the present invention may further include a posture adjustment guidance unit 25 that provides a test method for each test step and guides a patient to a required posture for an accurate test. The posture adjustment guidance unit 25 provides (feeds back) a required posture to the patient through a speaker (not shown) for an accurate test.

[0067] The feedback provided by the attitude adjustment guidance unit 25 is shown in Table 2 below. [Table 2] JPEG2025500310000004.jpg212170JPEG2025500310000005.jpg61170

[0068] FIG. 8 is a flow chart illustrating a method for diagnosing dizziness according to an embodiment of the present invention.

[0069] 1 and 8, head movement is detected using a VR device such as an HMD (S1). That is, the position and movement of the head can be detected using a head tracker 11 attached to the VR device while the HMD having a headset structure is worn on the head.

[0070] Next, a video of the eye movement is acquired and transmitted (S2). For example, the patient's eye is photographed via an eye tracker 12 attached to the VR device to acquire raw data, and then the acquired raw data is recombined using a processing program such as that shown in FIG. 4 to acquire an eye movement video, and the acquired video is transmitted.

[0071] Next, meaningful nystagmus is detected from the eyes of the patient suffering from dizziness (S3). That is, meaningful nystagmus is detected from the acquired eye movement video. For example, saccades are filtered from the acquired eye movement video to detect only nystagmus, and meaningless eye movements in the detected nystagmus are filtered to detect only the actually meaningful nystagmus.

[0072] Next, the type of dizziness of the patient is diagnosed based on the detected meaningful nystagmus (S4). For example, in order to diagnose the type of dizziness of the patient, information about dizziness is stored and registered in a database, and the diagnosis unit 24 can compare the currently measured nystagmus of the patient with the already registered dizziness information to diagnose the type (symptom) of dizziness.

[0073] FIG. 9 is a flow chart illustrating further steps of a method for diagnosing dizziness according to an embodiment of the present invention.

[0074] As shown in FIG. 9, the dizziness diagnosis method according to the embodiment of the present invention further includes a step of providing a gaze guidance point (S5) before the step of acquiring and transmitting an eye movement video (S2).

[0075] The gaze guidance gaze providing step (S5) provides a gaze point in the form of a curtain (see FIG. 7(a)) or a point (see FIG. 7(b)) having a vertical bar shape, as shown in FIG.

[0076] FIG. 10 is a flow chart illustrating further steps of a method for diagnosing dizziness according to an embodiment of the present invention.

[0077] 10, the dizziness diagnosis method according to the embodiment of the present invention further includes a posture correction process (S6, S7) for correcting the posture of the patient after the head position and movement detection process (S1). For example, the posture correction process (S6, S7) provides an examination method for each examination step and guides the patient to a required posture (see Table 2) so that an accurate examination can be performed.

[0078] The dizziness diagnosis method according to the embodiment of the present invention described above may be embodied in the form of a recording medium (or a computer program product) executable by a computer, for example, a program module stored in a computer-readable medium and executed by a computer.

[0079] Here, the computer-readable medium may include a computer storage medium (e.g., a memory, a hard disk, a magnetic / optical medium, or a solid-state drive (SSD)). The computer-readable medium may be any available medium that can be accessed by a computer, and may include, for example, both volatile and nonvolatile media, and both separate and non-separate media.

[0080] In addition, the dizziness diagnosis method according to an embodiment of the present invention includes instructions executable in whole or in part by a computer, and the computer program includes programmable machine instructions processed by a processor, and can be embodied in a high-level programming language, an object-oriented programming language, an assembly language, a machine language, or the like.

[0081] As described above, the preferred embodiment of the present invention has been described and illustrated using specific terms, but such terms are merely for the purpose of clarifying the present invention. It is obvious that the embodiments of the present invention and the terms described herein may be modified and changed in various ways without departing from the technical spirit and scope of the following claims. Such modified embodiments should not be understood separately from the spirit and scope of the present invention, but should be included within the scope of the claims of the present invention. [Explanation of symbols]

[0082] 1 eyeball, 10 dizziness diagnosis device, 11 head tracker, 12 eyeball tracker, 13 display (monitor), 14 video camera, 15 image generation unit, 16 image combination unit, 17 head movement detection unit, 18 eyeball movement video acquisition unit, 19 eyeball movement video transmission unit, 20 nystagmus detection unit, 21 graph output unit, 22 gaze guidance gaze point provision unit, 23 calculation unit, 24 diagnosis unit, 25 posture adjustment guidance unit, 121 internal camera, 123 light source, 124 reflective mirror.

Claims

1. a head movement detection unit that is attached to the VR device and detects the movement of the patient's head in response to a signal detected by a head tracker that detects the position and movement of the patient's head; an eye movement video acquisition unit that receives raw data obtained by capturing the eye movement of a patient from an eye tracking device attached to the VR device and acquires an eye movement video; an eye movement video sending unit that sends the eye movement video acquired from the eye movement video acquiring unit; a nystagmus detection unit that receives the eye movement video, filters saccades from the eye movement video, detects only nystagmus, and filters meaningless eye movements that cannot be measured because they are too slow or because the eye is hidden by a blink from the detected nystagmus, thereby detecting only meaningful nystagmus; and a diagnosis unit for diagnosing dizziness in a patient based on the significant nystagmus detected by the nystagmus detection unit; A virtual reality-based eye movement measurement dizziness diagnosis device including:

2. 2. The virtual reality-based eye movement measurement dizziness diagnosis device according to claim 1, wherein the eye movement video acquisition unit processes raw data on eye movement captured by an internal camera of the eye tracking device using a processing program to acquire an eye movement video.

3. 2. The virtual reality-based eye movement measurement dizziness diagnosis device of claim 1, further comprising a calculation unit that calculates a relative ratio between head movement and eye movement by a method of dividing a head movement angle detected in the head movement detection unit in response to a change in the patient's head by an eye movement angle obtained in response to the change in the head.

4. 4. The virtual reality-based dizziness diagnosis device using eye movement measurement according to claim 3, wherein the diagnosis unit determines that there is an abnormality in vestibular function when the relative ratio calculated by the calculation unit is not "1".

5. 2. The virtual reality-based dizziness diagnosis device according to claim 1, further comprising a graph output unit for expressing the nystagmus detected by said nystagmus detection unit in three axes (horizontal / vertical / rotational).

6. The virtual reality-based dizziness diagnosis device by eye movement measurement according to claim 1, further comprising a gaze guidance gaze point providing unit that provides a gaze point for guiding the gaze through a display provided within the VR device.

7. The virtual reality-based eye movement measurement dizziness diagnosis device according to claim 6, wherein the gaze point is curtain-shaped or point-shaped.

8. 2. The virtual reality-based dizziness diagnosis apparatus according to claim 1, further comprising a posture adjustment guide unit for providing a patient with a correct posture required for each examination through the VR device.

9. (a) detecting the patient's head movement in response to a detected signal from a head tracker attached to the VR device, the head tracker detecting the position and movement of the patient's head; (b) receiving raw data obtained by capturing the patient's eye movements from an eye tracking device attached to the VR device, acquiring and transmitting an eye movement video; (c) A process of distinguishing between saccades and nystagmus from the eye movement video, filtering out meaningless eye movements that are too slow or cannot be measured because the eye is hidden by blinking, and detecting only meaningful nystagmus; and (d) diagnosing a type of dizziness in the patient based on the detected meaningful nystagmus; and A method for diagnosing dizziness using virtual reality-based eye movement measurements, comprising:

10. In the step (b), The method for diagnosing dizziness by virtual reality-based eye movement measurement according to claim 9, further comprising: processing raw data of eye movement captured by an internal camera of the eye tracker using a processing program to obtain and transmit an eye movement video.

11. In the step (d), 10. The method for diagnosing dizziness using virtual reality-based eye movement measurement as described in claim 9, wherein in the step (a), a head movement angle detected in response to a head change is divided by an eye movement angle which moves in response to the head change to calculate a relative ratio between the head movement and the eye movement, and if the calculated relative ratio does not reach "1" or a self-set normal value, it is determined that there is an abnormality in the vestibular function.

12. 10. The method for diagnosing dizziness by measuring eye movement based on virtual reality according to claim 9, further comprising: (e) a step of graphically representing the nystagmus detected in step (c) as three axes (horizontal / vertical / rotational).

13. The method for diagnosing dizziness through virtual reality-based eye movement measurement according to claim 9, further comprising the step of: (f) providing a gaze fixation point for guiding gaze through the VR equipment before the step (b).

14. The virtual reality-based eye movement measurement dizziness diagnosis device according to claim 13, wherein the gaze point is curtain-shaped or point-shaped.

15. The method for diagnosing dizziness by virtual reality-based eye movement measurement according to claim 9, further comprising the step of: (g) providing the patient with an accurate posture required for each test through the VR equipment after the step (a).

16. A computer-readable recording medium storing a program for implementing the method for diagnosing dizziness by measuring eye movement based on virtual reality according to any one of claims 9 to 15.

17. A computer program stored on a computer-readable recording medium for implementing the method for diagnosing dizziness by virtual reality-based eye movement measurement according to any one of claims 9 to 15.

Citation Information

Patent Citations

  • A feature extraction and tracking algorithm of nystagmus signals for diagnosis of vestibular system diseases

    CN109146851A

  • Video head pulse test sensor post-correction method and system, electronic equipment and storage medium

    CN113035355A

  • Data processing device, monitoring system, awakening system, data processing method, and data processing program

    JP2019195376A

  • Nystagmus analysis system

    JP2020018704A

  • Drowsiness or awakening level evaluation device and evaluation program

    JP2021053240A