Vision correction device using augmented reality and control method thereof

Abstract

A vision correction device according to one disclosed embodiment comprises: a glass frame; a display unit which is connected to the glass frame and outputs light corresponding to an augmented reality image; an optical unit which is connected to the display unit to be positioned in front of the eyes of a wearer and reflects any one of the light outputted from the display unit and the light incident from the real world and allows the other one to be transmitted so as to allow both lights to proceed to the eyeballs of the wearer; a communication unit for receiving augmented reality image data and vision data from the outside; and a control unit for adjusting the augmented reality image data on the basis of the vision data, and controlling the display unit so as to output the adjusted augmented reality image data.

Description

Vision Correction Device Using Augmented Reality and Its Control Method

[0001] The disclosed embodiments relate to AR glasses for correcting or improving vision, and to an eye health care device and its control method for correcting amblyopia, myopia, hyperopia, or strabismus.

[0002] Amblyopia refers to a condition where the vision of one or both eyes does not develop normally. Patients with amblyopia can usually occur when the vision development of the eyes is not smooth during childhood. If not treated early, amblyopia can lead to permanent vision damage. Conventionally, it is treated through glasses, half glasses, or colored glasses, and in some cases, ophthalmic treatment or vision training is required.

[0003] Myopia refers to a condition where the refractive power of the eye is strong, making it difficult to clearly see distant objects. Patients with myopia can see nearby objects clearly, but distant objects appear blurry. This is a phenomenon caused by the eye's crystalline lens (the part that acts as a lens to focus light onto the retina) focusing too much light, and conventionally, correction treatment is carried out through glasses or contact lenses.

[0004] Strabismus refers to a condition where the directions of the two eyes do not exactly match, and the eyes look in different directions. Patients with strabismus perceive the images seen by the two eyes differently, and it can occur due to problems with the eye muscle control or abnormal functions of the brain's visual center. Conventionally, strabismus is treated through vision correction or ophthalmic surgery.

[0005] Myopia can occur during childhood, especially in the juvenile period from 6 to 14 years old or the youth period (15 - 25 years old), and it gradually worsens as people age. The vision of patients with such symptoms requires strong optical correction over time.

[0006] Patients with myopia typically receive treatment with glasses, contact lenses, or refractive surgery. However, refractive surgery is often costly, leading many to avoid or neglect treatment. However, if myopia worsens, it can lead to retinal degeneration, glaucoma, and retinal detachment, potentially leading to blindness. Therefore, slowing the progression of myopia is crucial.

[0007] In particular, the treatment of amblyopia primarily involves the use of half-glasses or protective tinted glasses that block the vision of the normal eye. However, treatment of amblyopia in children whose vision is still developing has been hampered by the fact that patients with low willpower often remove the half-glasses that block the vision of the normal eye. This complicates treatment progress.

[0008] Meanwhile, the prior art disclosed in 2019 discloses a technology to suppress myopia using virtual reality.

[0009] [Patent Document 1] Korean Patent Publication No. 10-2019-0057871A

[0010] The above patent document 1 discloses a technology for suppressing the occurrence of myopia using a VR (Virtual Reality) device and providing a virtual image so that a non-cross parallax is formed based on a distance sensed through an ultrasonic sensor.

[0011] However, these conventional technologies are not only limited to myopia, but also have limitations in long-term suppression treatment for patients with myopia, amblyopia, or strabismus because they use devices that are difficult for pediatric patients to wear for long periods of time, such as head mounts.

[0012] The disclosed embodiment relates to a vision correction device and a control method thereof, which allows a user to perform vision correction while using the augmented reality device for a long time by adjusting augmented reality image data based on vision data.

[0013] A vision correction device according to one embodiment of the present disclosure comprises: a glass frame; a display unit connected to the glass frame and outputting light corresponding to an augmented reality image; an optical unit connected to the display unit and positioned in front of the wearer's eyes, the optical unit reflecting one of light output from the display unit and light incident from the real world and transmitting the other, thereby directing both lights toward the wearer's eyes; a communication unit receiving augmented reality image data and vision data from the outside; and a control unit controlling the display unit to adjust the augmented reality image data based on the vision data and output the adjusted augmented reality image data.

[0014] The above control unit can adjust the depth recognition distance of the augmented reality image data based on the size of the diopter included in the vision data.

[0015] The control unit can distinguish between nearsighted or farsighted data included in the visual acuity data, and adjust the depth perception distance of the augmented reality image data differently depending on nearsightedness and farsightedness based on the size of the diopter.

[0016] The above control unit can adjust the size of the blur radius of the augmented reality image data based on the size of the corrected vision included in the vision data.

[0017] The above control unit can adjust the size of the blur radius of the augmented reality image data based on the size of the prism diopter included in the vision data.

[0018] The display unit includes a first display unit corresponding to the wearer's left eye and a second display unit corresponding to the wearer's right eye,

[0019] The device may further include a first folding part that connects the first display part and the glass frame and moves the first display part forward or backward of the wearer's left eye; and a second folding part that connects the second display part and the glass frame and moves the second display part forward or backward of the wearer's right eye.

[0020] The control unit can distinguish between left eye vision data and right eye vision data included in the vision data, and independently control the first display unit and the second display unit based on the distinguished vision data.

[0021] A method for controlling a vision correction device including a glass frame according to another disclosed embodiment, a display unit connected to the glass frame, and an optical unit connected to the display unit includes receiving augmented reality image data and vision data from an external source; performing image processing of the augmented reality image data; adjusting a depth perception distance or blur radius of the image-processed augmented reality image data based on the vision data; and controlling the display unit to output the adjusted augmented reality image data.

[0022] The above adjustment may include adjusting the depth perception distance based on the size of the diopter of myopia included in the visual acuity data.

[0023] The above adjusting may include adjusting the depth perception distance based on the size of the raw diopter included in the vision data.

[0024] The adjusting may include adjusting the blur radius based on the size of the corrected visual acuity of the amblyopia included in the visual acuity data.

[0025] The above adjusting may include adjusting the blur radius based on the size of the prism diopter of the strabismus included in the visual acuity data.

[0026] The display unit may include a first display unit corresponding to the wearer's left eye and a second display unit corresponding to the wearer's right eye, and the controlling may include independently controlling the first display unit and the second display unit based on the adjusted augmented reality image data.

[0027] A computer-readable recording medium having recorded thereon a program capable of executing a control method of the above vision correction device includes: receiving augmented reality image data and vision data from an external source; performing image processing of the augmented reality image data; adjusting a depth perception distance or blur radius of the image-processed augmented reality image data based on the vision data; and controlling a display unit to output the adjusted augmented reality image data.

[0028] The vision correction device and its control method according to the disclosed embodiment can provide a clear augmented reality image to an amblyopic eye (or strabismus) while simultaneously providing a blurred image or blocking the field of vision to a normal eye by adjusting augmented reality image data based on vision data.

[0029] In addition, the vision correction device and its control method according to the disclosed embodiment can suppress further progression of myopia or hyperopia by optically adjusting the viewing distance of an augmented reality image, and can also slow down the rate of progression.

[0030] The disclosed vision correction device and its control method are effective for corrective treatment because, compared to conventional technologies that provide vision correction images and cause users' interest to decline after a certain period of time, users with weak willpower can play various game images or video content, including dramas, movies, and online classes, and can arouse users' interest for a long period of time.

[0031] FIG. 1 is a schematic drawing of a vision correction device and an entire system including the same according to one disclosed embodiment.

[0032] FIG. 2 is a perspective view of a vision correction device according to one embodiment of the disclosure.

[0033] FIG. 3 is a perspective view looking down from above of the vision correction device according to the embodiment of FIG. 2.

[0034] FIG. 4 is a control block diagram of a vision correction device according to one embodiment of the disclosure.

[0035] FIG. 5 is a flowchart of a control method of a vision correction device according to one disclosed embodiment.

[0036] Figure 6 is a flowchart for explaining the operation of the image data control unit of the vision correction device.

[0037] FIG. 7, FIG. 8, FIG. 9, FIG. 10 and FIG. 11 are drawings specifically explaining the embodiment of FIG. 6.

[0038] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. However, the technical concept of the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided to ensure that the disclosure is thorough and complete and to sufficiently convey the spirit of the present invention to those skilled in the art.

[0039] In this specification, when a component is referred to as being on another component, it means that it can be formed directly on the other component, or a third component may be interposed between them. Furthermore, in the drawings, shapes and sizes are exaggerated for the purpose of effectively explaining the technical contents.

[0040] Additionally, although terms such as first, second, and third have been used to describe various components in various embodiments of this specification, these components should not be limited by these terms. These terms are only used to distinguish one component from another. Thus, what is referred to as a first component in one embodiment may be referred to as a second component in another embodiment. Each embodiment described and illustrated herein also includes its complementary embodiments. Additionally, the term "and / or" has been used herein to mean including at least one of the components listed before and after.

[0041] In the specification, singular expressions include plural expressions unless the context clearly dictates otherwise. In addition, terms such as "comprise" or "have" are intended to specify the presence of a feature, number, step, component, or combination thereof described in the specification, and should not be construed as excluding the possibility of the presence or addition of one or more other features, numbers, steps, components, or combinations thereof. In addition, in the present specification, "connection" is used to mean both indirectly connecting a plurality of components and directly connecting them.

[0042] In addition, when describing the present invention below, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

[0043] FIG. 1 is a schematic drawing of a vision correction device and an entire system including the same according to one disclosed embodiment.

[0044] Referring to FIG. 1, the vision correction device (1) can communicate with a user terminal (3, 4) and an external server (5) via a communication network (2).

[0045] First, the vision correction device (1) can be provided in the form of AR glasses that are worn by the user and provide AR images. The user can wear the vision correction device (1) like glasses and output AR image data differently for the eye with symptoms, including amblyopia, hyperopia, myopia, or strabismus, and the eye without symptoms. This provides a feeling of use that allows the user to wear the vision correction device (1) for a long period of time without losing interest and to freely carry on with their daily lives even when AR image data is not output.

[0046] The vision correction device (1) receives various augmented reality image data through a communication network (2). The communication network (2) is composed of the vision correction device (1), user terminals (3, 4), and an external server (5) as nodes. Here, the network between nodes refers to a connection structure that allows information exchange between each other, and includes a local area network (LAN), a wide area network (WAN), the Internet (WWW), wired and wireless data communication networks, telephone networks, wired and wireless television communication networks, etc. Examples of wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC), LiFi, etc.

[0047] The user terminal (3,4) refers to a device that can be positioned within close proximity of the vision correction device (1). Specifically, the computer (4) includes, for example, a notebook, desktop, laptop, tablet PC, slate PC, etc. equipped with a WEB browser, and the portable terminal (3) may include, for example, a wireless communication device that ensures portability and mobility, such as a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular), a PHS (Personal Handyphone System), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication)-2000, a CDMA (Code Division Multiple Access)-2000, a W-CDMA (W-Code Division Multiple Access), a WiBro (Wireless Broadband Internet) terminal, a smart phone, etc., and all kinds of handheld-based wireless communication devices, and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted devices (HMDs).

[0048] The server (5) is configured to provide augmented reality image data that can be very diverse and is located domestically or internationally, and can directly download the augmented reality image data to the vision correction device (1) through a communication network (2) or provide the augmented reality image data to the vision correction device (1) through a user terminal (3,4). That is, the server (5) can directly communicate with the vision correction device (1) through the communication network (2) or indirectly provide the augmented reality image data to the user terminal (3,4).

[0049] Meanwhile, the disclosed vision correction device (1) can receive vision data through a communication network (2), unlike a typical augmented reality imaging device. The vision data is data examined by an ophthalmologist, etc., and includes data on amblyopia, hyperopia, myopia, or strabismus. The user terminal (3, 4) can store or temporarily store the vision data received from an ophthalmologist, etc., and then transmit the vision data to the vision correction device (1). The vision correction device (1) can adjust the augmented reality image data to be output based on the received vision data. A detailed description thereof will be provided later with reference to other drawings.

[0050] FIG. 2 is a perspective view of a vision correction device according to one embodiment of the disclosure.

[0051] Referring to FIG. 2, the vision correction device (1) may include a glass frame (11) corresponding to the main body of the vision correction device (1), a head fixing part (12) provided in one area of ​​the glass frame (11) and connected to the head of a user (hereinafter, wearer) to fix the glass frame (11), a display part (110) positioned in front of the glass frame (11) and outputting light toward the optical part (120), a folding part (13) that fixes the display part (110) and allows the display part (110) to move forward or backward, and a support part (14) that allows the glass frame (11) to be fixed to the nose of the wearer.

[0052] Specifically, the glass frame (11) may be formed in a U shape when viewed from above, as illustrated in FIG. 2. The glass frame (11) is sectioned so that its length can be adjusted to fit the size of the wearer's face, and a band may be included at the rear of the glass frame (11) to provide a sense of stability when worn.

[0053] The head fixing member (12) can be provided in an arch shape toward the upper side of the glass frame (11).

[0054] The display unit (110) is located in front of the glass frame (11) and is configured to output augmented reality image data as light. The display unit (110) can be connected to the glass frame (11) through the folding unit (13).

[0055] The optical unit (120) is connected to the display unit (110). The optical unit (120) is positioned in front of the wearer's eyes, and can reflect at least one of the light output from the display unit (110) and various types of light incident from the real world, and transmit the remaining light, thereby allowing both lights to advance to the wearer's eyes. Accordingly, the wearer can perceive the real image that passes through the optical unit (120) even when the image output from the display unit (110) is displayed. In other words, the wearer can obtain the effect of the image displayed by the display unit (110) overlapping with an image corresponding to the real world.

[0056] In addition to the configurations not described in FIG. 2, the disclosed vision correction device (1) may further include various configurations, and is not necessarily limited to the form and shape illustrated in the embodiment of FIG. 2.

[0057] Fig. 3 is a perspective view of the vision correction device according to the embodiment of Fig. 2, viewed from above. Descriptions overlapping with those described in Fig. 2 are omitted.

[0058] Referring to FIG. 3, the vision correction device (1) includes a first optical unit (121) and a first display unit (111) corresponding to the wearer's left eye, and can be divided into a second optical unit (122) and a second display unit (112) corresponding to the wearer's right eye.

[0059] The first optical unit (121) may be composed of a lens formed of a transparent resin material, may have a thickness greater than a certain size, and may be inserted into the first display unit (111) to be electrically and physically connected. That is, the first optical unit (121) may be manufactured in a form that can be attached or detached from the first display unit (111).

[0060] The first optical unit (121) may include a configuration that reflects only light of a specific polarization direction between the lenses, and may reflect or transmit light incident from different directions and direct it toward the wearer's eye. The first optical unit (121) may also include an optical configuration such as an optical beam splitter or a (spherical or aspherical) mirror.

[0061] The first display unit (111) receives power from a power supply (80 in FIG. 4) provided in the glass frame (11) and outputs light. The first display unit (111) is a means for emitting image light converted from augmented reality image data, and may be equipped with, for example, a micro display device (not shown) and a collimator for collimating the image light emitted from the micro display device into parallel light.

[0062] The second optical part (122) and the second display part (112) located in front of the wearer's right eye can also be provided with the same configuration and shape as the first optical part (121) and the first display part (111).

[0063] Meanwhile, the second optical unit (122) and the second display unit (112) can move forward or backward through the second folding unit (13-2). The wearer can adjust the positions of the second optical unit (122) and the second display unit (112) through the second folding unit (13-2) for the convenience of wearing. The positions of the first optical unit (121) and the first display unit (111) can also be adjusted through the first folding unit (13-1).

[0064] FIG. 4 is a control block diagram of a vision correction device according to one embodiment of the disclosure.

[0065] Referring to FIG. 4, a vision correction device (1) according to one disclosed embodiment includes an input unit (60) for receiving an input command from a wearer, a communication unit (70) for receiving augmented reality image data and vision data from a communication network (2), a power unit (80) for supplying power to each component of the vision correction device (1), a storage unit (90) for storing augmented reality image data and vision data received by the communication unit (70), a control unit (100) for controlling each component of the vision correction device (1), and a display unit (110) for outputting augmented reality image data adjusted through the control unit (100) as light.

[0066] Specifically, the input unit (60) may include hardware devices such as various buttons, switches, trackballs, various levers, handles, or sticks for input from the wearer. In addition, the input unit (60) may include a GUI (Graphical User Interface), i.e., a software device such as a touch pad, to receive input commands transmitted by the wearer.

[0067] The communication unit (70) may include one or more components that enable communication with a user terminal (3,4) or a server (5), and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

[0068] The short-range communication module may include various short-range communication modules that transmit and receive signals using a wireless communication network at a short distance, such as a Bluetooth module, an infrared communication module, an RFID (Radio Frequency Identification) communication module, a WLAN (Wireless Local Access Network) communication module, an NFC communication module, and a Zigbee communication module.

[0069] The wired communication module may include various wired communication modules such as a Local Area Network (LAN) module, a Wide Area Network (WAN) module, or a Value Added Network (VAN) module, as well as various cable communication modules such as a Universal Serial Bus (USB), a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), RS-232 (recommended standard 232), power line communication, or plain old telephone service (POTS).

[0070] The wireless communication module may include a wireless communication module that supports various wireless communication methods such as GSM (global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), UMTS (universal mobile telecommunications system), TDMA (Time Division Multiple Access), and LTE (Long Term Evolution), in addition to a WiFi module and a WiBro (Wireless broadband) module.

[0071] The power supply unit (80) is a component that supplies electric energy to the vision correction device (1), and is a component that converts the input voltage of an external power source into an output voltage required for the operation of each component, prevents excessive current from flowing, and performs current control for stable operation of each component under the control of the control unit (100). The power supply unit (80) may further include a hardware module that can accommodate a battery or dry cell to enable a wearable function.

[0072] The storage unit (90) may be implemented as at least one of non-volatile memory devices such as cache, ROM (Read Only Memory), PROM (Programmable ROM), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and flash memory, or volatile memory devices such as RAM (Random Access Memory), or storage media such as a hard disk drive (HDD) or CD-ROM, but is not limited thereto. The storage unit (90) may be a memory implemented as a separate chip from the processor described above in relation to the control unit (100), or may be implemented as a single chip with the processor.

[0073] The control unit (100) may be implemented as a memory (not shown) that stores data regarding an algorithm for controlling the operation of components within the vision correction device (1) or a program that reproduces the algorithm, and a processor (not shown) that performs the aforementioned operation using the data stored in the memory. In this case, the memory and the processor may be implemented as separate chips. Alternatively, the memory and the processor may be implemented as a single chip.

[0074] A processor may refer to a data processing device embedded in hardware that has a physically structured circuit to perform functions expressed in code or instructions included in a program. Examples of such data processing devices embedded in hardware may include, but are not limited to, processing devices such as a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), and a graphics processing unit (GPU). A processor may include one or more processors.

[0075] In the disclosed embodiment, the control unit (100) can be divided into two modules in software.

[0076] The image data processing unit (101) performs general image processing of augmented reality image data received through the communication unit (70). Additionally, the image data processing unit (101) is capable of processing various augmented reality image data based on marker tracking, real-time object recognition and object tracking, safe area search (Simultaneous Localization and Mapping, SLAM), and eye tracking that measures eye movement.

[0077] Specifically, marker tracking is a function in which a vision correction device detects predefined markers (specific patterns or images) in real time and displays virtual content related to the markers in the user's field of vision, thereby enabling the insertion of virtual objects included in augmented reality image data related to the location where the wearer recognizes the marker. The image data processing unit (101) identifies the location where the marker is recognized and outputs augmented reality image data corresponding to the location.

[0078] Real-time object recognition and object tracking is a function in which, when a camera (not shown) provided in or around the vision correction device (1) captures a picture of the real world, the vision correction device (1) identifies an object or objects in the camera image and adds a virtual object or information in the augmented reality image data corresponding to the identified object or object to the screen. The image data processing unit (101) can select augmented reality image data corresponding to the recognized object based on the camera image and adjust the output position.

[0079] Safe Area Navigation (SLAM) is a technology that recognizes a user's location and surrounding environment and accurately places virtual objects based on that information. The image data processing unit (101) adjusts the augmented reality image data determined using the safe area navigation technology.

[0080] Eye tracking is a technology that measures eye movements using a sensor (not shown) attached to a glass frame (11) while the wearer is viewing an image output by a display unit (110). The image data processing unit (101) determines the wearer's gaze angle through eye movements detected based on the measured values ​​of the sensor, and adjusts and processes augmented reality image data accordingly.

[0081] When the image data processing unit (101) performs general image processing to output an augmented reality image, the image data control unit (102) can process the image-processed augmented reality image data once more based on the vision data received from the communication unit (70).

[0082] Here, the visual acuity data includes data related to the wearer's amblyopia, hyperopia, myopia, and strabismus. The visual acuity data includes data on diopters, corrected visual acuity, and prism diopters for the wearer's left or right eye, and the image data control unit (102) adjusts the depth perception distance and blur radius of the augmented reality image data based on each reference value included in the visual acuity data.

[0083] The image data control unit (102) individually adjusts the depth perception distance and blur radius according to the state of the wearer's two eyes included in the vision data. For example, if the overall vision of a wearer with myopia is diopter +1, the image data control unit (102) can control the display unit (110) to output augmented reality image data at a depth perception distance of 0.5 to 1 m. As another example, if the diopter is +5, the image data control unit (102) can control the display unit (110) to output augmented reality image data at a depth perception distance of 0.1 to 0.3 m.

[0084] A specific embodiment of the image processing controlled by the image data control unit (102) will be described later through other drawings.

[0085] Meanwhile, the control unit (100) can measure the angle of strabismus through the eye tracking of the wearer who views the image output by the display unit (110). For example, the vision correction device (1) outputs a black image to either the first optical unit (121) or the second optical unit (111) while the display unit (110) outputs augmented reality image data. The vision correction device (1) measures the distance of movement of the eye by comparing the position before outputting the black image, i.e., before the eye moves, with the position to which the eye has moved after outputting the black image, and can also measure the angle of strabismus using the distance of movement of the eye.

[0086] The display unit (110) outputs augmented reality image data processed by the control unit (100). As described above with reference to FIGS. 2 and 3, the display unit (110) emits light to output augmented reality image data to the optical unit (120), and the optical unit (120) reflects the light output by the display unit (110) and emits it into the wearer's pupil.

[0087] In addition to the configuration illustrated in FIG. 4, the disclosed vision correction device (1) may further include various configurations. For example, the vision correction device (1) may further include various configurations necessary for the operation of the augmented reality user interface, such as a speaker (not shown) that outputs voice data included in the augmented reality image data received through the communication unit (70).

[0088] FIG. 5 is a flowchart of a control method of a vision correction device according to one disclosed embodiment.

[0089] Referring to Fig. 5, the vision correction device (1) receives vision data and image data from the outside (130).

[0090] Here, the external means a user terminal (3, 4) or a server (5), and vision data is received through a communication unit (70) and stored or temporarily stored in a storage unit (90). The image data is the augmented reality image data described above in FIG. 4, etc., and is output through the following image processing after being received.

[0091] The vision correction device (1) performs image processing of augmented reality image data (131).

[0092] The image processing performed in step 131 refers to various image processing used in general augmented reality devices, and can be performed through the image data processing unit (101) of the control unit (100).

[0093] The vision correction device (1) distinguishes each display unit (110) based on vision data (132).

[0094] As described above in FIG. 3, the vision correction device (1) outputs differentiated augmented reality image data for the user's left or right eye based on the vision data. Accordingly, the vision correction device (1), specifically the image data control unit (102), differentiates the augmented reality image data to be output by the first display unit (111) and the second display unit (112) based on the vision data.

[0095] When each display unit (110) to be output is distinguished, the vision correction device (1) adjusts the augmented reality image data processed based on the vision data once again (133) and outputs the adjusted image data (134).

[0096] If the left and right eyes do not have symptoms such as amblyopia, myopia, or strabismus, the image data control unit (102) can control the first display unit (111) and the second display unit (112) so that the image processing performed by the image data processing unit (110) is output as is. However, if even one eye has symptoms such as amblyopia based on the visual acuity data, the image data control unit (102) adjusts the depth perception distance or blur radius.

[0097] When the image data control unit (102) adjusts the depth recognition distance of the augmented reality image data, the augmented reality image data output for the other eye may not be output as is. However, the image data control unit (102) may also adjust the augmented reality image data together so that the overall augmented reality image data perceived by the wearer is not awkward. In other words, the vision correction device (1) can perform vision correction by controlling the light emitted to the symptomatic eye while ensuring that the augmented reality image data perceived by the wearer through both eyes is not awkward.

[0098] Fig. 6 is a flowchart for explaining the operation of the image data control unit of the vision correction device. Figs. 7, 8, 9, 10, and 11 are drawings for specifically explaining the embodiment of Fig. 6.

[0099] Referring first to FIG. 6, the disclosed vision correction device (1) analyzes vision data (200).

[0100] The vision data may include data on hyperopia, myopia, amblyopia, and strabismus for each eye, distinguishing between the left and right eyes. The vision correction device (1) reads the symptoms of each eye included in the vision data, distinguishes between the first display unit (111) and the second display unit (112), and determines whether to perform image processing.

[0101] For convenience of explanation, the following example will not distinguish between the two eyes, but will describe cases where each symptom occurs in one eye.

[0102] If the wearer has farsightedness (Yes of 210), the vision correction device (1) compares the diopters included in the vision data (211).

[0103] Here, diopter is a unit that indicates the refractive power of a lens, and is the reciprocal of the focal length (unit: meters). In other words, the shorter the focal length, the stronger the refractive power. Both hyperopia and myopia are expressed in diopters, with myopia indicated by a (-) and hyperopia by a (+).

[0104] Based on the comparison result, the vision correction device (1) determines how much to adjust the depth recognition distance of the augmented reality image data, and then adjusts the depth recognition distance of the augmented reality image data (212).

[0105] Here, the depth perception distance refers to the location at which augmented reality image data is recognized on the wearer's image. If the vision correction device (1) determines that the wearer has farsightedness, it adjusts the display unit (110) so that augmented reality image data is output at a short distance from the wearer, thereby stimulating the wearer's eyes so that the wearer can continuously recognize objects at a close distance.

[0106] Referring to Fig. 7, the vision correction device (1) can adjust the depth perception distance by distinguishing between mild hyperopia, moderate hyperopia, and high hyperopia.

[0107] Specifically, the vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.5 to 1 m after determining a diopter between +1 and +2 as mild hyperopia. In addition, the vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.3 to 0.5 m after determining a diopter between +2 and +5 as moderate hyperopia. The vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.1 to 0.3 m after determining a diopter between +5 and +8 as high hyperopia.

[0108] The vision correction device (1) disclosed through this can alleviate hyperopia symptoms by outputting augmented reality image data while adjusting the depth recognition distance according to the wearer's vision data.

[0109] Referring again to FIG. 6, augmented reality image data with adjusted depth recognition distance is output (213) through the display unit (110).

[0110] If the wearer has myopia (Yes of 220), the vision correction device (1) compares the diopters included in the vision data (221).

[0111] Based on the comparison result, the vision correction device (1) determines how much to adjust the depth recognition distance of the augmented reality image data, and then adjusts the depth recognition distance of the augmented reality image data (222).

[0112] Referring to Fig. 8, the vision correction device (1) can adjust the depth perception distance by distinguishing between mild myopia, moderate myopia, high myopia, and ultra-high myopia.

[0113] Specifically, the vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.11 to 0.2 m after determining a diopter between -1 and -3 as mild myopia. In addition, the vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.2 to 0.33 m after determining a diopter between -3 and -5 as moderate myopia. The vision correction device (1) can control the display unit (110) to output augmented reality image data at 0.33 to 1.0 m after determining a diopter between -5 and -9 as high myopia. The vision correction device (1) can control the display unit (110) to output augmented reality image data at 1.5 m after determining a diopter of -10 or more as ultra-high myopia.

[0114] The vision correction device (1) disclosed through this can treat myopia symptoms by outputting augmented reality image data while adjusting the depth recognition distance according to the wearer's vision data.

[0115] Referring again to FIG. 6, augmented reality image data with adjusted depth recognition distance is output through the display unit (110) (223).

[0116] If the wearer has amblyopia (Yes of 230), the vision correction device (1) compares the corrected vision included in the vision data (231).

[0117] Here, corrected visual acuity is the visual acuity obtained by correcting an eye with a refractive index higher than a certain level using a lens or other device, and is determined by an ophthalmologist, etc., and is data included in the visual acuity data.

[0118] Based on the comparison result, the vision correction device (1) determines how much to adjust the blur radius of the augmented reality image data, and then adjusts the blur radius of the augmented reality image data (232).

[0119] Here, blur radius refers to the radius value of Gaussian blur, which reduces image noise by applying a Gaussian function or its truncated approximation to convolution in image processing. In other words, blur radius indicates the degree of blurring of an image as the number of pixels to which blur is applied increases.

[0120] Referring to Fig. 9, the vision correction device (1) can adjust the blur radius by distinguishing between mild amblyopia, moderate amblyopia, and severe amblyopia.

[0121] Specifically, the vision correction device (1) can control the display unit (110) to output an augmented reality image data as an augmented reality image with a blur radius of 5 to 20 after determining that corrected visual acuity of 0.6 or more is mild amblyopia. In addition, the vision correction device (1) can control the display unit (110) to output an augmented reality image data as an augmented reality image with a blur radius of 30 to 40 after determining that corrected visual acuity of between 0.3 and 0.5 is moderate amblyopia. The vision correction device (1) can control the display unit (110) to output an augmented reality image data as an augmented reality image with a blur radius of 40 or more after determining that corrected visual acuity of less than 0.2 is severe amblyopia.

[0122] Meanwhile, the vision correction device (1) outputs augmented reality image data with adjusted blur radius to the normal eye rather than outputting augmented reality image data with adjusted blur radius to the amblyopic eye that requires corrected vision, thereby inducing the amblyopic eye to continue using its vision. In other words, unlike hyperopia and myopia, the vision correction device (1) adjusts the augmented reality image data to the normal eye, not the amblyopic eye.

[0123] Referring to FIG. 10, four images illustrate augmented reality image data with adjusted blur radii. FIG. 10 a) is an image with a blur radius of 5, FIG. 10 b) is an image with a blur radius of 20, FIG. 10 c) is an image with a blur radius of 30, and FIG. 10 d) is an image with a blur radius of 55.

[0124] If the wearer's vision data shows moderate amblyopia in the left eye and corrected vision is 0.3, the vision correction device (1) controls the second display unit (112) corresponding to the right eye to output an image having a blur radius of 30, such as c) of FIG. 10.

[0125] Referring again to FIG. 6, augmented reality image data with adjusted blur radius is output through the display unit (110) (233).

[0126] If the wearer has strabismus (Yes of 240), the vision correction device (1) compares the prism diopter included in the vision data (241).

[0127] Here, the prism diopter represents the prism power required to deflect light emitted from a distance of 1 meter by 1 cm, but it is also a unit used to indicate how much the pupil is misaligned in strabismus.

[0128] Based on the comparison result, the vision correction device (1) determines how much to adjust the blur radius of the augmented reality image data, and then adjusts the blur radius of the augmented reality image data (242).

[0129] Referring to Fig. 11, the vision correction device (1) can adjust the blur radius by distinguishing between mild strabismus, moderate strabismus, and severe strabismus.

[0130] Specifically, the vision correction device (1) can control the display unit (110) to output an augmented reality image data having a blur radius of 5 to 20 after determining a prism diopter of 10 to less than 25 as mild strabismus. In addition, the vision correction device (1) can control the display unit (110) to output an augmented reality image data having a blur radius of 30 to 40 after determining a prism diopter of between 25 and 50 as moderate strabismus. The vision correction device (1) can control the display unit (110) to output an augmented reality image data having a blur radius of 40 or more after determining a prism diopter of 50 or more as severe strabismus.

[0131] Meanwhile, the vision correction device (1) does not output augmented reality image data with adjusted blur radius to a strabismic eye requiring corrected vision, but outputs augmented reality image data with adjusted blur radius to a normal eye, thereby inducing continued use of vision in the strabismic eye. In other words, the vision correction device (1) adjusts augmented reality image data for the normal eye, not the strabismic eye, as in the case of an amblyopic eye.

[0132] Referring again to FIG. 6, augmented reality image data with adjusted blur radius is output through the display unit (110) (243).

[0133] The vision correction device (1) disclosed herein can treat amblyopia or strabismus by providing a clear augmented reality image to the amblyopic eye (or strabismus) while simultaneously blocking the field of vision or providing a blurred image to the normal eye by adjusting different augmented reality image data for each symptom based on the vision data. In addition, the vision correction device and its control method can suppress myopia or hyperopia and slow down the rate of progression by optically adjusting the viewing distance of the augmented reality image.

[0134] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions or data on a communication network. The instructions may be stored or downloaded in the form of program code, and when executed by a processor, generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

[0135] Computer-readable storage media include all types of storage media that store instructions that can be deciphered by a computer. Examples include read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disks, flash memory, and optical data storage devices.

[0136] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. Glass frame; A display unit connected to the above glass frame and outputting light corresponding to an augmented reality image; An optical unit connected to the display unit and positioned in front of the wearer's eyes, which reflects one of the light output from the display unit and the light incident from the real world and passes the other, thereby directing both lights to the wearer's eyes; A communication unit that receives augmented reality image data and vision data from the outside; and A vision correction device comprising a control unit that controls the display unit to adjust the augmented reality image data based on the vision data and output the adjusted augmented reality image data.

2. In paragraph 1, The above control unit, A vision correction device that adjusts the depth perception distance of the augmented reality image data based on the size of the diopter included in the above vision data.

3. In paragraph 2, The above control unit, A vision correction device that distinguishes between myopia and hyperopia data included in the above vision data and, based on the size of the diopter, adjusts the depth perception distance of the augmented reality image data differently depending on myopia and hyperopia.

4. In paragraph 1, The above control unit, A vision correction device that adjusts the size of the blur radius of the augmented reality image data based on the size of the corrected vision including the above vision data.

5. In paragraph 1, The above control unit, A vision correction device that adjusts the size of the blur radius of the augmented reality image data based on the size of the prism diopter included in the above vision data.

6. In paragraph 1, The above display unit, It includes a first display unit corresponding to the left eye of the wearer and a second display unit corresponding to the right eye of the wearer, A first folding part that connects the first display part and the glass frame and moves the first display part forward or backward of the wearer's left eye; and A vision correction device further comprising a second folding part that connects the second display part and the glass frame and moves the second display part forward or backward of the wearer's right eye.

7. In paragraph 6, The above control unit, A vision correction device that distinguishes left eye vision data and right eye vision data included in the above vision data, and independently controls the first display unit and the second display unit based on the distinguished vision data.

8. A method for controlling a vision correction device including a glass frame, a display unit connected to the glass frame, and an optical unit connected to the display unit, Receive augmented reality image data and vision data from outside; Performing image processing of the above augmented reality image data; Adjusting the depth perception distance or blur radius of the image-processed augmented reality image data based on the above vision data; A control method for a vision correction device, comprising: controlling the display unit to output the adjusted augmented reality image data.

9. In paragraph 8, The above adjustment is, A control method of a vision correction device, comprising: adjusting the depth perception distance based on the size of the diopter of myopia included in the above vision data.

10. In paragraph 8, The above adjustment is, A control method of a vision correction device, comprising: adjusting the depth perception distance based on the size of the diopter of the original included in the vision data.

11. In paragraph 8, The above adjustment is, A control method of a vision correction device, comprising: adjusting the blur radius based on the size of the corrected vision of amblyopia included in the above vision data.

12. In paragraph 8, The above adjustment is, A control method of a vision correction device, comprising: adjusting the blur radius based on the size of the prism diopter of strabismus included in the above vision data.

13. In paragraph 8, The display unit includes a first display unit corresponding to the wearer's left eye and a second display unit corresponding to the wearer's right eye, The above control is, A control method for a vision correction device, comprising: independently controlling the first display unit and the second display unit based on the adjusted augmented reality image data.

14. Receive augmented reality image data and vision data from external sources; Performing image processing of the above augmented reality image data; Adjusting the depth perception distance or blur radius of the image-processed augmented reality image data based on the above vision data; and A computer-readable recording medium having recorded thereon a program capable of executing a control method of a vision correction device, including controlling a display unit to output the adjusted augmented reality image data.

Images