Apparatus and method for providing stereopsis training
The apparatus and method for stereoscopic vision training address the visual confusion in strabismus by using a display module and control module to adjust training images based on strabismus angles, enhancing both static and dynamic stereoscopic vision abilities in children with strabismus.
Patent Information
- Application Number
- PCT/KR2024/007113
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-26
- Filing Date
- 2024-05-24
- Publication Date
- 2024-12-05
AI Technical Summary
Children with strabismus, a condition where the eyes are not aligned properly, often experience visual confusion and amblyopia due to different images being transmitted to the brain, leading to impaired binocular vision and three-dimensional perception, necessitating effective stereoscopic vision training to correct this issue.
An apparatus and method utilizing a display module, reference images, and a control module to provide stereoscopic vision training by outputting training images with varying three-dimensional effects based on measured strabismus angles, allowing for both static and dynamic training sessions to enhance visual perception.
The solution effectively increases the effectiveness of stereoscopic vision training by accurately reflecting the strabismus angle, improving both static and dynamic stereoscopic vision abilities in trainees, even if their eyes are uncorrected, and providing a comprehensive training experience.
Smart Images

Figure KR2024007113_05122024_PF_FP_ABST
Abstract
Description
Device and method for providing stereoscopic vision training
[0001] The present disclosure relates to a device and method for providing stereopsis training. More specifically, the present disclosure relates to a device and method for providing stereopsis training for a strabismus patient.
[0002] Due to recent advancements in media, the incidence of myopia, astigmatism, and strabismus is on the rise. Among these, strabismus refers to a condition in which the eyes are not aligned properly. If left untreated, vision may be permanently impaired, so early detection and correction in childhood are crucial.
[0003] If strabismus develops between the ages of 2 and 5, the child's two eyes will each see different objects, resulting in two completely different images being transmitted to the brain, causing visual confusion, where completely different objects appear to overlap. Furthermore, because they experience diplopia, where images appear to be in two different places simultaneously, the child will ignore the images coming from one side to alleviate the visual confusion and double vision. Consequently, the child will lose the ability to perceive objects in three dimensions through binocular vision, and may even lose the use of the strabismus eye, leading to amblyopia.
[0004] Therefore, there is a need to develop a technology that provides and controls stereoscopic vision training to improve the visual perception ability, including stereoscopic perception, of users (trainees).
[0005] The purpose of the embodiments disclosed in the present disclosure is to provide a device and method for providing stereoscopic vision training.
[0006] The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.
[0007] A stereoscopic training providing device according to the present disclosure for achieving the above-described technical problem may include a display module, a first reference image, a second reference image, a plurality of training images, a memory including stereoscopic information, an input module for receiving a trainee's response, and a control module for performing a stereoscopic training operation of outputting the first reference image to a first area of the display module, outputting the second reference image to a second area of the display module, setting training coordinates based on coordinate change signals for the first reference image and the second reference image, outputting the plurality of training images having different stereoscopic effects based on the training coordinates to the display module, and receiving a selection response for a training image having high stereoscopic effect.
[0008] In addition, a method for providing stereoscopic vision training according to the present disclosure may include a step of outputting a first reference image to a first area of a display module and outputting a second reference image to a second area of the display module, a step of setting training coordinates based on coordinate change signals for the first reference image and the second reference image, a step of outputting a plurality of training images with different stereoscopic effects to the display module based on the training coordinates, and a step of performing a stereoscopic vision training operation of receiving a selection response for a training image with high stereoscopic effects.
[0009] According to the stereoscopic training device of the present disclosure, by performing a training coordinate setting operation through strabismus measurement in advance, the degree of strabismus according to the trainee's condition at the time of training is accurately reflected, thereby providing an effect of increasing the effectiveness of stereoscopic training.
[0010] In addition, according to the stereoscopic training device of the present disclosure, it provides not only static stereoscopic training but also dynamic stereoscopic training, thereby providing the effect of increasing the effectiveness of stereoscopic training for the trainee.
[0011] FIG. 1 is a block diagram showing a stereoscopic vision training providing device according to an embodiment of the present disclosure.
[0012] FIG. 2 is a diagram for explaining a training coordinate setting operation through angle measurement according to an embodiment of the present disclosure.
[0013] FIG. 3 is a diagram showing the types of trainees when measuring the angle of incidence according to an embodiment of the present disclosure.
[0014] FIG. 4 is a diagram showing a first training of a stereoscopic vision training motion according to one embodiment of the present disclosure.
[0015] FIG. 5 is a diagram showing a second training of a stereoscopic vision training motion according to one embodiment of the present disclosure.
[0016] FIG. 6 is a diagram showing a third training of a stereoscopic training motion according to one embodiment of the present disclosure.
[0017] FIG. 7 is a diagram showing the fourth training of a stereoscopic training motion according to one embodiment of the present disclosure.
[0018] FIG. 8 is a diagram illustrating training images according to one embodiment of the present disclosure.
[0019] FIG. 9 is a table showing the stereoscopic view of training images according to the difficulty of the first and fourth trainings according to one embodiment of the present disclosure.
[0020] FIG. 10 is a table showing the stereoscopic view of training images according to the difficulty of the second training according to one embodiment of the present disclosure.
[0021] FIG. 11 is a table showing the stereoscopic view of training images according to the difficulty level of the third training according to one embodiment of the present disclosure.
[0022] FIG. 12 is a diagram showing training coordinates according to one embodiment of the present disclosure.
[0023] FIG. 13 is a diagram showing training coordinates according to difficulty and stereoscopic view according to one embodiment of the present disclosure.
[0024] FIG. 14 is a flowchart illustrating a method for providing stereoscopic vision training according to one embodiment of the present disclosure.
[0025] Figure 15 is a flowchart showing a training coordinate setting method of the present disclosure.
[0026] Throughout this disclosure, the same reference numerals denote the same components. This disclosure does not describe all elements of the embodiments, and any content that is common in the technical field to which this disclosure pertains or that overlaps between embodiments is omitted. The terms "part, module, element, block" used in the specification may be implemented in software or hardware, and depending on the embodiments, multiple "parts, modules, elements, blocks" may be implemented as a single component, or a single "part, module, element, block" may include multiple components.
[0027] Throughout the specification, when a part is said to be "connected" to another part, this includes not only direct connection but also indirect connection, and indirect connection includes connection via a wireless communication network.
[0028] Additionally, when a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise specifically stated.
[0029] Throughout the specification, when we say that an element is "on" another element, this includes not only cases where the element is in contact with the other element, but also cases where another element exists between the two elements.
[0030] The terms first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.
[0031] Singular expressions include plural expressions unless the context clearly indicates otherwise.
[0032] The identification codes for each step are used for convenience of explanation and do not describe the order of each step. Each step may be performed in a different order than specified unless the context clearly indicates a specific order.
[0033] The operating principle and embodiments of the present disclosure are described below with reference to the attached drawings.
[0034] As used herein, the term "device according to the present disclosure" encompasses a variety of devices capable of performing computational processing and providing results to a user. For example, the device according to the present disclosure may include a computer, a server device, and a portable terminal, or may be any one of them.
[0035] Here, the computer may include, for example, a notebook, desktop, laptop, tablet PC, slate PC, etc. equipped with a web browser.
[0036] The above server device is a server that processes information by communicating with an external device, and may include an application server, a computing server, a database server, a file server, a game server, a mail server, a proxy server, and a web server.
[0037] The above portable terminal may include, for example, a wireless communication device that ensures portability and mobility, and may include all kinds of handheld-based wireless communication devices such as a PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, a smart phone, and a wearable device such as a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD).
[0038] The artificial intelligence-related functions according to the present disclosure are operated via a processor and memory. The processor may be comprised of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, an AP, a Digital Signal Processor (DSP), a graphics-only processor such as a GPU or a Vision Processing Unit (VPU), or an artificial intelligence-only processor such as an NPU. One or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0039] FIG. 1 is a block diagram of a stereoscopic training providing device according to an embodiment of the present disclosure. Referring to FIG. 1, the stereoscopic training providing device (100) may include a communication module (110), an input module (130), a display module (150), a memory (170), and a control module (190). The components illustrated in FIG. 1 are not essential for implementing the stereoscopic training providing device (100) according to the present disclosure, and thus the stereoscopic training providing device (100) described in this specification may have more or fewer components than the components listed above.
[0040] The stereoscopic vision training device (100) according to an embodiment of the present invention may include various devices capable of performing computational processing. For example, the stereoscopic vision training device (100) may include a desktop PC, a mobile phone, a smart phone, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a slate PC, a tablet PC, an ultrabook, a wearable device, and the like.
[0041] Meanwhile, the stereoscopic training device (100) may include a display device such as a mobile phone that can be mounted on a head-mounted device such as an HMD (Head Mounted Display) that is mounted on the head of the trainee and displays an image, smart glasses, smart goggles, etc.
[0042] The communication module (110) performs wired or wireless communication with at least one external device (server, etc.). In particular, when performing wireless communication, it transmits and receives wireless signals in a communication network according to wireless Internet technologies.
[0043] Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution-Advanced), and the stereoscopic training providing device (100) transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.
[0044] The communication module (110) is for short range communication and can support short range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. In this case, the short range wireless communication network may be a short range wireless personal area network.
[0045] The input module (130) can obtain signals corresponding to the trainee's input. For example, the input module (130) can obtain inputs from the trainee for performing astigmatism measurement or stereopsis training, responses to astigmatism measurement movements and stereopsis training movements provided through the display module (150), etc.
[0046] At this time, the input module (130) may include a keyboard, a key pad, buttons, a jog shuttle, a wheel, etc. In addition, the trainee's input in the input module (130) may be, for example, pressing a button, touching, and dragging.
[0047] The input module (130) may be configured as a separate module that is connected wirelessly or wiredly to the stereoscopic training device (100). For example, the stereoscopic training device (100) may provide the trainee with images for measuring astigmatism or performing stereoscopic training through a display module (150) mounted and attached to the trainee's head, and may receive responses from the trainee through the input module (130) configured as a separate module provided to the trainee's hand.
[0048] The display module (150) outputs images or video. For example, the display module (150) may include an LCD, OLED, AMOLED display, etc. In one embodiment, when the display module (150) is implemented as a touch screen, the display module (150) may also function as an input module (130). In this case, depending on the selection, a separate input module (130) may not be provided, or an input module (130) that performs limited functions such as volume control, a power button, and a home button may be provided. In addition, the display module (150) may also be provided in the form of an image output port that transmits image information to an external display device.
[0049] The display module (150) may include a plurality of first displays and second displays, each corresponding to the trainee's eyes (left and right eyes). Here, the first display may output a first image, and the second display may output a second image.
[0050] Meanwhile, the present disclosure is not limited thereto, and the display module (150) may be implemented as a single display. In this case, the display module (150) may output a first image to the left area of the display and a second image to the right area of the display.
[0051] The memory (170) stores at least one data (information) and at least one process necessary for providing a stereoscopic vision training method, as well as various data (information). For example, the memory (170) may store a program for performing training, at least one piece of trainee information (personal information, visual information, response information, training results, etc.), various reference values that serve as criteria for measuring astigmatism, measurement images, training images, etc. as data. In addition, the memory (170) may store various commands, algorithms, etc. for executing a stereoscopic vision training method.
[0052] In addition, the memory (170) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. In addition, the memory (170) may store information temporarily, permanently, or semi-permanently, and may be provided as a built-in or removable type.
[0053] The control module (190) is for controlling the configurations within the stereoscopic training device (100) or processing and calculating various information, and controls the stereoscopic training operation to be performed based on at least one process stored in the memory (170).
[0054] The control module (190) may perform a training coordinate setting operation by measuring the trainee's angle of astigmatism before performing the stereoscopic vision training operation. Specifically, the control module (190) may output a first reference image to an area corresponding to the left eye through the display module (150) and output a second reference image to an area corresponding to the right eye. At this time, when the first reference image and the second reference image are viewed together based on the normal eye, the first reference image and the second reference image may be output so that a specific shape (e.g., a square, a heart, etc.) is visible. On the other hand, when the first reference image and the second reference image are viewed together based on the astigmatism, a left-right gap may exist and the above-mentioned specific shape may not be visible. In this case, the trainee may input a coordinate change signal to complete the specific shape by moving the first reference image or the second reference image in the left-right direction through the input module (130). The control module (190) can calculate whether the trainee's strabismus is in the left or right eye and the degree of strabismus based on the input coordinate change signal. Furthermore, the control module (190) can set training coordinates based on the calculated strabismus angle. For example, the control module (190) can set training coordinates so that an image for stereoscopic vision training is output to the display module (150) corresponding to the visual angles of the trainee's normal eye and / or strabismus, respectively, using the calculated strabismus angle.
[0055] And the control module (190) can perform a stereoscopic training operation based on the set training coordinates. For example, the control module (190) can perform a static stereoscopic training operation and a dynamic stereoscopic training operation. The static stereoscopic training operation is a training operation in which the trainee sequentially selects an image that appears to be more protruding forward among a plurality of stationary training images. In addition, the dynamic stereoscopic training operation is a training operation in which the trainee selects one image that appears to be more protruding forward among a plurality of moving training images.
[0056] The control module (190) may be implemented in software, hardware, or a combination thereof. For example, in terms of hardware, the control module (190) may be implemented in terms of FPGA (field programmable gate array), ASIC (Application Specific Integrated Circuit), semiconductor chips, or other various forms of electronic circuits. In addition, for example, in terms of software, the control module (190) may be implemented in terms of logic programs executed according to the above-described hardware, various computer languages, etc.
[0057] Unless otherwise stated in the following description, the operation of the stereoscopic training device (100) can be understood to be performed under the control of the control module (190).
[0058] In this way, the stereoscopic vision training device (100) according to the present disclosure can increase the effectiveness of stereoscopic vision training by accurately reflecting the degree of strabismus according to the trainee's condition at the time of training by performing a training coordinate setting operation through strabismus measurement in advance.
[0059] In addition, the stereoscopic training device (100) according to the present disclosure can increase the effectiveness of stereoscopic training for a trainee by providing not only static stereoscopic training but also dynamic stereoscopic training.
[0060] Meanwhile, the stereoscopic training providing device (100) may be implemented to perform the training coordinate setting operation and the stereoscopic training operation through an external device, depending on the embodiment. For example, if the stereoscopic training providing device (100) is implemented as a server, the stereoscopic training providing device (100) may communicate with the external device through the communication module (110) to perform the training coordinate setting operation and the stereoscopic training operation. In this case, the operation using the input module (130) and the display module (150) of the stereoscopic training providing device (100) described in the present specification may be replaced with an operation using the display module and the input module of the external device through the communication module (110).
[0061] FIG. 2 is a diagram illustrating a training coordinate setting operation through angle measurement according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating the types of trainees for angle measurement according to an embodiment of the present disclosure.
[0062] Referring to FIG. 2, the display module (150) may include a first display (151) and a second display (152). In the present disclosure, the first display (151) and the second display (152) may be implemented as multiple physically separated displays, or may be implemented as a concept of areas divided into a left area and a right area within a single display.
[0063] In one embodiment, the first display (151) may output a first reference image (210) corresponding to the left eye, and the second display (152) may output a second reference image (220) corresponding to the right eye. The first reference image (210) and the second reference image (220) may be different images. For example, referring to FIG. 2, the first reference image (210) is a 'ㄷ' shaped image, and the second reference image (220) is a 'ㅓ' shaped image.
[0064] And the first reference image (210) and the second reference image (220) can be output so that when a trainee with normal eyes looks at them, the first reference image (210) and the second reference image (220) appear to form a specific shape together. For example, referring to FIG. 3, when a trainee with normal eyes looks at them, the first reference image (210) and the second reference image (220) can be output so that they appear as a square formed by combining 'ㄷ' and 'ㅓ'. This specific shape is hereinafter referred to as a reference shape.
[0065] Meanwhile, when a trainee with strabismus looks at the first reference image (210) and the second reference image (220), they will appear differently from the above. For example, referring to FIG. 3, a trainee with strabismus will see the first reference image (210) or the second reference image (220) as being further to the left or right, and will not see the letters 'ㄷ' and 'ㅓ' as a combined square.
[0066] Accordingly, the stereoscopic training providing device (100) can request the trainee to move the first reference image (210) or the second reference image (220) left and right through the display module (150) so that the first reference image (210) or the second reference image (220) have a reference shape. In addition, the stereoscopic training providing device (100) can receive a coordinate change signal for moving the first reference image (210) or the second reference image (220) left and right from the trainee through the input module (130). In addition, when a signal indicating that the coordinate change has been completed is additionally received from the trainee, the training coordinates can be set based on the position of the first reference image (210) or the second reference image (220).
[0067] Specifically, the stereoscopic training providing device (100) can calculate a boundary area including a first reference image (210) and a second reference image (220), and calculate the center coordinates of the boundary area. At this time, the boundary area includes the first reference image (210) and the second reference image (220), and is a shape such as a square or a circle with a minimum size. At this time, the reference origin is the center coordinates of the boundary areas of the first reference image (210) and the second reference image (220) that have not moved in the left and right direction. That is, the origin is the center coordinates of the boundary areas when looking at the first reference image (210) and the second reference image (220) based on a normal eye. The stereoscopic training providing device (100) can set training coordinates based on the calculated center coordinates. And the stereoscopic training providing device (100) can perform a stereoscopic training operation based on the set training coordinates.
[0068] In one embodiment, the stereoscopic training device (100) may perform the aforementioned operation multiple times to achieve high accuracy. That is, the device may output the first reference image (210) and the second reference image (220) to the trainee, receive a coordinate change signal, and perform the operation of calculating the center coordinates of the boundary area multiple times (e.g., three times), and set the training coordinates using the average value of the calculated center coordinates.
[0069] Meanwhile, the forms of the first reference image (210) and the second reference image (220) are not limited to the examples illustrated in FIGS. 2 and 3, and may be implemented as various images. In addition, although FIGS. 2 and 3 illustrate and describe the first reference image (210) and the second reference image (220) as different images, the present disclosure is not limited thereto, and they may be implemented as identical images.
[0070] Below, the static stereoscopic training operation is described based on FIGS. 4 to 6, and the dynamic stereoscopic training operation is described based on FIG. 7.
[0071] FIG. 4 is a diagram illustrating a first training session of a stereoscopic vision training motion according to one embodiment of the present disclosure. Referring to FIG. 4, the first training session of the stereoscopic vision training motion is performed using two stationary training images (310, 320). FIG. 4 also illustrates the images recognized when a trainee looks at a display module (150) with both eyes during the first training session.
[0072] In one embodiment, the stereoscopic training providing device (100) may output a first training image (310) and a second training image (320) together to a first display (151) and a second display (152) through a display module (150). At this time, the stereoscopic information of each of the first training image (310) and the second training image (320) may be different from each other. For example, the first training image (310) is an image that is required to have higher stereoscopic vision than the second training image (320), so that when a trainee looks at the first display (151) and the second display (152) together, the first training image (310) appears to protrude further forward.
[0073] The stereoscopic training providing device (100) may adjust at least one of the training coordinates of the first training image (310) and the second training image (320) based on the stereoscopic information in order to reflect the stereoscopic effect of each of the first training image (310) and the second training image (320). For example, the stereoscopic training providing device (100) may adjust the training coordinates of the first training image (310) so that the first training image (310) appears to protrude further forward. In some embodiments, if an image with stereoscopic effect of 0 (e.g., the second training image (320)) exists, adjustment of the training coordinates of the corresponding image may not be performed.
[0074] The stereoscopic training providing device (100) can output the first training image (310) and the second training image (320) to the display module (150) based on the adjusted training coordinates. In addition, the stereoscopic training providing device (100) can receive an input from the trainee through the input module (130) for selecting the training images (310, 320) in order of increasing stereoscopic effect. The stereoscopic training providing device (100) can calculate the trainee's training score by considering whether the trainee's input is correct, the input time, etc.
[0075] FIG. 5 is a diagram illustrating a second training session of a stereoscopic vision training motion according to one embodiment of the present disclosure. Referring to FIG. 5 , the second training session of the stereoscopic vision training motion is performed using three stationary training images (410, 420, 430). FIG. 5 also illustrates images recognized when a trainee looks at a display module (150) with both eyes during the second training session.
[0076] In one embodiment, the stereoscopic training providing device (100) may output a first training image (410), a second training image (420), and a third training image (430) together to the first display (151) and the second display (152), respectively, through the display module (150). At this time, the stereoscopic information of the first training image (410), the second training image (420), and the third training image (430) may be different from each other. For example, the first training image (410) is an image that is required to have higher stereoscopic vision than the second training image (420) and the third training image (430), so that when the trainee looks at the first display (151) and the second display (152) together, the first training image (410) appears to protrude further forward. And the second training image (420) is an image that is required to have a higher sense of three-dimensionality than the third training image (430), so that when the trainee looks at the first display (151) and the second display (152) together, the second training image (420) appears to protrude further forward.
[0077] The stereoscopic training providing device (100) may adjust at least one of the training coordinates of the first training image (410), the second training image (420), and the third training image (430) based on stereoscopic information in order to reflect the stereoscopic effect of each of the first training image (410), the second training image (420), and the third training image (430). For example, the stereoscopic training providing device (100) may adjust the training coordinates of the first training image (410) and the second training image (420) so that the first training image (410) appears to protrude the most forward, and the second training image (420) appears to protrude the most in the following order. In some embodiments, if an image with stereoscopic effect of 0 (e.g., the third training image (430)) exists, adjustment of the training coordinates of the corresponding image may not be performed.
[0078] The stereoscopic training providing device (100) can output a first training image (410), a second training image (420), and a third training image (430) to the display module (150) based on the adjusted training coordinates. In addition, the stereoscopic training providing device (100) can receive an input from the trainee through the input module (130) for selecting training images (410, 420, 430) in descending order of stereoscopic effect. The stereoscopic training providing device (100) can calculate the trainee's training score by considering whether the trainee's input is correct, the input time, etc.
[0079] FIG. 6 is a diagram illustrating a third training session of a stereoscopic vision training motion according to one embodiment of the present disclosure. Referring to FIG. 6, the third training session of the stereoscopic vision training motion is performed using four stationary training images (510, 520, 530, 540). FIG. 6 also illustrates images recognized when a trainee looks at a display module (150) with both eyes during the third training session.
[0080] In one embodiment, the stereoscopic vision training providing device (100) may output a first training image (510), a second training image (520), a third training image (530), and a fourth training image (540) together to the first display (151) and the second display (152) via the display module (150), respectively. At this time, the stereoscopic information of the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540) may be different from each other. For example, the stereoscopic vision may be high in the order of 'first training image (510) - second training image (520) - third training image (530) - fourth training image (540).' Therefore, it may be required to appear to protrude forward in the order of 'first training image (510) - second training image (520) - third training image (530) - fourth training image (540)'.
[0081] The stereoscopic training providing device (100) may adjust at least one of the training coordinates of the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540) based on stereoscopic information in order to reflect the stereoscopic effect of each of the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540). For example, the stereoscopic training providing device (100) may adjust the training coordinates of the first training image (510), the second training image (520), and the third training image (530) so that they appear to protrude forward in the order of 'first training image (510) - second training image (520) - third training image (530) - fourth training image (540).' In some embodiments, if there is an image with stereopsis 0 (e.g., the fourth training image (540)), no adjustment may be made to the training coordinates of that image.
[0082] The stereoscopic training providing device (100) can output a first training image (510), a second training image (520), a third training image (530), and a fourth training image (540) to the display module (150) based on the adjusted training coordinates. In addition, the stereoscopic training providing device (100) can receive an input from the trainee through the input module (130) for selecting training images (510, 520, 530, 540) in order of increasing stereoscopic effect. The stereoscopic training providing device (100) can calculate the trainee's training score by considering whether the trainee's input is correct, the input time, etc.
[0083] In this way, the stereoscopic vision training device (100) of the present disclosure can increase the static stereoscopic vision ability even if the eyes of the trainee are not currently corrected by providing a static stereoscopic vision training movement based on training coordinates according to the astigmatism evaluation.
[0084] Meanwhile, although FIGS. 4 to 6 illustrate and describe the stereoscopic training device (100) as performing static stereoscopic training using two to four training images, the present disclosure is not limited thereto. For example, it goes without saying that the device may be implemented to perform static stereoscopic training using five or more training images.
[0085] In addition, although FIGS. 4 through 6 illustrate and describe the stereoscopic training device (100) as providing a static stereoscopic training motion that performs all of the first through third trainings, the present disclosure is not limited thereto. For example, the stereoscopic training device (100) may be implemented to provide a static stereoscopic training motion that performs at least one of the first through third trainings.
[0086] FIG. 7 is a diagram illustrating the fourth training session of the stereoscopic vision training motion according to one embodiment of the present disclosure. Referring to FIG. 7, the fourth training session of the stereoscopic vision training motion is performed using ten moving training images (610, 620). FIG. 7 also illustrates the images recognized when a trainee looks at the display module (150) with both eyes during the fourth training session.
[0087] In one embodiment, the stereoscopic vision training providing device (100) may output a first training image (610) and a plurality of second training images (620) together to a first display (151) and a second display (152) through a display module (150). At this time, the stereoscopic vision information of the first training image (610) and the stereoscopic vision information of the plurality of second training images (620) may be different from each other. For example, the first training image (610) is an image that is required to have higher stereoscopic vision than the plurality of second training images (620), so that when a trainee looks at the first display (151) and the second display (152) together, the first training image (610) appears to protrude further forward.
[0088] The stereoscopic training providing device (100) may adjust at least one of the training coordinates of the first training image (310) and the plurality of second training images (620) based on stereoscopic information to reflect the stereoscopic effect of each of the first training image (610) and the plurality of second training images (620). For example, the stereoscopic training providing device (100) may adjust the training coordinates of the first training image (610) so that the first training image (610) appears to protrude further forward. In some embodiments, if there is an image with stereoscopic effect of 0 (e.g., the plurality of second training images (620)), adjustment of the training coordinates of the corresponding image may not be performed.
[0089] The stereoscopic training providing device (100) can output a first training image (610) and a plurality of second training images (620) to the display module (150) based on the adjusted training coordinates. In addition, the stereoscopic training providing device (100) can receive an input from the trainee through the input module (130) to select an image with high stereoscopic effect among moving images. The stereoscopic training providing device (100) can calculate the trainee's training score by considering whether the trainee's input is correct, the input time, etc.
[0090] In this way, the stereoscopic vision training device (100) of the present disclosure can increase dynamic stereoscopic vision ability even if the trainee's eyes are not currently corrected by providing dynamic stereoscopic vision training movements based on training coordinates according to strabismus evaluation.
[0091] The stereoscopic training device (100) of the present disclosure can perform each of the first to fourth trainings of the stereoscopic training motion multiple times. For example, the stereoscopic training device (100) can perform each of the first to fourth trainings 50 times. In addition, the stereoscopic training device (100) can adjust the difficulty of the next training based on the training scores of the first to fourth trainings that were performed previously. For example, the stereoscopic training device (100) can adjust the difficulty by changing the stereoscopic difference between the training images or changing the training images into images that are easier or more difficult to perceive the stereoscopic effect.
[0092] Meanwhile, in FIGS. 3 to 7, the stereoscopic training device (100) has been described as selecting training images in order of increasing stereoscopic effect during the stereoscopic training operation, but the present disclosure is not limited thereto. For example, the stereoscopic training device (100) may be implemented to select training images in order of decreasing stereoscopic effect, or may be implemented to alternately select images with the highest or lowest stereoscopic effect each time an image is selected.
[0093] FIG. 8 is a diagram illustrating training images according to one embodiment of the present disclosure. Referring to FIG. 8, the training images can be implemented in various shapes, such as a heart shape, a star shape, a circle shape, a tree shape, a rabbit shape, an elephant shape, a fish shape, a house shape, a butterfly shape, a car shape, and the like.
[0094] In one embodiment, the training images may have a preset size. The preset size may be set based on the display size of the display module (150), the distance between the trainee and the display, etc.
[0095] In one embodiment, the stereoscopic training providing device (100) may be implemented to use only the same training images within a single training session. For example, referring to FIG. 4, in the first training session of the static stereoscopic training operation, the stereoscopic training providing device (100) may use rabbit-shaped training images. Referring to FIG. 5, in the second training session of the static stereoscopic training operation, the stereoscopic training providing device (100) may use elephant-shaped training images. Referring to FIG. 6, in the third training session of the static stereoscopic training operation, the stereoscopic training providing device (100) may use car-shaped training images. Referring to FIG. 7, in the fourth training session of the dynamic stereoscopic training operation, the stereoscopic training providing device (100) may use star-shaped training images. Meanwhile, the above example is only one embodiment, and the training images used for each training type may be set in various ways.
[0096] In another embodiment, the stereoscopic training device (100) may use different training images for each training session when performing multiple training sessions. For example, the stereoscopic training device (100) may use rabbit-shaped training images in the first session of the first training session, and star-shaped training images in the next session.
[0097] In one embodiment, the stereoscopic training providing device (100) can set the difficulty level based on the symmetry of the training image. Specifically, a training image having vertical, horizontal, and right-to-left symmetry (e.g., a circle shape) is relatively easier to perceive a three-dimensional effect than an image having only vertical or left-to-right symmetry (e.g., a star shape, a heart shape, a tree shape, a butterfly shape), or a training image without symmetry (a rabbit shape, an elephant shape, a fish shape, a house shape, a car shape). In this respect, the stereoscopic training providing device (100) can set the difficulty level to gradually increase in the order of 'training image with vertical, horizontal, and right-to-left symmetry - image with vertical symmetry or image with left-to-right symmetry - image without symmetry'. In addition, the stereoscopic training providing device (100) can adjust the difficulty level in the stereoscopic training operation in consideration of the difficulty level of the training image.
[0098] FIG. 9 is a table showing the stereoscopic accuracy of training images according to the difficulty level of the first and fourth trainings according to one embodiment of the present disclosure. Since the first and fourth trainings use training images with two types of stereoscopic effects, the table shows the stereoscopic accuracy according to the difficulty level of images with high stereoscopic effects (e.g., the first training image (310) of FIG. 4 and the first training image (610) of FIG. 7).
[0099] Referring to FIG. 9, the stereoscopic views of the first training images (310, 610) can be confirmed in the first and fourth trainings of the first to eleventh difficulties. For example, in the first and fourth trainings of the first difficulty, the stereoscopic views of the first training images (310, 610) are 1600 arcsec. In addition, in the first and fourth trainings of the second difficulty, the stereoscopic views of the first training images (310, 610) are 800 arcsec. Although not illustrated in FIG. 9, the stereoscopic views of the second training images (320, 620) can be set to a fixed value, for example, 0 arcsec.
[0100] In this way, as the difficulty increases, the difference in stereoscopic vision between the first training images (310, 610) and the second training images (320, 620) decreases.
[0101] Meanwhile, the number of difficulty levels and the information on stereoscopic views according to difficulty level in the table of FIG. 9 are not limited to the above example. For example, the number of difficulty levels may be less than or more than 11, and the stereoscopic views according to difficulty level may also be set to values different from the above example.
[0102] FIG. 10 is a table showing the stereoscopic accuracy of training images according to the difficulty level of the second training according to one embodiment of the present disclosure. Since the second training utilizes training images with three types of stereoscopic effects, the table shows the stereoscopic accuracy according to the difficulty level of each of the first training image (410), the second training image (420), and the third training image (430).
[0103] Referring to FIG. 10, in the second training of the tenth difficulty level from the first difficulty level, the stereoscopic views of the first training image (410), the second training image (420), and the third training image (430) can be sequentially checked. For example, in the second training of the first difficulty level, the stereoscopic view of the first training image (410) is 1600 arcsec, the stereoscopic view of the second training image (420) is 800 arcsec, and the stereoscopic view of the third training image (430) is 0 arcsec. And in the second training of the second difficulty level, the stereoscopic view of the first training image (410) is 800 arcsec, the stereoscopic view of the second training image (420) is 400 arcsec, and the stereoscopic view of the third training image (430) is 0 arcsec.
[0104] In this way, as the difficulty increases, the difference in stereopsis between the first training image (410), the second training image (420), and the third training image (430) decreases, and the average value of stereopsis also decreases.
[0105] Meanwhile, the number of difficulty levels and the information on stereoscopic views according to difficulty level in the table of FIG. 10 are not limited to the above example. For example, the number of difficulty levels may be less than or more than 10, and the stereoscopic views according to difficulty level may also be set to values different from the above example.
[0106] FIG. 11 is a table showing the stereoscopic accuracy of training images according to the difficulty level of the third training according to one embodiment of the present disclosure. Since the third training uses training images with four types of stereoscopic effects, the table shows the stereoscopic accuracy according to the difficulty level of each of the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540).
[0107] Referring to FIG. 11, in the third training of the ninth difficulty level from the first difficulty level, the stereoscopic views of the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540) can be sequentially checked. For example, in the third training of the first difficulty level, the stereoscopic view of the first training image (510) is 1600 arcsec, the stereoscopic view of the second training image (520) is 800 arcsec, the stereoscopic view of the third training image (530) is 400 arcsec, and the stereoscopic view of the fourth training image (540) is 0 arcsec. And in the third training of the second difficulty, the stereoscopic vision of the first training image (510) is 800 arcsec, the stereoscopic vision of the second training image (520) is 400 arcsec, the stereoscopic vision of the third training image (530) is 200 arcsec, and the stereoscopic vision of the fourth training image (540) is 0 arcsec.
[0108] In this way, as the difficulty increases, the difference in stereopsis between the first training image (510), the second training image (520), the third training image (530), and the fourth training image (540) decreases, and the average value of stereopsis also decreases.
[0109] Meanwhile, the number of difficulty levels and the information on stereoscopic views according to difficulty levels in the table of FIG. 11 are not limited to the above example. For example, the number of difficulty levels may be less than or more than 9, and the stereoscopic views according to difficulty levels may also be set to values different from the above example.
[0110] FIG. 12 is a diagram illustrating training coordinates according to one embodiment of the present disclosure. FIG. 13 is a diagram illustrating training coordinates according to difficulty and stereoscopic vision according to one embodiment of the present disclosure.
[0111] Referring to Fig. 12, in the operation of setting training coordinates through strabismus measurement, the training coordinates of a trainee with normal eyes can be set to (0,0). Meanwhile, the training coordinates of a trainee with strabismus can be set based on a coordinate change signal that moves the first reference image (210) or the second reference image (220) in the left-right direction, as described in Fig. 2. For example, if the trainee inputs a coordinate change signal that moves the first reference image (210) or the second reference image (220) by k, the training coordinates can be set to (k,0).
[0112] In one embodiment, the stereoscopic vision training device (100) may adjust training coordinates based on stereoscopic information of the training image used for the training prior to performing the training. At this time, the stereoscopic vision training device (100) may adjust the training coordinates of the area corresponding to the strabismus among the normal eye and the strabismus. For example, if the strabismus is the left eye, the stereoscopic vision training device (100) may adjust the training coordinates of the area corresponding to the left eye, and if the strabismus is the right eye, the stereoscopic vision training device (100) may adjust the training coordinates of the area corresponding to the right eye.
[0113] Referring to Fig. 13, the training coordinate values of the area corresponding to strabismus according to stereopsis can be confirmed. For example, if the stereopsis is 1600 arcsec, the training coordinate values can be adjusted by adding or subtracting 0.4444 to or from the training coordinate (k,0) of the area corresponding to strabismus. In addition, if the stereopsis is 800 arcsec, the training coordinate values can be adjusted by adding or subtracting 0.2222 to or from the training coordinate (k,0) of the area corresponding to strabismus.
[0114] Meanwhile, in the table of Fig. 13, the number of difficulty levels, the information on stereoscopic views according to difficulty levels, and the training coordinate correction values according to stereoscopic views are not limited to the above example. For example, the number of difficulty levels may be less than or more than 10, and the stereoscopic views according to difficulty levels and the training coordinate correction values according to stereoscopic views may also be set to values different from the above example.
[0115] FIG. 14 is a flowchart illustrating a method for providing stereoscopic vision training according to one embodiment of the present disclosure.
[0116] Referring to FIG. 14, the stereoscopic vision training providing device (100) can set training coordinates based on coordinate change responses for the first reference image and the second reference image (S110). Specifically, the stereoscopic vision training providing device (100) can output the first reference image to an area corresponding to the left eye through the display module (150) and output the second reference image to an area corresponding to the right eye. In addition, the stereoscopic vision training providing device (100) can receive a coordinate change signal for moving the first reference image or the second reference image in the left-right direction to complete a specific shape through the input module (130). In addition, the stereoscopic vision training providing device (100) can calculate training coordinates based on the input signal.
[0117] And the stereoscopic vision training providing device (100) can output multiple training images with different stereoscopic effects based on training coordinates (S120). Specifically, the stereoscopic vision training providing device (100) can output multiple training images with different stereoscopic effects to both the area corresponding to the left eye and the area corresponding to the right eye. The stereoscopic vision training providing device (100) can output multiple training images by adjusting the training coordinates based on the stereoscopic information of the training image to be used in each training. The stereoscopic vision training providing device (100) can output training images that do not move in a static stereoscopic vision training operation, and can output training images that move in a dynamic stereoscopic vision training operation.
[0118] And the stereoscopic training device (100) can receive a selection response for a training image with high stereoscopic effect (S130). Specifically, the stereoscopic training device (100) can receive a response for selecting images in order of high stereoscopic effect in a static stereoscopic training operation, and can receive a response for selecting a single image with high stereoscopic effect in a dynamic stereoscopic training operation.
[0119] And the stereoscopic training device (100) can adjust the difficulty of the next training based on the trainee's selection response.
[0120] Figure 15 is a flowchart showing a training coordinate setting method of the present disclosure.
[0121] Referring to FIG. 15, the stereoscopic vision training providing device (100) can output a first reference image to a first area and a second reference image to a second area (S210). Specifically, the stereoscopic vision training providing device (100) can output the first reference image to a first area of the display module (150), that is, an area corresponding to the left eye, and output the second reference image to a second area of the display module (150), that is, an area corresponding to the right eye. The first area and the second area of the display module (150) can be distinguished based on a location within a single display, and according to an embodiment, the first area and the second area can refer to a plurality of physically distinct displays.
[0122] And the stereoscopic vision training providing device (100) can receive a coordinate change signal for moving the first reference image (210) or the second reference image (220) in the left-right direction (S220). Specifically, the stereoscopic vision training providing device (100) can receive a coordinate change signal for moving the image corresponding to strabismus in the left-right direction. For example, if the left eye of the trainee is strabismus, the coordinate change signal for the first reference image (210) corresponding to the left eye can be received. And if the right eye of the trainee is strabismus, the coordinate change signal for the second reference image (220) corresponding to the right eye can be received.
[0123] And the stereoscopic training providing device (100) can move the first reference image (210) or the second reference image (220) in the left and right direction based on the coordinate change signal (S230). Specifically, the stereoscopic training providing device (100) can move the position of the first reference image (210) or the second reference image (220) output to the display module (150) in real time according to the received coordinate change signal. Accordingly, the trainee can check through the display module (150) whether the first reference image (210) and the second reference image (220) have a reference shape due to the movement. If the trainee confirms the reference shape, the trainee can input a signal indicating that the coordinate change is completed. The stereoscopic training providing device (100) can proceed to the next step if it receives the completion signal.
[0124] And the stereoscopic training providing device (100) can calculate the center coordinates of the boundary area including the first reference image (210) and the second reference image (220) (240). Specifically, the stereoscopic training providing device (100) can calculate the center coordinates of the boundary area including the first reference image (210) and the second reference image (220) but having the smallest size. And the stereoscopic training providing device (100) can set the calculated center coordinates as the training coordinates of the area corresponding to the strabismus.
[0125] According to the stereoscopic vision training device (100) of the present disclosure, by performing a training coordinate setting operation through strabismus measurement in advance, the degree of strabismus according to the trainee's condition at the time of training is accurately reflected, thereby providing an effect of increasing the effectiveness of stereoscopic vision training.
[0126] In addition, according to the stereoscopic training device (100) of the present disclosure, by providing not only static stereoscopic training but also dynamic stereoscopic training, it provides the effect of increasing the effectiveness of stereoscopic training of the trainee.
[0127] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.
[0128] Computer-readable storage media include all types of storage media that store instructions that can be deciphered by a computer. Examples include read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disks, flash memory, and optical data storage devices.
[0129] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present disclosure can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.
Claims
1. Display module; A memory including a first reference image, a second reference image, multiple training images, and stereoscopic information; an input module for receiving the trainee's response; and Outputting the first reference image to the first area of the display module, outputting the second reference image to the second area of the display module, and setting training coordinates based on coordinate change signals for the first reference image and the second reference image, A stereoscopic training providing device, comprising: a control module for performing a stereoscopic training operation of outputting a plurality of training images with different stereoscopic effects to the display module based on the training coordinates and receiving a selection response for a training image with high stereoscopic effects.
2. In paragraph 1, The above first area is an area corresponding to the left eye of the trainee, The above second area is an area corresponding to the right eye of the trainee, A stereoscopic vision training device characterized in that the coordinate change signal is a signal that moves the first reference image or the second reference image in the left and right direction.
3. In paragraph 1, The above control module, A stereoscopic training device characterized in that it moves the first reference image or the second reference image according to the coordinate change signal, calculates the center coordinates of a boundary area including the first reference image and the second reference image, and sets the training coordinates based on the calculated center coordinates.
4. In paragraph 1, The above control module, Correcting the training coordinates of at least one of the plurality of training images based on the stereoscopic information, A stereoscopic vision training device characterized in that the training coordinates of the plurality of training images output to an area corresponding to a strabismus are corrected based on the stereoscopic vision information.
5. In paragraph 1, The above stereoscopic information is, A stereoscopic training device characterized in that it has different stereoscopic values according to the training difficulty of the stereoscopic training movement.
6. In paragraph 1, The above stereoscopic training movements are: Static stereoscopic training, which selects training images in order of high stereoscopic effect among the plurality of non-moving training images; and A stereoscopic training providing device characterized by including dynamic stereoscopic training, which selects one training image with high stereoscopic effect from among the plurality of moving training images.
7. In paragraph 1, The above control module, A stereoscopic training device characterized in that it performs the stereoscopic training movement multiple times and adjusts the difficulty of the next stereoscopic training movement based on the training result of the previous stereoscopic training movement.
8. In a method for providing stereoscopic training, performed by a control module of a device, A step of outputting a first reference image to a first area of a display module and outputting a second reference image to a second area of the display module; A step of setting training coordinates based on coordinate change signals for the first reference image and the second reference image; A step of outputting a plurality of training images with different three-dimensional effects to the display module based on the training coordinates; and A method for providing stereoscopic training, comprising: performing a stereoscopic training operation for receiving a selection response for a stereoscopic training image having high stereoscopic effect; 9. In paragraph 8, The above first area corresponds to the left eye of the trainee, The above second area is an area corresponding to the right eye of the trainee, A method for providing stereoscopic vision training, characterized in that the coordinate change signal is a signal for moving the first reference image or the second reference image in the left and right direction.
10. In paragraph 8, The step of setting the above training coordinates is: A step of moving the first reference image or the second reference image according to the coordinate change signal; A step of calculating the center coordinates of a boundary area including the first reference image and the second reference image; and A stereoscopic training method characterized by including a step of setting the training coordinates based on the above-described calculated center coordinates.
11. In paragraph 8, A step of correcting the training coordinates of at least one of the plurality of training images based on the stereoscopic information; and A method for providing stereoscopic vision training, characterized in that it further includes a step of correcting training coordinates of the plurality of training images output to an area corresponding to a strabismus based on the stereoscopic vision information.
12. In paragraph 8, The above stereoscopic information is, A method for providing stereoscopic vision training characterized in that it has different stereoscopic values according to the difficulty level of each training of the stereoscopic vision training movement.
13. In paragraph 8, The above stereoscopic training movements are: Static stereoscopic training, which selects training images in order of high stereoscopic effect among the plurality of non-moving training images; and A method for providing stereoscopic vision training, characterized by comprising: dynamic stereoscopic vision training, which selects one training image having high stereoscopic effect among a plurality of moving training images.
14. In paragraph 8, A step of performing the above stereoscopic training movement multiple times; and A method for providing stereoscopic training, characterized in that it further includes a step of adjusting the difficulty of the next sequence of stereoscopic training movements based on the training results of the previous sequence of stereoscopic training movements.
15. A computer-readable recording medium having recorded thereon a computer program for performing the stereoscopic vision training method of Article 8.
Citation Information
Patent Citations
Method and apparatus for preventing squint in viewing binocular display
KR101834287B1
System for curing visual handicap using virtual reality
KR101880386B1
Doppel-targeting antibodies
KR1020220117367A
Method for estimating capacitance for inverter dc-link capacitor and inverter using the same
KR1020240140297A
System, Method and Computer-readable Medium for Rehabilitation training with Virtual Reality for Patients with Exotropia Based on Artificial Intelligence
KR102120112B1
Cited By
Myopia prevention and control training device
CN122320772A
