Visual perception learning-based apparatus and method for providing stereovision training

Abstract

The present disclosure relates to a visual perception learning-based apparatus and method for providing stereovision training, the apparatus including: a display module; a memory storing at least one stereovision training-based process for improving strabismus; and a processor that generates first stimulus plate for orthophoria among the both eyes of a trainee and a second stimulus plate for strabismus among the both eyes, and provides the stereovision training by adjusting of a difficulty level of a first stimulus among a plurality of stimuli included in each of the first stimulus plate and the second stimulus plate, wherein the difficulty level can be adjusted through at least one of a three-dimensional effect setting of the stimulus, a shape setting of the stimulus, an interval setting of the stimulus, an edge setting of the stimulus, and a background color setting of the stimulus.

Description

Device and method for providing stereoscopic vision training based on visual perception learning

[0001] The present disclosure relates to a device and method for providing stereoscopic vision training based on visual perception learning.

[0002] Due to recent advancements in media, the incidence of myopia, astigmatism, and strabismus is on the rise. Among these, strabismus refers to a condition in which the eyes are not aligned properly. If left untreated, vision may be permanently impaired, so early detection and correction in childhood are crucial.

[0003] If strabismus develops between the ages of 2 and 5, the child's two eyes will each see different objects, resulting in two completely different images being transmitted to the brain, causing visual confusion, where completely different objects appear to overlap. Furthermore, double vision, where images appear to be in two different places simultaneously, can occur. To alleviate this confusion and double vision, the child will ignore the images coming from one side. Consequently, the child will lose the ability to perceive objects in three dimensions through binocular vision, and may even lose the use of the strabismic eye, potentially leading to amblyopia.

[0004] Therefore, there is a need to develop a technology that provides and controls stereoscopic vision training to improve the visual perception ability, including stereoscopic perception, of users (trainees).

[0005] The purpose of the embodiments disclosed in the present disclosure is to provide a device and method for providing stereoscopic vision training based on visual perception learning.

[0006] The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

[0007] In order to achieve the above-described technical problem, a stereoscopic training providing device according to the present disclosure based on visual perception learning includes a display module, a memory storing at least one process for improving strabismus based on stereoscopic training, and a processor generating a first stimulus plate for a normal eye among the two eyes of a trainee and a second stimulus plate for a strabismus among the two eyes, and providing the stereoscopic training by adjusting the difficulty of a first stimulus among a plurality of stimuli included in each of the first stimulus plate and the second stimulus plate, wherein the adjusting the difficulty can be performed through at least one of setting the three-dimensionality of the stimulus, setting the shape of the stimulus, setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus.

[0008] In addition, the processor can determine the angle of strabismus of the trainee's strabismus through an evaluation of the trainee's angle of strabismus, and set the positions of the first stimulus plate and the second stimulus plate within the image for stereoscopic vision training based on the angle of strabismus.

[0009] In addition, the positions of the first stimulus plate and the second stimulus plate within the image may be set such that the center of the first stimulus plate and the center of the second stimulus plate differ by the oblique angle on the line.

[0010] In addition, the three-dimensional setting of the stimulus may be a method in which the difficulty level is higher the smaller the distance that the first stimulus included in the second stimulus plate moves based on the center of the second stimulus plate, and the shape setting of the stimulus may be a method in which the difficulty level is higher the less symmetry there is in the shape.

[0011] In addition, the setting of the interval of the stimulus may be such that the greater the distance between the first stimulus and the second stimulus among the plurality of stimuli, the more difficult it is, and the setting of the background color of the stimulus may be such that the less different the background color is from the colors of the first stimulus and the second stimulus, the more difficult it is.

[0012] In addition, the setting of the border of the stimulus may be a method in which the difficulty increases as the distance between the border set by the first method or the second method and at least one of the first stimulus and the second stimulus increases, and the first method may be a method in which the border is set for each of the first stimulus and the second stimulus, and the second method may be a method in which the border is set including the first stimulus and the second stimulus.

[0013] In addition, the processor can set a minimum border formation condition based on an angle for setting the three-dimensional effect, and apply the minimum border formation condition when setting the border of the stimulus.

[0014] In addition, the processor can set priorities for setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus using an artificial intelligence model that has learned the training results of other trainees.

[0015] Additionally, the processor may provide stereoscopic training by providing a third stimulus based on auditory or tactile sensation in a form associated with the first stimulus.

[0016] In addition, a method for providing stereoscopic vision training based on visual perception learning performed by a processor of a device according to another aspect of the present disclosure for achieving the above-described technical task includes a step in which the processor generates a first stimulus plate for a normal eye among the two eyes of a trainee and a second stimulus plate for a strabismus among the two eyes, and a step in which the processor provides stereoscopic vision training by adjusting the difficulty of a first stimulus among a plurality of stimuli included in each of the first stimulus plate and the second stimulus plate, wherein the adjusting the difficulty can be performed through at least one of a method of setting the stereoscopic effect of the stimulus, setting the shape of the stimulus, setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus.

[0017] In addition, a computer program stored in a computer-readable recording medium for executing a method for implementing the present disclosure may be further provided.

[0018] In addition, a computer-readable recording medium recording a computer program for executing a method for implementing the present disclosure may be further provided.

[0019] According to the aforementioned problem solving means of the present disclosure, the stereoscopic vision of the trainee can be trained by setting the stimulus plates provided to both eyes based on the astigmatism angle identified through the astigmatism angle evaluation and imparting a three-dimensional effect to the stimulus included in the stimulus plates.

[0020] In addition, the effectiveness of stereoscopic vision training can be increased by adjusting the difficulty of the stereoscopic stimulus that creates a sense of three-dimensionality in various ways.

[0021] The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0022] FIG. 1 is a block diagram of a stereoscopic vision training providing device based on visual perception learning according to an embodiment of the present disclosure.

[0023] FIG. 2 is a flowchart of a method for providing stereoscopic vision training based on visual perception learning according to an embodiment of the present disclosure.

[0024] FIG. 3 and FIG. 4 are drawings for explaining the difference between normal eyes and strabismus eyes according to an embodiment of the present disclosure.

[0025] FIG. 5A and FIG. 5B are drawings for explaining the angle measurement and stimulus plate setting according to one embodiment of the present disclosure.

[0026] FIG. 6A and FIG. 6B are diagrams illustrating applying a sense of depth to a stereoscopic stimulus for stereoscopic vision training according to one embodiment of the present disclosure.

[0027] FIG. 7 is a drawing for explaining a three-dimensional effect step according to one embodiment of the present disclosure.

[0028] FIG. 8a and FIG. 8b are drawings for explaining border settings according to one embodiment of the present disclosure.

[0029] FIG. 9 is a drawing for explaining minimum border formation conditions according to one embodiment of the present disclosure.

[0030] Throughout this disclosure, the same reference numerals denote the same components. This disclosure does not describe all elements of the embodiments, and any content that is common in the technical field to which this disclosure belongs or that overlaps between embodiments is omitted. The terms "part, module, element, block" used in the specification may be implemented in software or hardware, and depending on the embodiments, multiple "parts, modules, elements, blocks" may be implemented as a single component, or a single "part, module, element, block" may include multiple components. Throughout the specification, when a part is said to be "connected" to another part, this includes not only cases where it is directly connected, but also cases where it is indirectly connected, and an indirect connection includes a connection via a wireless communication network.

[0031] Additionally, when a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise specifically stated.

[0032] Throughout the specification, when we say that an element is "on" another element, this includes not only cases where the element is in contact with the other element, but also cases where another element exists between the two elements.

[0033] The terms first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.

[0034] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0035] The identification codes for each step are used for convenience of explanation and do not describe the order of each step. Each step may be performed in a different order than specified unless the context clearly indicates a specific order.

[0036] The operating principle and embodiments of the present disclosure are described below with reference to the attached drawings.

[0037] As used herein, the term "device" encompasses a variety of devices capable of performing computational processing and providing results to a user. For example, a device according to the present disclosure may include a computer, a server device, and a portable terminal, or may be any one of them.

[0038] Here, the computer may include, for example, a notebook, desktop, laptop, tablet PC, slate PC, etc. equipped with a web browser.

[0039] The above server device is a server that processes information by communicating with an external device, and may include an application server, a computing server, a database server, a file server, a game server, a mail server, a proxy server, and a web server.

[0040] The above portable terminal may include, for example, a wireless communication device that ensures portability and mobility, and may include all kinds of handheld-based wireless communication devices such as a PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, a smart phone, and a wearable device such as a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD).

[0041] The artificial intelligence-related functions according to the present disclosure are operated via a processor and memory. The processor may be comprised of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, an AP, a DSP (Digital Signal Processor), a graphics-only processor such as a GPU or a VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. One or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0042] FIG. 1 is a block diagram of a stereoscopic vision training providing device based on visual perception learning according to an embodiment of the present disclosure.

[0043] Referring to FIG. 1, a stereoscopic training device based on visual perception learning (hereinafter, stereoscopic training device) (10) may include a communication module (11), an input module (12), a display module (13), a memory (14), and a processor (15). The components illustrated in FIG. 1 are not essential for implementing the stereoscopic training device (10) according to the present disclosure, and thus the stereoscopic training device (10) described in this specification may have more or fewer components than the components listed above.

[0044] The stereoscopic vision training device (10) according to an embodiment of the present invention may include various devices capable of performing computational processing. For example, the stereoscopic vision training device (10) may include a desktop PC, a mobile phone, a smart phone, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a slate PC, a tablet PC, an ultrabook, a wearable device, etc.

[0045] Meanwhile, the stereoscopic training device (10) may include a display device such as a mobile phone that can be mounted on a head-mounted device such as an HMD (Head Mounted Display) that is mounted on the head of the trainee and displays an image, smart glasses, smart goggles, etc.

[0046] The communication module (11) performs wired or wireless communication with at least one external device (server, etc.). In particular, when performing wireless communication, it transmits and receives wireless signals in a communication network according to wireless Internet technologies.

[0047] Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution-Advanced), and the stereoscopic training providing device (100) transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.

[0048] As for short range communication, it can support short range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. In this case, the short range wireless communication network can be a short range wireless personal area network.

[0049] The input module (12) can acquire signals corresponding to the trainee's input. For example, the input module (12) can acquire input from the trainee for performing astigmatism measurement or stereoscopic training, responses to astigmatism evaluation movements and stereoscopic training movements provided through the display module (13), etc.

[0050] At this time, the input module (12) may include a keyboard, a key pad, buttons, a jog shuttle, a wheel, etc. In addition, the trainee's input in the input module (12) may be, for example, pressing a button, touching, dragging, etc.

[0051] The input module (12) may be configured as a separate module that is connected wirelessly or wiredly to the stereoscopic training device (10). For example, the stereoscopic training device (10) may provide the trainee with images for performing astigmatism evaluation or stereoscopic training through a display module (13) mounted and attached to the trainee's head, and may receive responses from the trainee through an input module (12) configured as a separate module placed in the trainee's hand.

[0052] The display module (13) outputs images or video. For example, the display module (13) may include an LCD, OLED, AMOLED display, etc. In one embodiment, when the display module (13) is implemented as a touch screen, the display module (13) may also function as an input module (12). In this case, depending on the selection, a separate input module (12) may not be provided, or an input module (12) that performs limited functions such as volume control, a power button, and a home button may be provided. In addition, the display module (13) may also be provided in the form of an image output port that transmits image information to an external display device.

[0053] The display module (13) may include a plurality of first displays and second displays, each corresponding to the trainee's two eyes. Here, the first display may output a first image, and the second display may output a second image.

[0054] Meanwhile, the present disclosure is not limited thereto, and the display module (13) may be implemented as a single display. In this case, the display module (13) may output a first image to the left area of ​​the display and a second image to the right area of ​​the display.

[0055] The memory (14) stores at least one data (information) and at least one process required for strabismus improvement based on stereoscopic vision training, as well as various data (information). For example, the memory (14) may store a program for providing and performing training, at least one trainee's information (personal information, visual information, response information, training results, etc.), various reference values ​​that serve as criteria for strabismus evaluation, measurement images, training images, etc. as data. In addition, the memory (14) may store various commands, algorithms, etc. for executing a strabismus improvement method based on stereoscopic vision training.

[0056] In addition, the memory (14) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. In addition, the memory (14) may store information temporarily, permanently, or semi-permanently, and may be provided as a built-in or removable type.

[0057] The processor (15) controls the components within the stereoscopic training device (10) or processes and calculates various information, and controls the performance of a strabismus improvement operation based on at least one process stored in the memory (14).

[0058] The processor (15) may perform a stimulus plate setting operation through an evaluation of the trainee's strabismus angle before performing a strabismus improvement operation. Specifically, the processor (15) may output a first reference image to an area corresponding to the left eye through the display module (13) and output a second reference image to an area corresponding to the right eye. At this time, when the first reference image and the second reference image are viewed together based on a normal eye, the first reference image and the second reference image may be output so that a specific shape (e.g., a square, a heart, etc.) is visible. On the other hand, when the first reference image and the second reference image are viewed together based on a strabismus eye, a gap to the left and right may exist, so that the specific shape above may not be visible. In this case, the trainee may complete a specific shape by moving the first reference image or the second reference image in the left and right direction through the input module (12). Through this, the processor (15) can calculate whether the trainee's strabismus is in the left or right eye and the degree of strabismus. And the processor (15) can generate a stimulus plate based on the calculated astigmatism angle. For example, the processor (15) can set the position of the stimulus plate so that an image for stereoscopic vision training is output to the display module (13) corresponding to the visual angle of the trainee's normal eye and / or astigmatism eye, respectively, using the calculated astigmatism angle.

[0059] And the processor (15) can perform a stereoscopic training movement (strabismus improvement movement) based on the position of the set stimulus plate. The stereoscopic training movement is a training that allows the trainee to select a stereoscopic stimulus among a planar stimulus and a stereoscopic stimulus. At this time, the processor (15) can efficiently perform the training to improve the trainee's strabismus by varying the difficulty of the stereoscopic stimulus.

[0060] The processor (15) may be implemented in software, hardware, or a combination thereof. For example, in terms of hardware, the processor (15) may be implemented in terms of FPGA (field programmable gate array), ASIC (Application Specific Integrated Circuit), semiconductor chip, or other various forms of electronic circuit. In addition, for example, in terms of software, the processor (15) may be implemented in terms of logic programs executed according to the above-described hardware, various computer languages, etc.

[0061] Unless otherwise stated in the following description, it can be understood that the operation of the stereoscopic training device (10) is performed under the control of the processor (15).

[0062] In this way, the stereoscopic vision training device (10) according to the present disclosure can determine the location of the stimulus based on the angle from the center of the lens rather than setting the location of the stimulus based on the rectangular coordinate system by performing the operation of setting the location of the stimulus plate through strabismus evaluation in advance. As a result, the effectiveness of stereoscopic vision training can be increased by accurately providing the stimulus at the location of the strabismus by accurately reflecting the degree of strabismus according to the trainee's condition at the time of training.

[0063] In addition, the stereoscopic training device (10) according to the present disclosure can increase the effectiveness of stereoscopic training for a trainee by providing not only static stereoscopic training but also dynamic stereoscopic training.

[0064] Meanwhile, the stereoscopic vision training providing device (10) may be implemented to perform a strabismus evaluation operation and a stereoscopic vision training operation through an external device, depending on the embodiment. For example, if the stereoscopic vision training providing device (100) is implemented as a server, the stereoscopic vision training providing device (100) may communicate with an external device through a communication module (110) to perform a stimulus plate generation operation and a stereoscopic vision training operation (strabismus improvement operation). In this case, the operation using the input module (12) and the display module (13) of the stereoscopic vision training providing device (10) described in the present specification may be replaced with an operation using the display module and the input module of the external device through the communication module (11).

[0065] FIG. 2 is a flowchart of a method for providing stereoscopic vision training based on visual perception learning according to an embodiment of the present disclosure.

[0066] FIGS. 3 and 4 are diagrams for explaining the difference between normal eyes and strabismus according to an embodiment of the present disclosure. FIGS. 5A and 5B are diagrams for explaining strabismus angle measurement and stimulus plate setting according to an embodiment of the present disclosure.

[0067] FIG. 6A and FIG. 6B are diagrams illustrating applying a sense of depth to a stereoscopic stimulus for stereoscopic vision training according to one embodiment of the present disclosure.

[0068] FIG. 7 is a drawing for explaining a three-dimensional effect step according to one embodiment of the present disclosure.

[0069] FIG. 8a and FIG. 8b are drawings for explaining border settings according to one embodiment of the present disclosure.

[0070] FIG. 9 is a drawing for explaining minimum border formation conditions according to one embodiment of the present disclosure.

[0071] Before describing a stereoscopic training-based strabismus improvement method according to an embodiment of the present disclosure with reference to FIG. 2, the differences between normal eyes and strabismus eyes according to an embodiment of the present disclosure will be described with reference to FIGS. 3 and 4.

[0072] Referring to FIG. 3, the display module (13) may include a first display (131) and a second display (132). In the present disclosure, the first display (131) and the second display (132) may be implemented as multiple physically separated displays, or may be implemented as a concept of areas divided into a left area and a right area within a single display.

[0073] In one embodiment, the first display (131) may output a first reference image (310) corresponding to the left eye, and the second display (132) may output a second reference image (320) corresponding to the right eye. The first reference image (310) and the second reference image (320) may be different images. For example, referring to FIG. 3, the first reference image (310) is a 'ㄷ'-shaped image, and the second reference image (320) is a 'ㅓ'-shaped image.

[0074] And the first reference image (310) and the second reference image (320) can be output so that when a trainee with normal eyes in both eyes looks at them, the first reference image (310) and the second reference image (320) appear to form a specific shape together. For example, referring to FIG. 4, when a trainee with normal eyes in both eyes looks at them, the first reference image (310) and the second reference image (320) can be output so that they appear to be a square formed by combining 'ㄷ' and 'ㅓ'. This specific shape is hereinafter referred to as a reference shape.

[0075] Meanwhile, if a trainee with strabismus in one eye looks at the first reference image (310) and the second reference image (320), they will appear differently from the above. For example, referring to FIG. 4, a trainee with strabismus in one eye will see the first reference image (310) or the second reference image (320) as being further to the left or right, and will not see it as a square formed by combining 'ㄷ' and 'ㅓ'.

[0076] The trainee can move his or her eyes or head so that the first reference image (310) and the second reference image (320) have a reference shape. The processor (15) can determine whether one of the trainee's eyes is strabismic based on the distance the pupils or head have moved, and can determine the angle of the strabismus.

[0077] Meanwhile, the forms of the first reference image (310) and the second reference image (320) are not limited to the examples illustrated in FIGS. 3 and 4, and may be implemented as various images. In addition, although FIGS. 4 and 5 illustrate and describe the first reference image (310) and the second reference image (320) as different images, the present disclosure is not limited thereto, and they may be implemented as identical images.

[0078] Hereinafter, with reference to FIGS. 2, 5 to 9, the operation of generating a stimulus plate through a visual angle evaluation and the operation of stereoscopic vision training will be described.

[0079] Referring to FIG. 2, the processor (15) can generate a first stimulus plate for the left eye of the trainee and a second stimulus plate for the right eye of the trainee (S210).

[0080] The processor (15) can identify the strabismus of the trainee's eyes through an evaluation of the trainee's angle of strabismus, and also determine the angle of strabismus of the strabismus eye. The following description will be given as an example of a case in which the right eye is strabismus, unless otherwise specified. The same explanation can also be applied to a case in which the left eye is strabismus.

[0081] Here, the strabismus evaluation can be performed based on the movement distance of the trainee's pupils or head when the first reference image (310) and the second reference image (320) are provided to the trainee through the display module (13), as described above.

[0082] The processor (15) can set the positions of the first stimulus plate and the second stimulus plate within the image for stereoscopic vision training (hereinafter, training image) based on the calculated angle of astigmatism.

[0083] Specifically, the positions of the first stimulus plate in the first training image and the second stimulus plate in the second training image may be set such that the center of the first stimulus plate and the center of the second stimulus plate differ by the angle of astigmatism on the horizontal line. Here, the first training image may be an image for the left eye, and the second training image may be an image for the right eye.

[0084] That is, the processor (15) can set the position of the first stimulus plate in the first training image and the position of the second stimulus plate in the second training image so that the angle between the center of the first stimulus plate and the center of the second stimulus plate is equal to the oblique angle.

[0085] Referring to Fig. 5a, when 'ㅓ' in the second reference image moves k° with respect to 0°, and the reference shape is formed by combining 'ㄷ' and 'ㅓ', the angle of incidence can be k°.

[0086] Referring to FIG. 5b, if the strabismus is the right eye, the processor (15) can set the first stimulus plate (510) of the non-strabismus eye (left eye) to 0° and set the second stimulus plate (520) of the strabismus eye (right eye) to k°. That is, the angle between the center of the first stimulus plate (510) and the center of the second stimulus plate (520) can be k°.

[0087] Accordingly, the images for normal eyes and strabismus provided to the trainee during stereoscopic training can be set so that the stimulus plates are positioned based on 0° and k° degrees, respectively.

[0088] The processor (15) can provide (perform) stereoscopic vision training by adjusting the difficulty of the first stimulus among the plurality of stimuli included in each of the first stimulus plate and the second stimulus plate (220).

[0089] Here, the first stimulus may be a stereoscopic stimulus and the second stimulus may be a planar stimulus.

[0090] That is, when the first training image for the left eye and the second training image for the right eye each contain two objects (stereoscopic stimuli and planar stimuli), and the right eye is strabismus, when the processor (15) maintains the position of the stereoscopic stimuli contained in the first training image for the left eye as is and adjusts the position of the stereoscopic stimuli contained in the second training image for the right eye, a three-dimensional effect is formed in the stereoscopic stimuli. By simultaneously viewing the stereoscopic stimuli with a three-dimensional effect and the planar stimuli without a three-dimensional effect, the trainee recognizes the three-dimensional effect of the stereoscopic stimuli and provides (performs) stereoscopic vision training.

[0091] In the present disclosure, the difficulty of the first stimulus (stereoscopic stimulus) can be adjusted through at least one of setting the three-dimensionality of the stimulus, setting the shape of the stimulus, setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus.

[0092] The three-dimensionality setting of the above stimulus is a method of adjusting the difficulty by setting the three-dimensionality based on the distance that the first stimulus included in the second stimulus plate in the second training video moves relative to the center of the second stimulus plate. Specifically, the difficulty may be higher as the distance that the first stimulus included in the second stimulus plate moves relative to the center of the second stimulus plate decreases. At this time, the shape of the stimulus is not limited to a single shape and various shapes may be applied. This will be described later.

[0093] Referring to Fig. 6a, in the case where the left eye is normal and the right eye is strabismus, there is a stereoscopic stimulus at the top and a planar stimulus at the bottom of the first stimulus plate for the left eye, and there is a stereoscopic stimulus at the top and a planar stimulus at the bottom of the second stimulus plate for the right eye. At this time, as described above, the center of the first stimulus plate is based on 0°, and the center of the second stimulus plate is based on k°. The processor (15) can move the stereoscopic stimulus included in the second stimulus plate to the left by 0.444° from k° to provide a sense of three-dimensionality of the stereoscopic stimulus. Through this, the trainee can compare the stereoscopic stimulus with a sense of three-dimensionality of -0.444° and the planar stimulus when viewed binocularly.

[0094] Fig. 6b illustrates a case where the left eye is strabismus and the right eye is normal. Referring to Fig. 6b, a stereoscopic stimulus is provided at the top of the first stimulus plate for the left eye and a planar stimulus is provided at the bottom, and a stereoscopic stimulus is provided at the top of the second stimulus plate for the right eye and a planar stimulus is provided at the bottom. At this time, the center of the first stimulus plate is based on k°, and the center of the second stimulus plate is based on 0°. The processor (15) can move the stereoscopic stimulus included in the first stimulus plate by 0.444° to the right from k° for the stereoscopic effect of the stereoscopic stimulus. Through this, the trainee can compare the stereoscopic stimulus with the planar stimulus applied with a stereoscopic effect of +0.444° when viewed with both eyes.

[0095] Referring to Figure 7, as the stereoscopic effect level increases, the arcsec unit value representing the stereoscopic effect decreases. Here, 1600 arcsec is 0.444°. In other words, as the arcsec unit value decreases according to the stereoscopic effect level, the angle at which the stereoscopic stimulus included in the stimulus plate moves for the strabismus eye decreases, thereby increasing the difficulty level.

[0096] The way the stimulus's three-dimensionality is set can be a fundamental factor in determining the difficulty of training. In other words, after setting the stimulus's difficulty through three-dimensionality, the remaining methods can be applied to fine-tune the difficulty.

[0097] The shape setting of the above stimulus is a method of controlling the difficulty level through the shape of the stimulus. Here, the shape of the stimulus can be implemented in various ways, such as a heart, star, circle, tree, rabbit, elephant, fish, house, butterfly, or car.

[0098] The stereoscopic and planar stimuli for training can have the same shape. For example, both the stereoscopic and planar stimuli can be shaped like rabbits. However, this is not limited to this, and the shapes of the stereoscopic and planar stimuli can be set differently.

[0099] In one embodiment, the difficulty of setting the shape of a stimulus may increase as the shape lacks symmetry. Specifically, training images with vertical and horizontal symmetry (e.g., a circle) are relatively easier to perceive three-dimensionality than images with only vertical or horizontal symmetry (e.g., a star shape, a heart shape, a tree shape, a butterfly shape), or training images without symmetry (a rabbit shape, an elephant shape, a fish shape, a house shape, a car shape). In this regard, the processor (15) may set the difficulty to gradually increase in the order of 'training images with vertical and horizontal symmetry - images with vertical symmetry or images with horizontal symmetry - images without symmetry.'

[0100] Depending on the embodiment, the stimulus shape setting method, along with the stimulus three-dimensionality setting method, may be a fundamental factor that significantly determines the training difficulty. That is, after the stimulus difficulty is set fundamentally through the three-dimensionality setting and the shape setting, the remaining methods can be applied to fine-tune the difficulty.

[0101] The above-mentioned stimulus spacing setting is a method for adjusting the difficulty level by adjusting the distance between the first stimulus and the second stimulus. Specifically, the greater the distance between the first stimulus and the second stimulus, the higher the difficulty level. This is a method for increasing the difficulty level of training by setting the distance between stimulus objects within the stimulus board farther away, as the closer the three-dimensional stimulus and the planar stimulus are, the more likely the trainee is to perceive a difference in three-dimensionality.

[0102] The background color setting of the above stimulus is a method of adjusting the difficulty level by adjusting the background color of the stimulus plate. Specifically, the greater the difference between the background color of the stimulus plate and the colors of the first and second stimuli, the higher the difficulty level.

[0103] In one embodiment, the processor (15) can set the color of the portion of the first and second stimulus plates, excluding the first and second stimuli, to a color (e.g., a complementary color) that is in contrast to the colors of the first and second stimuli. Accordingly, the trainee can feel a greater sense of three-dimensionality of the stimulus.

[0104] Conversely, the processor (15) can set the color of the portion of the first and second stimulus plates excluding the first and second stimuli to a color similar to the colors of the first and second stimuli (e.g., a color of the same series).

[0105] In another embodiment, the processor (15) may provide the background colors of the first and second stimulus plates in a form that includes a pattern rather than a solid color. Depending on the similarity between the background pattern and the color of the stimulus, the background color containing the pattern may serve as a hint or a distraction during training. The more similar the background pattern and the color of the stimulus, the more difficult the trainee will experience during training. On the other hand, the greater the difference between the background pattern and the color of the stimulus, the greater the three-dimensionality the trainee will experience.

[0106] The difficulty of the above stimulus boundary setting can be adjusted through boundary setting based on the first method or the second method.

[0107] Here, the first method may be a method of setting a border for each of the first stimulus and the second stimulus. Referring to Fig. 8a, the processor (15) may set individual borders for each of the first stimulus and the second stimulus included in each of the first stimulus plate and the second stimulus plate.

[0108] The second method may be a method of setting a border including the first stimulus and the second stimulus. Referring to Fig. 8b, the processor (15) may set a border to encompass the first stimulus and the second stimulus, or may set a border on the stimulus plate itself.

[0109] Specifically, the way to set the border of the stimulus may be such that, when the border is set by the first method, the greater the distance between the border set for the first stimulus and the first stimulus and the distance between the border set for the second stimulus and the second stimulus, the higher the difficulty; and, when the border is set by the second method, the greater the distance between the border set to include the first and second stimuli and the first and second stimuli, the higher the difficulty.

[0110] This method creates the effect of forming a plane at a specific distance within the virtual space through the border, making it easy to judge whether or not an object (stimulus) has a three-dimensional effect based on the plane of the border, rather than feeling like it is floating in the air.

[0111] The first method described above is a good way to check how much three-dimensionality a stimulus has from a flat surface, and the second method described above is a good way to compare the three-dimensionality between a stereoscopic stimulus and a flat stimulus. In other words, the first method is a way to compare the three-dimensionality of stimuli within a flat surface (stimulus plate) with that of a flat surface, and the second method is a way to check how much more three-dimensionality each stimulus has compared to the flat surface (stimulus plate).

[0112] According to an embodiment, when the first method is followed when generating a border, the processor (15) can set a minimum border formation condition based on the angle for setting the three-dimensional effect, and apply the minimum border formation condition when setting the border of the stimulus.

[0113] Referring to Fig. 9, when setting individual borders for each stimulus, since the border does not have a three-dimensional effect while the object (stimulus) within the border must have a three-dimensional effect, the border of the three-dimensional stimulus is output as is at the position of the astigmatism angle (k°), and the three-dimensional stimulus can be output by moving it by a distance corresponding to the angle for forming a three-dimensional effect. At this time, if the three-dimensional stimulus invades the border, when the object is fused by the two eyes, the input stimulus is abnormally perceived as extending beyond the border, which may cause a situation in which trainees can easily distinguish the three-dimensional stimulus. To prevent this situation, the minimum border formation condition is set.

[0114] That is, since the training difficulty becomes easier the closer the border is to the stimulus object, the minimum border formation condition is set according to the three-dimensional effect stage. For example, when setting the three-dimensional effect, if the three-dimensional effect stage is set to level 1 and the three-dimensional stimulus is moved by a distance of 0.444° (1600 arcsec), the processor (15) can set the minimum border formation condition to ensure that the stimulus object and the border are separated by at least a distance of 0.444° based on k°.

[0115] According to the embodiment, the processor (15) finely adjusts the difficulty by adjusting the distance from the center of the stimulus object to the border, but the distance from the center to the border must be set to a value that satisfies the minimum border formation condition.

[0116] According to an embodiment, the processor (15) may change the minimum border formation condition according to a change in the size of the stimulus object. That is, as the size of the stimulus object increases, the minimum border formation condition (minimum distance from the center to the border) may also increase.

[0117] Meanwhile, the processor (15) can set the priority of the interval setting of the stimulus, the border setting of the stimulus, and the background color setting of the stimulus using an artificial intelligence model that has learned the training results of other trainees.

[0118] That is, the processor (15) can set the basic difficulty of training by setting the three-dimensionality of the stimulus and the shape of the stimulus, and can adjust the detailed difficulty by setting the interval of the stimulus, setting the background color of the stimulus, and setting the border of the stimulus.

[0119] At this time, the priorities for setting stimulus intervals, stimulus background colors, and stimulus borders can be predicted using an AI model based on the previous training performance results of multiple trainees. In other words, the AI ​​model, which has learned which difficulty adjustments resulted in the most effective training outcomes based on the previous training performance results of multiple trainees, determines the priorities to apply to each trainee. Specifically, the AI ​​model can predict priorities appropriate for the current trainee's condition by considering the previous training performance results of other trainees and the current trainee's characteristics (age, degree of strabismus, training period, etc.).

[0120] The processor (15) sets the basic difficulty of training by setting the three-dimensionality and shape of the stimulus as described above, and then sets the interval, background color, and border of the stimulus according to priority while keeping the three-dimensionality and shape of the stimulus fixed, thereby allowing the training difficulty to be adjusted in detail in a manner suitable for the trainee.

[0121] Meanwhile, the processor (15) can provide stereoscopic training by providing a third stimulus based on auditory or tactile sensation in a form associated with the first stimulus (stereoscopic stimulus).

[0122] Specifically, the processor (15) can provide a third stimulus below the threshold (e.g., an auditory stimulus or a tactile stimulus below a level that the patient can perceive). By providing stimuli from other senses in addition to visual stimuli, training can be performed at a higher level of difficulty and with higher training accuracy than when stereopsis training is performed solely through visual stimuli.

[0123] Although FIG. 2 describes the steps as being executed sequentially, this is merely an example of the technical idea of ​​the present embodiment, and a person having ordinary skill in the technical field to which the present embodiment belongs can modify and apply various modifications and variations by changing the order described in FIG. 2 or executing them in parallel without departing from the essential characteristics of the present embodiment, and therefore FIG. 2 is not limited to a chronological order.

[0124] Meanwhile, in the above description, the steps described in FIG. 2 may be further divided into additional steps or combined into fewer steps, depending on the implementation example of the present disclosure. Furthermore, some steps may be omitted as needed, and the order of the steps may be changed.

[0125] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

[0126] Computer-readable storage media include all types of storage media that store instructions that can be deciphered by a computer. Examples include read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disks, flash memory, and optical data storage devices.

[0127] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present disclosure can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. Display module; A memory storing at least one process for improving strabismus based on stereoscopic training; and A processor that generates a first stimulus plate for the normal eye among the two eyes of the trainee and a second stimulus plate for the strabismus among the two eyes, and provides the stereoscopic vision training by adjusting the difficulty of the first stimulus among the plurality of stimuli included in each of the first stimulus plate and the second stimulus plate; A device for providing stereoscopic vision training based on visual perception learning, wherein the above difficulty adjustment is performed through at least one of setting the three-dimensionality of the stimulus, setting the shape of the stimulus, setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus.

2. In paragraph 1, The above processor, A device for providing stereopsis training based on visual perception learning, which determines the angle of strabismus of the above-mentioned strabismus through an evaluation of the above-mentioned strabismus of the above-mentioned trainee, and sets the positions of the first stimulus plate and the second stimulus plate within the image for stereopsis training based on the angle of strabismus.

3. In paragraph 2, A stereoscopic training device based on visual perception learning, wherein the positions of the first stimulus plate and the second stimulus plate within the image are set such that the center of the first stimulus plate and the center of the second stimulus plate differ by the angle of astigmatism on a line.

4. In paragraph 1, The three-dimensional setting of the above stimulus is a method in which the difficulty level is higher the smaller the distance that the first stimulus included in the second stimulus plate moves relative to the center of the second stimulus plate. A stereoscopic training device based on visual perception learning, in which the shape setting of the above stimulus is a method in which the difficulty level increases the less symmetrical the shape is.

5. In paragraph 4, The interval setting of the above stimulation is a method in which the difficulty increases as the distance between the first stimulus and the second stimulus among the plurality of stimuli increases. A device for providing stereoscopic vision training based on visual perception learning, wherein the background color setting of the above stimulus is such that the difficulty level increases as the background color differs less from the colors of the first stimulus and the second stimulus.

6. In paragraph 5, The setting of the boundary of the above stimulus is a method in which the difficulty level is higher the longer the distance between the boundary set by the first method or the second method and at least one of the first stimulus and the second stimulus is, The first method is to set a boundary for each of the first stimulus and the second stimulus, The second method is a stereoscopic training device based on visual perception learning, which sets a boundary including the first stimulus and the second stimulus.

7. In paragraph 6, The above processor, A stereoscopic training device based on visual perception learning, which sets a minimum border formation condition based on an angle for setting the above stereoscopic effect, and applies the minimum border formation condition when setting the border of the stimulus.

8. In paragraph 1, The above processor, A stereoscopic training device based on visual perception learning that sets priorities for setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus by using an artificial intelligence model that has learned the training results of other trainees.

9. In paragraph 1, The above processor, A stereoscopic training device based on visual perception learning, which provides stereoscopic training by providing a third stimulus based on auditory or tactile sensation in a form associated with the first stimulus.

10. In a method performed by a processor of a device, The step of the processor generating a first stimulus plate for the normal eye among the two eyes of the trainee and a second stimulus plate for the strabismus among the two eyes; and The step of providing stereoscopic vision training by adjusting the difficulty of a first stimulus among a plurality of stimuli included in each of the first stimulus plate and the second stimulus plate is included; A method for providing stereoscopic vision training based on visual perception learning, wherein the above difficulty adjustment is performed through at least one of setting the three-dimensionality of the stimulus, setting the shape of the stimulus, setting the interval of the stimulus, setting the border of the stimulus, and setting the background color of the stimulus.

Images