Method and device for determining visual object distortion amount and storage medium
By using the gaze guide point and the pattern generated by the user input on the display screen, the problem of difficult to accurately determine the visual object distortion in the prior art is solved, and a convenient and efficient diagnostic process and high-precision diagnostic results are achieved. .
Patent Information
- Application Number
- CN202310703848.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-14
- Publication Date
- 2024-12-17
AI Technical Summary
The prior art is difficult to determine the amount of distortion of the visual object in a convenient and precise manner, resulting in low diagnostic efficiency and poor accuracy during the diagnosis and treatment process, and it is difficult for users to clearly describe the distorted state in the field of view.
By presenting the first pattern on the display screen and marking the gaze guide point, keeping the user's gaze guide point consistent, receiving user input to generate a second pattern, determining the amount of visual object distortion based on the two patterns, using eye tracking devices and touch control The screen enables accurate monitoring and drawing.
Users can quantify the distorted position, direction and degree in the field of vision by themselves. The diagnosis process is painless, simple to operate, comprehensive data and high calculation accuracy, which improves diagnostic efficiency and accuracy.
Smart Images

Figure CN119138837A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of quantitative evaluation of visual function, and more specifically to a method for determining the amount of visual distortion. The present invention also relates to a storage medium storing a computer program for implementing the method and a device for determining the amount of visual distortion. Background Art
[0002] In a normal human eye, the retina is tightly attached to the inner surface of the choroid and is very flat. When looking at an object, the image can be accurately and evenly projected onto the retina, so the human eye can see a clear image that is consistent with the actual shape of the object. The macula of the human eye is located in the center of the retina. The macula is the most sensitive area for vision and is home to a large number of visual function cells. For example, the cones responsible for vision and color vision are distributed in the macula, which can recognize most optical signals such as shape, size, color, depth, and distance. Therefore, the macula is an important part that determines visual function. There is a depression in the center of the macula, called the fovea, which is the area on the retina with the sharpest and most accurate vision.
[0003] Certain diseases can cause lesions in the macular area of the retina. For example, macular degeneration and diabetic retinopathy caused by diabetes may cause edema, new blood vessels, and bleeding scars in the macular area of the retina. Most of the lesions are centered on the fovea and are located within a radius of 1 optic disc diameter (1PD), which manifests as retinal deformation. The deformed area of the retina will cause the image of the object to not be projected on the original position of the retina when the human eye looks at the object, but at a peripheral position that is offset from the original position. In this way, the user's subjective feeling is that the object seen is distorted. For users, retinal deformation and visual distortion (also called metamorphosia) bring varying degrees of pain and pressure to the physical, psychological, economic and other aspects, and reduce the quality of life.
[0004] When the above-mentioned user seeks medical treatment, it is difficult for the user to clearly describe to the doctor the specific state of the distortion of the image in the field of vision based only on the user's subjective feelings. It is difficult for the user to let the doctor know the specific state of the distortion by language alone, such as the location, direction and degree of the distortion. In addition, the distortion in the user's field of vision occurs in multiple places in most cases, which further increases the difficulty for the user to describe the state of visual distortion to the doctor.
[0005] Therefore, there is an urgent need for a method to conveniently and accurately determine the amount of visual distortion of a user, so as to provide a reference for diagnosis and treatment. Summary of the invention
[0006] The object of the present invention is to at least alleviate or solve the above-mentioned problem by providing a method and device for determining the amount of visual distortion and a storage medium.
[0007] According to one aspect of the present invention, there is provided a method for determining the amount of visual distortion, comprising: presenting a first pattern to a user on a display screen and marking a gaze guide point in the first pattern, wherein the gaze guide point is fixed relative to the first pattern; keeping the user's gaze point consistent with the gaze guide point; receiving user input to generate a second pattern on the display screen, wherein the second pattern is drawn by the user with reference to the first pattern and the user's own visual perception is that no distortion has occurred; and determining the amount of visual distortion of the user based on the second pattern and the first pattern.
[0008] Preferably, a guiding mark is provided at the gaze guiding point.
[0009] Preferably, the guide mark has a shape of a dot, a circle or a cross, and / or the guide mark has a preset color or has a flashing display effect.
[0010] Preferably, keeping the user's gaze point consistent with the gaze guide point includes: monitoring the amplitude and direction of the user's gaze point moving on the display screen in real time, thereby controlling the first pattern and the gaze guide point to move on the display screen with the same amplitude and direction.
[0011] Preferably, keeping the user's gaze point consistent with the gaze guide point includes: monitoring the relative position of the user's gaze point and the gaze guide point in real time, and when the two are inconsistent, controlling the first pattern displayed on the display screen to disappear, and redisplaying the first pattern after the user's gaze point returns to the gaze guide point.
[0012] Preferably, real-time monitoring of the user's gaze point is performed by an eye tracking device.
[0013] Preferably, receiving user input to generate the second pattern on the display screen includes: the user manually draws on the display screen, and the pattern obtained by drawing is the second pattern.
[0014] Preferably, receiving user input to generate the second pattern on the display screen comprises: the user manually drags a portion of the first pattern that is visually perceived as distorted on the display screen, and the first pattern after dragging becomes the second pattern.
[0015] Preferably, the lines in the second pattern displayed on the display screen are different from the lines in the first pattern in at least one of the following aspects: color, line type, width.
[0016] Preferably, in the method for determining the amount of visual distortion, a user can selectively erase part or all of the second pattern.
[0017] Preferably, the display screen is a touch screen, and the user draws the second pattern on the display screen using a stylus pen.
[0018] Preferably, receiving user input to generate the second pattern on the display screen comprises: the user generates the second pattern on the display screen through an external input device connected to the display screen.
[0019] Preferably, the external input device is a mouse, a touch pad or a drawing tablet.
[0020] Preferably, the method for determining the amount of visual distortion further comprises: constructing a two-dimensional coordinate system on the display screen with the user's gaze point as the coordinate origin; and displaying the current two-dimensional coordinates of the control point of the external input device on the display screen in real time.
[0021] Preferably, the unit length of the two-dimensional coordinate system is equal to the length of the unit length on the display screen.
[0022] Preferably, a unit length of the two-dimensional coordinate system is equal to a length of a preset number of pixels on the display screen.
[0023] Preferably, the first pattern is an Amsler Grid, and the gaze guide point is a center point of the Amsler Grid.
[0024] Preferably, the horizontal lines and vertical lines in the second pattern are visually perceived as straight lines by the user, and each horizontal line and vertical line in the second pattern has an intersection or an overlapping line segment with a corresponding grid line in the Amsler grid.
[0025] Preferably, determining the visual distortion amount of the user includes: performing axisymmetric processing on each horizontal line and vertical line with the grid line of the Amsler grid according to the intersection points or coincident line segments of each horizontal line and vertical line with the grid line of the Amsler grid, thereby determining the visual distortion amount of the user.
[0026] Preferably, the method for determining the amount of visual distortion further includes: constructing a distortion set according to the first pattern and the second pattern, the distortion set including a plurality of distortion line pairs, each distortion line pair including a state before distortion and an axially symmetrical state of the same horizontal or vertical line, and the relative positional relationship between the two remains unchanged; and recording the position of each line in the first pattern.
[0027] Preferably, the distortion set is stored in the form of a picture.
[0028] Preferably, the number of horizontal and vertical lines in the Amsler grid, the interval between adjacent horizontal lines, and the interval between adjacent vertical lines are set and adjusted by a user.
[0029] According to another aspect of the present invention, a storage medium is provided, on which a computer program is stored, wherein when the computer program is executed by a processor, the method for determining the amount of visual distortion as described above is implemented.
[0030] According to yet another aspect of the present invention, there is provided an apparatus for determining the amount of visual distortion, comprising: a gaze point monitoring module, a display module, an interaction module, a processor and a storage medium, wherein the gaze point monitoring module is used to monitor the gaze point of a user on the display module, the interaction module is used to receive the user's input, the display module is used to display a first pattern and a second pattern generated based on the user's input, the storage medium stores a computer program, and when the computer program is executed by the processor, the method for determining the amount of visual distortion as described above is implemented.
[0031] By means of the above technical solution of the present invention, at least the following beneficial technical effects can be achieved:
[0032] According to the embodiments of the present invention, the user can perform the operation by himself to quantitatively output the distortion position, direction and degree of all visual distortions within his field of vision without the help of medical personnel or other persons, and the diagnosis process is painless, simple to operate, outputs comprehensive data, has high calculation accuracy and high automation, which greatly improves the diagnosis efficiency and accuracy of users with visual distortion, reduces the investment in manpower and equipment in the diagnosis process, and has high promotion and application value and broad market prospects. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:
[0034] Figure 1 The Amsler grid is shown for normal vision and abnormal vision caused by macular lesions;
[0035] Figure 2 is a flow chart of a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0036] Figure 3 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0037] Figure 4 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0038] Figure 5 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0039] Figure 6is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0040] Figure 7 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0041] Figure 8 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention;
[0042] Fig. 9 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention; and
[0043] Fig.10 is a schematic block diagram of an apparatus for determining an amount of visual distortion according to an embodiment of the present invention. DETAILED DESCRIPTION
[0044] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the invention are shown in the accompanying drawings.
[0045] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0046] Figure 1 The Amsler grid is shown with normal vision and abnormal vision caused by macular degeneration.
[0047] Users can use the Amsler grid printed on paper for qualitative self-examination. Doctors also often use the Amsler grid to assist in diagnosing whether the user has visual distortion and the degree of visual distortion. The original form of the Amsler grid was a grid with black lines on a white background. The grid includes horizontal and vertical lines to present small squares arranged in a regular pattern, such as 20×20 small squares with a side length of 5 mm. There is generally a black dot in the center of the grid. When in use, the user places the Amsler grid about 30 cm away from the eye along the line of sight, and according to the user's usual reading habits (users who usually wear glasses still need to wear glasses), cover one eye and look at the central black dot with the other eye. At this time, all the squares correspond exactly to the core area of the user's retinal macular area, corresponding to a total of 20° viewing angle, that is, each small square corresponds to 0.5° viewing angle.
[0048] Normal users see the Amsler grid as clear, undistorted horizontal and vertical lines, such as Figure 1However, for users with retinal deformation, the horizontal and vertical black lines in the Amsler grid may be wavy, that is, the visual object is distorted, as shown in Figure 2. Figure 1 as shown on the right.
[0049] When using the Amsler grid for testing, users can only tell the approximate location, direction and degree of their visual distortion, which is highly subjective and difficult to quantify in detail the specific location, direction and degree of their visual distortion. This is not conducive to doctors giving accurate diagnosis results and providing specific and targeted treatment plans.
[0050] The inventors noticed that a study proposed a reverse approach, which no longer requires users to describe the location, direction, and degree of visual distortion, but still provides users with an Amsler grid, and requires users to draw lines in the grid that their own visual perception is not distorted. Under this approach, the greater the degree of visual distortion of the user, the greater the actual degree of distortion of the lines that the user re-draws for their own visual perception as being not distorted. The re-drawn lines can provide detailed information on the location, direction, and degree of visual distortion, thereby helping doctors make diagnoses.
[0051] However, the inventors found that this idea has the following difficult-to-overcome technical problems. The line connecting the fovea and the center of the pupil is called the visual axis, which is the actual gaze direction of the human eye, and the gaze point is called the gaze point. Based on the imaging principle and physiological characteristics of the human eye, the imaging of the fovea area is the clearest, while the peripheral peripheral light area is unclear. Therefore, when the human eye looks at an object, in order to make the point to be seen clearly imaged on the fovea, the visual axis will involuntarily move to the point to be seen clearly, thereby changing the gaze point. For the above reasons, if the grid is printed on a static paper and one of the intersections of the horizontal and vertical lines is designated as the user's gaze point, and the user is asked to gaze at the gaze point, then for the user, the horizontal and vertical lines around the gaze point will be distorted. At this time, if the user manually draws on the paper with a pen to obtain horizontal and vertical lines that appear to be non-distorted, then in the process of drawing, in order to draw accurately, the tip of the pen becomes the part that the user wants to see clearly, so the gaze point will involuntarily follow the movement of the pen tip. However, once the gaze point moves, the distortion position of each horizontal and vertical line seen by the user will also change, just as the distortion pattern moves on the paper as the gaze point moves. This makes it impossible to accurately draw the horizontal and vertical lines that the user's own visual perception is not distorted.
[0052] The inventors note that there are also studies proposing a head-mounted visual assistance system for visually impaired users. In this head-mounted visual assistance system, the user is made to produce a normal image through image deformation, such as displaying a grid in the glasses, allowing the user to adjust it by themselves so that each line appears to the user to be straight, and then the image captured by the camera is deformed by image processing. Since glasses, like paper, are both static and fixed carriers, the method of "displaying a grid in the glasses and allowing the user to adjust it by themselves" described above is the same principle as allowing the user to adjust the horizontal and vertical lines on paper with a pen. Since it is impossible to force the user's gaze point to be fixed, and at the same time require the user to draw the grid lines that his or her own visual perception is not distorted, this head-mounted visual assistance system is also difficult to work in actual implementation.
[0053] In summary, the inventors realize that how to enable users to conveniently and accurately draw horizontal and vertical lines in the Amsler grid that are not distorted according to their own visual perception, so as to provide a reference for doctors in diagnosis and treatment, is a problem that urgently needs to be solved.
[0054] Figure 2 is a flowchart of a method 100 for determining an amount of visual distortion according to an embodiment of the present invention, and Figure 3 is a schematic diagram for explaining a method for determining a visual distortion amount according to an embodiment of the present invention. Figure 2 As shown, and combined Figure 3 , the method 100 for determining the visual distortion amount according to an embodiment of the present invention includes the following steps.
[0055] S110: presenting a first pattern P1 to the user on the display screen 10 and marking a gaze guide point 20 in the first pattern P1, where the gaze guide point 20 is fixed relative to the first pattern P1;
[0056] S120: Keep the user's gaze point 40 consistent with the gaze guide point 20;
[0057] S130: receiving a user input to generate a second pattern P2 on the display screen 10, where the second pattern P2 is drawn by the user with reference to the first pattern P1 and the user's own visual perception is that no distortion occurs; and
[0058] S140: Determine the visual distortion amount of the user based on the second pattern P2 and the first pattern P1.
[0059] like Figure 3As shown, the user's gaze point 40 (indicated by "×") is consistent with the gaze guide point 20 on the first pattern P1, and the gaze guide point 20 is fixed relative to the first pattern P1, so the user's gaze point 40 is fixed relative to the first pattern P1. When the user draws the second pattern P2 on the display screen 10 with reference to the first pattern P1, the gaze point 40 remains fixed relative to the first pattern P1, so the distorted position of the first pattern P1 remains fixed during the drawing of the second pattern P2. This enables the user to accurately draw the second pattern P2, thereby realizing a convenient and accurate method for determining the amount of visual distortion of the user.
[0060] According to an embodiment of the present invention, a method is provided for allowing a user to determine the amount of visual distortion. The difference from the prior art is that the carrier for the user to generate the second pattern is no longer a static, fixed paper surface, but a display screen. It should be noted that in the context of this application, the amount of distortion refers to the position, direction, and degree of distortion of all visual distortions within the user's field of view.
[0061] As a non-limiting example, Figure 3 As shown, the first pattern P1 may be a conventional Amsler grid, that is, a grid with black lines on a white background, and includes 20×20 small squares with a side length of 5 mm defined by transverse lines and longitudinal lines. Figure 3 As shown, the Amsler grid is displayed on the display screen 10 for eye detection, and the detection requirements are the same as those of the conventional method. For example, when the user is tested, the distance between the eye and the display screen 10 is a fixed value of about 30 cm, and the distance is the fixed value for each subsequent detection. The fixed value is related to the size of the Amsler grid displayed on the display screen 10. The principle is that the size of the Amsler grid is similar to the central visual field range. At the same time, the center of the Amsler grid is at the same height as the human eye.
[0062] It should be noted that the first pattern P1 may be any regular shape that can detect the user's visual distortion.
[0063] like Figure 3 As shown, the gaze guide point 20 can be set at the center of the first pattern P1, that is, the gaze guide point 20 can be located at the center point of the Amsler grid. The first pattern P1 can be set at the central position of the display screen 10, and the center of the first pattern P1 coincides with the center of the display screen 10. It should be noted that the first pattern P1 can be presented at any position on the display screen 10, as long as the user can fully see the first pattern P1 on the display screen 10 and draw the second pattern P2 with reference to the first pattern P1. In addition, the gaze guide point 20 can be set at a non-central position of the first pattern P1, as long as the gaze guide point 20 is fixed relative to the first pattern P1.
[0064] According to an embodiment of the present invention, a guide mark 30 may be provided at the gaze guide point 20. Figure 3 In the non-limiting example shown, the guide mark 30 has the shape of a dot. However, in some examples, the guide mark 30 may have a circle, a cross, or any other shape that can attract the user's gaze point. In other examples, the guide mark 30 may also have a preset color, for example, a striking color such as red or yellow. In some other examples, the guide mark 30 may also have a flashing display effect, such as a flashing bright spot, or a character (such as a letter or a number) that flashes at a preset time interval, thereby suppressing the Troxler effect and maintaining the user's gaze point.
[0065] Figure 4 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention, and Figure 5 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention.
[0066] According to an embodiment of the present invention, step S120 may include: monitoring in real time the amplitude and direction of movement of the user's gaze point 40 on the display screen 10, thereby controlling the first pattern P1 and the gaze guide point 20 to move to the same amplitude and direction on the display screen 10. In this embodiment, the center coordinates of the first pattern P1 (i.e., the coordinates of the gaze guide point 20) are set as the user's gaze point 40 on the display screen 10.
[0067] Combined here Figure 4 and Figure 5 This embodiment is described. When the user's gaze point 40 is not located at the center of the first pattern P1 and moves to Figure 4 When the user's gaze point 40 is at the position shown in FIG. 1 , the gaze point 40 of the user is inconsistent with the gaze guide point 20. This inconsistency is monitored in real time. For example, the amplitude and direction of the movement of the gaze point 40 on the display screen 10 can be determined based on the coordinates of the current gaze point 40. Then, as shown in FIG. Figure 5 As shown, based on the determined movement amplitude and direction of the gaze point 40, the first pattern P1 and the gaze guide point 20 and the second pattern P2 drawn by the user are moved on the display screen 10. Through the above operation, the user's gaze point 40 is kept consistent with the gaze guide point 20.
[0068] In this embodiment, the first pattern P1 and the gaze guide point 20 move on the display screen 10 following the movement of the user's gaze point 40. The coordinate movement direction and movement amount of the first pattern P1 and the gaze guide point 20 are the same as the coordinate movement direction and movement amount of the user's gaze point 40. In this embodiment, the effect presented is that the user uses his own gaze point 40 to control the movement of the first pattern P1 and the gaze guide point 20 on the display screen 10. On this basis, the user draws the second pattern P2 on the display screen 10 that the user's own visual perception is not distorted, and the second pattern P2 drawn by the user is based on the current first pattern P1. When the first pattern P1 and the gaze guide point 20 move following the gaze point 40, the second pattern P2 drawn by the user moves in the same direction by the same amount.
[0069] Figure 6 is a schematic diagram for explaining a method for determining an amount of visual distortion according to an embodiment of the present invention.
[0070] According to an embodiment of the present invention, step S120 may include: real-time monitoring of the relative positions of the user's gaze point 40 and the gaze guiding point 20, and when the two are inconsistent, controlling the first pattern P1 displayed on the display screen 10 to disappear, until the user's gaze point 40 returns to the gaze guiding point 20 and then redisplaying the first pattern P1.
[0071] Combined here Figure 4 and Figure 6 This embodiment is described. When the user's gaze point 40 is not located at the center of the first pattern P1 and moves to Figure 4 When the user's gaze point 40 is at the position shown in FIG. 2 , the user's gaze point 40 is inconsistent with the gaze guide point 20. This inconsistency is monitored in real time. For example, when it is monitored in real time that the user's gaze point 40 is inconsistent with the gaze guide point 20, the first pattern P1 displayed on the display screen 10 can be made to disappear, such as Figure 6 When the user has started to draw the second pattern P2, the second pattern P2 also disappears on the display screen 10. At this time, the guide mark 30 is still displayed at the gaze guide point 20 on the display screen 10 to attract the user's gaze point 40. Figure 4 As shown, after the user's gaze point 40 returns to the gaze guide point 20, the first pattern P1 and the second pattern P2 previously drawn by the user are redisplayed on the display screen 10. Through the above operations, the user's gaze point 40 is consistent with the gaze guide point 20.
[0072] According to the present embodiment, the center of the first pattern P1 (e.g., Amsler grid) on the display screen 10 is set as the gaze point 40 for the user to gaze at. In the present embodiment, the first pattern P1 and the gaze guide point 20 displayed on the display screen 10 remain stationary relative to the display screen 10, and the gaze point 40 is fixed relative to the first pattern P1, and the user manually draws the second pattern P2 that his or her own visual perception is not distorted. In the present embodiment, once the eye tracking device 50 detects that the user's gaze point 40 deviates from the preset gaze guide point 20 located at the center of the first pattern P1, the first pattern P1 on the display screen 10 and the second pattern P2 previously drawn by the user disappear, and the guide mark 30 of the gaze guide point 20 plays a role of visual guidance, which is used to guide the user's gaze point 40, until the user's gaze point 40 returns to the preset gaze guide point 20, the first pattern P1 reappears, and the second pattern P2 previously drawn by the user also reappears. In the present embodiment, the user is forced to draw the second pattern P2 with the peripheral vision of the eye.
[0073] like Figures 3 to 6 As shown, according to an embodiment of the present invention, real-time monitoring of the user's gaze point 40 can be performed by an eye tracking device 50. The eye tracking device 50 is arranged on the display screen 10, facing the user, and is used to monitor the user's gaze point 40 on the display screen 10 in real time. The eye tracking device 50 may include an image collector for acquiring an eye image of the user, and in some cases may also include a light source. The light source may be an infrared light source or a visible light source, and accordingly, the image collector is an image collector operating in a corresponding spectral range, such as a camera. The eye tracking device 50 acquires the user's eye image to perform line of sight tracking, thereby determining the user's gaze point 40 on the display screen 10. The eye tracking device 50 may be integrated with the display screen 10, for example, as Figures 3 to 6 As shown, the eye tracking device 50 can be set below the display screen 10. It should be noted that the embodiment of the present invention does not limit the position and specific number of the eye tracking device 50 relative to the display screen 10. The eye tracking device 50 can be set above the display screen 10 or on both sides of the display screen 10. In addition, the eye tracking device 50 can be set separately from the display screen 10, as long as the eye tracking device 50 can obtain the user's eye image and monitor the user's gaze point in real time based on the eye image.
[0074] According to an embodiment of the present invention, step S130 may include: a user manually draws on the display screen 10, and the pattern drawn is the second pattern P2. That is, the user manually generates a new second pattern P2 on the display screen 10. In this embodiment, for the convenience of user observation, the lines in the second pattern P2 displayed on the display screen 10 are different from the lines in the first pattern P1 in at least one of the following: color, line type, and width. In some examples, the color of the first pattern P1 displayed on the display screen 10 is different from the color of the second pattern P2 drawn by the user himself. In other examples, the line width of the first pattern P1 is different from the line width of the second pattern P2 drawn by the user himself, such as Figure 3 shown.
[0075] Alternatively, step S130 may include: the user manually drags the part of the first pattern P1 that is visually perceived as distorted on the display screen 10, and the dragged first pattern P1 becomes the second pattern P2. In this embodiment, the user does not need to draw new lines in the Amsler grid, but adjusts the original lines in the Amsler grid. In this case, the touch structure of the display screen 10 can provide this function, or the corresponding application can provide this function, thereby facilitating user operation.
[0076] In step S130, after the user finally draws the second pattern P2, the second pattern P2 is output, for example, displayed in real time on the display screen 10, or output to a storage medium. It should be noted that the second pattern P2 is visually perceived by the user as not distorted. For example, when the first pattern P1 is an Amsler grid, the second pattern P2 drawn by the user based on the first pattern P1 is not distorted in the user's view, that is, the horizontal and vertical lines in the grid are not distorted. However, in the view of a user with normal vision, the second pattern P2 is distorted.
[0077] According to an embodiment of the present invention, the display screen 10 may be a touch screen. Figure 3 As shown, the display screen 10 is a touch screen, and the user uses the stylus 60 to draw the second pattern P2 on the display screen 10. The user can adjust the thickness of the tip of the stylus 60 according to actual needs before and during the operation. For example, multiple options for the thickness of the tip can be provided for the user to choose. In some examples, the user can enter his or her own vision value, and the thickness of the tip is recommended based on the vision value. Generally, the thickness of the tip of the stylus 60 needs to take into account the drawing accuracy and the user's ease of seeing clearly on the display screen 10. It should be noted that in the embodiment where the display screen 10 is a touch screen, the user can also draw the second pattern P2 directly on the display screen 10 with a finger.
[0078] According to an embodiment of the present invention, step S130 may include: the user generates a second pattern P2 on the display screen 10 through an external input device 70 connected to the display screen 10. As a non-limiting example, the external input device 70 may be a mouse, and the user manipulates the mouse to control the movement of a cursor 75 on the display screen 10, and accordingly draws the second pattern P2, such as Figure 7 In other examples, the external input device 70 may also be any input device that can be operated by a user to generate the second pattern P2, such as a touch pad, a drawing board, etc.
[0079] According to an embodiment of the present invention, the user can selectively erase part or all of the second pattern P2. When the second pattern P2 drawn by the user is inaccurate, the user can use this function to modify the second pattern P2.
[0080] According to an embodiment of the present invention, the method 100 for determining the amount of visual distortion may further include: constructing a two-dimensional coordinate system on the display screen 10 with the user's gaze point 40 as the coordinate origin; and displaying the current two-dimensional coordinates of the control point of the external input device 70 on the display screen 10 in real time.
[0081] In this embodiment, a two-dimensional plane coordinate system is constructed on the display screen 10, and the user's gaze point corresponds to the coordinate origin of the coordinate system. The two-dimensional plane coordinate system constructed in the above manner does not need to be displayed on the display screen 10. In addition, the purpose of setting the two-dimensional plane coordinate system is to be used for subsequent quantitative calculation of the visual distortion amount, for example, by calculating the offset between the corresponding lines of the second pattern P2 and the first pattern P1 through coordinate calculation, thereby calculating the visual distortion amount.
[0082] In this embodiment, the current two-dimensional coordinates of the control point of the external input device 70 are displayed in real time on the display screen 10. Figure 7 As shown, after the user has drawn the second pattern P2, in the subsequent calculation stage, the two-dimensional coordinates corresponding to the point to which the cursor 75 moves under the control of the mouse are displayed on the display screen 10. This function facilitates doctors or researchers to understand the specific numerical value of visual distortion.
[0083] According to an embodiment of the present invention, the unit length of the two-dimensional coordinate system can be equal to the length of the unit length on the display screen 10. For example, assuming that the coordinate system is in centimeters, one centimeter displayed on the display screen 10 is the unit length of the coordinate system. In this case, the difference in the calculated coordinates is the offset value of the line, so that the amount of calculation when determining the visual distortion amount by this method is relatively small. It should be noted that in this embodiment, the accuracy of the coordinate system is related to the resolution of the display screen 10, and therefore the unit length of the coordinates needs to be defined according to the resolution of the display screen 10.
[0084] According to an embodiment of the present invention, the unit length of the two-dimensional coordinate system can be equal to the length of a preset number of pixels on the display screen 10. In this embodiment, the unit length of the coordinate system is not limited, but the number of pixels corresponding to the unit length of the coordinate system and the size value of a single pixel point need to be known. In this case, after calculating the difference in coordinates, multiplying by the number of pixels corresponding to the unit length and the size value of a single pixel point, the offset value between the corresponding lines of the second pattern P2 and the first pattern P1 can be obtained. In this embodiment, the calculation accuracy complies with the accuracy of the resolution of the display screen 10, but the amount of calculation is relatively large.
[0085] According to an embodiment of the present invention, the first pattern P1 may be an Amsler grid, and the horizontal and vertical lines in the second pattern P2 drawn by the user with reference to the Amsler grid are perceived as straight lines by the user's own vision, and each horizontal and vertical line in the second pattern P2 has intersections or overlapping line segments with the corresponding grid lines in the Amsler grid. In this embodiment, each horizontal and vertical line drawn by the user has intersections with the original horizontal and vertical lines in the Amsler grid, which makes it possible to determine which line in the Amsler grid a certain line drawn by the user actually corresponds to. Generally speaking, the user's visual distortion does not exist in the entire visual field but exists in a scattered manner, and the drawn lines almost always have segments where no visual distortion occurs and must have intersections with the original lines.
[0086] According to an embodiment of the present invention, step S140 may include: according to the intersection or coincident line segments of each horizontal line and vertical line with the grid lines of the Amsler grid, each horizontal line and vertical line is subjected to axisymmetric processing with the corresponding grid lines as the axis, thereby determining the amount of visual distortion of the user. Specifically, if the user's vision is distorted downward, the lines drawn by the user that appear to be undistorted must be bent upward compared to the actual straight line, so that they will appear to be straight lines after the user's own pathological vision is bent downward, and the distortion amplitude drawn by the user is equal to the degree of distortion of the actual vision. The principle of lines distorted in the left and right directions is the same. It should be noted that the user's visual distortion in the horizontal direction will only appear in the lines drawn in the vertical direction, and the user's visual distortion in the vertical direction will only appear in the horizontal lines drawn by the user. In short, for the second pattern P2 drawn by the user, it is necessary to reverse it based on the intersection and the original line direction as the axis, specifically, for the horizontal lines, perform up and down axisymmetric reversal (vertical reversal), and for the vertical lines, perform left and right axisymmetric reversal. As a non-limiting example, Figure 8 As shown, the line of the second pattern P2 drawn by the user extends in the horizontal direction as a whole, and is partially distorted in the vertical direction. In this case, the line is symmetrically reversed vertically with the corresponding horizontal line of the Amsler grid that partially overlaps with the line as the axis, thereby obtaining a distorted line P2' including visual distortion information.
[0087] According to an embodiment of the present invention, the method 100 for determining the amount of visual distortion may further include: constructing a distortion set according to the first pattern P1 and the second pattern P2, the distortion set including a plurality of distortion line pairs, each distortion line pair including a state before distortion and an axially symmetrical state of the same horizontal or vertical line, and the relative position relationship between the two remains unchanged; and recording the position of each line in the first pattern P1.
[0088] In the present embodiment, after the user has finished all the drawing, a distortion set is constructed according to the Amsler grid and the lines drawn by the user, and a plurality of distorted line pairs are included in this distortion set, and each distorted line pair includes the state before the same line is distorted (to facilitate the subsequent alignment of the lines to compare the distortion amount before and after, and the entire length of the line from the starting point to the end point needs to be preserved) and the state after the reversal and keep the original relative position relationship between the two unchanged, and record the specific position of the line in the Amsler grid (which horizontal line / vertical line) at the same time. This distortion set can be stored in the form of a picture, to facilitate the comparison during the subsequent follow-up visit of the user, to judge the disease progression and the therapeutic effect of the user. In addition, this is convenient for the subsequent comparison of the distortion variation of a single line, and is thus more suitable for the situation where distortion is only distributed in certain lines.
[0089] In this embodiment, the lines drawn by the user can be reversed and saved as a whole, and the origin position needs to be recorded so that the origin can be used as the basis for alignment during comparison. This facilitates overall comparison and is more suitable for the situation where multiple horizontal and vertical lines are distorted.
[0090] According to an embodiment of the present invention, the size of the Amsler grid may be large enough to ensure that the user can identify the correspondence between the lines drawn by the user and the lines in the original Amsler grid table based on the partially undistorted horizontal and vertical lines.
[0091] According to an embodiment of the present invention, the number of horizontal and vertical lines in the Amsler grid, the interval between adjacent horizontal lines, and the interval between adjacent vertical lines are set and adjusted by the user. For example, the interval between the lines in the Amsler grid can be adjusted according to the visual distortion of the user. For users with large visual distortion, two sets of Amsler grids can be established, one set is centered on the intersection of the lines, and the other set is centered on the center of the square grid. The combination of the two sets of Amsler grids can double the detection accuracy.
[0092] In the embodiment of the present invention, Fig. 9 As shown, the user can set and adjust the number of horizontal and vertical lines in the first pattern P1, the interval between adjacent horizontal lines and the interval between adjacent vertical lines, so that the first pattern P1 is different from the conventional Amsler grid. In some examples, the first pattern P1 can preferably be spread over the entire display screen 10.
[0093] Although not shown, according to an embodiment of the present invention, there is further provided a storage medium on which a computer program is stored. When the computer program is executed by a processor, the method 100 for determining the amount of visual distortion according to the embodiment of the present invention described above is implemented.
[0094] Fig.10 is a schematic block diagram of an apparatus for determining an amount of visual distortion according to an embodiment of the present invention.
[0095] like Fig.10 As shown, according to an embodiment of the present invention, an apparatus 200 for determining the amount of visual distortion includes: a gaze point monitoring module 210, a display module 220, an interaction module 230, a processor 240, and a storage medium 250. The gaze point monitoring module 210 is used to monitor the gaze point of the user on the display module 220. The interaction module 230 is used to receive the user's input. The display module 220 is used to display a first pattern and a second pattern generated based on the user's input. The storage medium 250 stores a computer program, and when the computer program is executed by the processor 240, the method 100 for determining the amount of visual distortion according to the embodiment of the present invention described above is implemented.
[0096] It should be noted that Fig.10 The gaze point monitoring module 210 shown can be implemented as the eye tracking device 50 described in the above embodiment, the display module 220 can be implemented as the display screen 10 described in the above embodiment, and the interaction module 230 can be implemented as the stylus 60 or the external input device 70 described in the above embodiment, but the embodiment of the present invention is not limited thereto. In addition, in addition to the computer program, the storage medium 250 can also store other data content, such as data or input provided or generated by the gaze point monitoring module 210, the display module 220 and the interaction module 230, or any data generated in the above method 100 for determining the amount of visual distortion.
[0097] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.
Claims
1. A method for determining an amount of visual distortion, comprising: Presenting a first pattern to a user on a display screen and marking a gaze guide point in the first pattern, wherein the gaze guide point is fixed relative to the first pattern; Keeping the user's gaze point consistent with the gaze guide point; receiving a user input to generate a second pattern on the display screen, wherein the second pattern is drawn by the user with reference to the first pattern and the user's own visual perception is that no distortion occurs; as well as An amount of visual distortion of the user is determined based on the second pattern and the first pattern.
2. The method for determining the amount of visual distortion according to claim 1, wherein: A guiding mark is arranged at the gaze guiding point.
3. The method for determining the amount of visual distortion according to claim 2, wherein: The guide mark has a shape of a dot, a circle or a cross, and / or the guide mark has a preset color or has a flashing display effect.
4. The method for determining the amount of visual distortion according to claim 1, wherein: Keeping the user's gaze point consistent with the gaze guide point includes: monitoring the amplitude and direction of the user's gaze point moving on the display screen in real time, thereby controlling the first pattern and the gaze guide point to move on the display screen with the same amplitude and direction.
5. The method for determining the amount of visual distortion according to claim 1, wherein: Keeping the user's gaze point consistent with the gaze guide point includes: monitoring the relative position of the user's gaze point and the gaze guide point in real time, and when the two are inconsistent, controlling the first pattern displayed on the display screen to disappear, and redisplaying the first pattern after the user's gaze point returns to the gaze guide point.
6. The method for determining the amount of visual distortion according to claim 4 or 5, wherein: Real-time monitoring of the user's gaze point is carried out through an eye tracking device.
7. The method for determining the amount of visual distortion according to claim 1, wherein: Receiving user input to generate a second pattern on the display screen includes: the user manually draws on the display screen, and the pattern obtained by drawing is the second pattern.
8. The method for determining the amount of visual distortion according to claim 1, wherein: Receiving user input to generate a second pattern on the display screen includes: the user manually drags a portion of the first pattern that is visually perceived as distorted on the display screen, and the first pattern after dragging becomes the second pattern.
9. The method for determining the amount of visual distortion according to claim 1, wherein: The lines in the second pattern displayed on the display screen are different from the lines in the first pattern in at least one of the following: color, line type, and width.
10. The method for determining the amount of visual distortion according to claim 1, wherein: The user can selectively erase part or all of the second pattern.
11. The method for determining the amount of visual distortion according to claim 1, wherein: The display screen is a touch screen, and the user draws the second pattern on the display screen using a touch pen.
12. The method for determining the amount of visual distortion according to claim 1, wherein: Receiving user input to generate a second pattern on the display screen includes: the user generates the second pattern on the display screen through an external input device connected to the display screen.
13. The method for determining the amount of visual distortion according to claim 12, wherein: The external input device is a mouse, a touch pad or a drawing tablet.
14. The method for determining the amount of visual distortion according to claim 12, further comprising: Taking the user's gaze point as the coordinate origin, constructing a two-dimensional coordinate system on the display screen; And the current two-dimensional coordinates of the control point of the external input device are displayed in real time on the display screen.
15. The method for determining the amount of visual distortion according to claim 14, wherein: The unit length of the two-dimensional coordinate system is equal to the length of the unit length on the display screen.
16. The method for determining the amount of visual distortion according to claim 14, wherein: The unit length of the two-dimensional coordinate system is equal to the length of a preset number of pixels on the display screen.
17. The method for determining the amount of visual distortion according to claim 1, wherein: The first pattern is an Amsler grid, and the gaze guide point is a center point of the Amsler grid.
18. The method for determining the amount of visual distortion according to claim 17, wherein: The horizontal lines and vertical lines in the second pattern are visually perceived as straight lines by the user, and each horizontal line and vertical line in the second pattern has an intersection or an overlapping line segment with a corresponding grid line in the Amsler grid.
19. The method for determining the amount of visual distortion according to claim 18, wherein: Determining the visual distortion amount of the user includes: performing axisymmetric processing on each horizontal line and vertical line with the grid line of the Amsler grid according to the intersection points or coincident line segments of each horizontal line and vertical line with the grid line of the Amsler grid, thereby determining the visual distortion amount of the user.
20. The method for determining the amount of visual distortion according to claim 18, further comprising: A distortion set is constructed according to the first pattern and the second pattern, wherein the distortion set includes a plurality of distortion line pairs, each distortion line pair includes a state before distortion and an axially symmetrical state of the same horizontal or vertical line, and the relative position relationship between the two remains unchanged; and the position of each line in the first pattern is recorded.
21. The method for determining the amount of visual distortion according to claim 20, wherein: The warp set is stored in the form of a picture.
22. The method for determining the amount of visual distortion according to claim 17, wherein: The number of horizontal and vertical lines in the Amsler grid, the spacing between adjacent horizontal lines, and the spacing between adjacent vertical lines are set and adjusted by the user.
23. A storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method for determining the amount of visual distortion according to any one of claims 1 to 22 is implemented.
24. A device for determining the amount of visual distortion, comprising: A gaze point monitoring module, a display module, an interaction module, a processor and a storage medium, wherein: The gaze point monitoring module is used to monitor the gaze point of the user on the display module. The interaction module is used to receive user input. The display module is used to display a first pattern and a second pattern generated based on a user input, The storage medium stores a computer program, and When the computer program is executed by the processor, the method for determining the amount of visual distortion according to any one of claims 1 to 22 is implemented.
