Image-based myopia prevention and control and visual perception training method and system

Abstract

Disclosed are an image-based myopia prevention and control and visual perception training method and system. The image-based myopia prevention and control and visual perception training method comprises: positioning and detecting relative position relationship information between a user and a terminal, and determining whether the user is located in an effective visual perception training space area of the terminal, so as to adjust a first display state of a directional image displayed on an interface of the terminal; adjusting, on the basis of gaze change trajectory information of the user when viewing the directional image, a second display state of the directional image; analyzing a directional characteristic response result of the user for the directional image, so as to determine whether the user correctly recognizes the directional image, thereby providing a basis for subsequent changes to an image display content; and, combined with directional characteristic response attribute information of the user about the directional image, adjusting a display mode of the directional image on the interface of the terminal. Said method effectively avoids repeated display of the same directional image to the user, improves the flexibility and diversity of training image forms, and provides the user with a variety of targeted vision training solutions.

Description

Image-based myopia prevention and control and visual perception training method and system TECHNICAL FIELD

[0001] The present application relates to the field of vision training, and in particular to an image-based myopia prevention and control and visual perception training method and system. BACKGROUND

[0002] Myopia has become a major vision problem for school-age children, and as the frequency of school-age children using electronic devices such as smartphones increases, the probability of school-age children developing myopia also gradually increases. Generally speaking, the occurrence of myopia is a gradual process, and in the early stages school-age children are basically suffering from pseudomyopia, which is reversible. By conducting appropriate vision training on school-age children, avoiding eye strain and paying attention to eye relaxation and rest, school-age children can restore normal vision. Existing vision training mainly includes repeatedly focusing on images of different sizes and directions through the eyes, so that the eyes can repeatedly switch between tension and relaxation, avoiding the eyes being in a state of tension and being unable to effectively adjust the lens. However, existing vision training is only achieved by using corresponding vision training pictures, which makes the image content of the vision training too monotonous, cannot provide different degrees and forms of vision training for the eyes, reduces the form flexibility and diversity of vision training, and cannot provide targeted vision training programs for different objects. SUMMARY

[0003] The purpose of the present application is to provide an image-based myopia prevention and control and visual perception training method and system, which detects the relative position relationship information between the user and the terminal, judges whether the user is located in the effective space area of the visual perception training of the terminal, adjusts the first display state of the directional image of the interface display of the terminal according to the judgment result, so that the display of the directional image can adapt to the position scene of different users; adjusts the second display state of the directional image based on the visual line change trajectory information of the user watching the directional image, ensures that the user can watch the complete image during the entire training process; analyzes the directional characteristic response result of the user to the directional image, judges whether the user correctly identifies the directional image, and provides a basis for subsequent changes in image display content; and adjusts the display mode of the directional image of the interface of the terminal combined with the directional characteristic response attribute information of the user about the directional image, effectively avoids repeatedly displaying the same directional image to the user, improves the form flexibility and diversity of the training image, and provides multiple targeted vision training programs for the user.

[0004] The present application is achieved by the following technical solutions:

[0005] The image-based myopia prevention and control and visual perception training method comprises:

[0006] Positioning detection is performed on a user in front of a terminal to obtain relative position relationship information of the user and the terminal; based on the relative position relationship information, it is determined whether the user is located in a visual perception training effective space region of the terminal, so as to adjust a first display state of a directional image displayed on an interface of the terminal;

[0007] Gaze tracking and recognition are performed on the user watching the directional image to obtain gaze change trajectory information of the user; based on the gaze change trajectory information, a second display state of the directional image on the interface is adjusted; analysis is performed on a directional characteristic response result of the user about the directional image, and it is determined whether the user correctly identifies the directional image;

[0008] Based on the determination result of whether the user correctly identifies the directional image and directional characteristic response attribute information about the directional image, a display mode of the directional image on the interface of the terminal is adjusted.

[0009] Optionally, positioning detection is performed on a user in front of a terminal to obtain relative position relationship information of the user and the terminal; based on the relative position relationship information, it is determined whether the user is located in a visual perception training effective space region of the terminal, so as to adjust a first display state of a directional image displayed on an interface of the terminal, comprising:

[0010] Dynamic binocular shooting is performed on a user in front of a terminal to obtain dynamic binocular activity images of the user in front of the terminal; based on binocular parallax of the dynamic binocular activity images, three-dimensional activity images of the user are generated; user activity position recognition is performed on the three-dimensional activity images to obtain relative position relationship information between an activity range of the user and the terminal; wherein the relative position relationship information comprises relative distance and relative azimuth angle between the activity range and the terminal;

[0011] Based on the relative position relationship information, an actual viewing space field of view of the user about the terminal is estimated; the actual viewing space field of view is compared with an optimal viewing space field of view of the terminal to determine a spatial overlap ratio thereof; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in a visual perception training effective space region of the terminal, so that display contrast of a directional image displayed on an interface of the terminal is kept unchanged; otherwise, it is determined that the user is not located in the visual perception training effective space region of the terminal, so that display contrast of the directional image displayed on the interface of the terminal is increased.

[0012] Optionally, line-of-sight tracking is performed on the user watching the directional image to obtain line-of-sight change trajectory information of the user; based on the line-of-sight change trajectory information, the second display state of the directional image on the interface is adjusted; the directional characteristic response result of the user with respect to the directional image is analyzed to determine whether the user correctly identifies the directional image, including:

[0013] Line-of-sight tracking is performed on the user watching the directional image to obtain binocular line-of-sight direction change information of the user; based on the binocular line-of-sight direction change information, projection position change information of the viewing point of the user on the interface of the terminal is determined, which is used as the line-of-sight change trajectory information of the user;

[0014] Based on the line-of-sight change trajectory information, the maximum offset distance between the projection position of the viewing line on the interface and the reference display area of the directional image on the interface is determined; if the maximum offset distance exceeds a preset distance threshold, the display position of the directional image on the interface is adjusted; otherwise, the current display position of the directional image on the interface is kept unchanged;

[0015] Fuzzy recognition is performed on the directional characteristic response voice of the user with respect to the directional image to obtain the directional characteristic identification result of the user with respect to the directional image and the response occurrence time; based on the directional characteristic identification result and the response occurrence time, it is determined whether the user correctly identifies the directional feature of the directional image during the display period of the directional image.

[0016] Optionally, based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information with respect to the directional image, the display mode of the directional image on the interface of the terminal is adjusted, including:

[0017] When the user correctly identifies the directional image, based on the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal, the state of displaying the directional image next time on the interface of the terminal is adjusted;

[0018] When the user does not correctly identify the directional image, based on the directional characteristic response time of the user with respect to the directional image, the duration of displaying the directional image on the interface of the terminal is adjusted.

[0019] Optionally, based on the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal, the state of displaying the directional image next time on the interface of the terminal is adjusted, including:

[0020] Step S1: Suppose there are n historical data points for the user's visual perception training, of which k data points have directional images with orientation i. i The number of directional images in which the user correctly identifies the orientation is s. i The average response time for a user to correctly identify the orientation of a directional image is t. i Then the probability that the orientation of the directional image displayed on the interface next time is i is:

[0021] In the above formula (1), P i Let k be the probability that the orientation of the directional image displayed on the interface in the next iteration is i. The orientation of the directional image includes four directions: up, down, left, and right. t1, t2, t3, and t4 represent the average response time for the user to correctly identify the orientation of the directional image as up, down, left, and right, respectively. i takes values ​​of 1, 2, 3, and 4. If there is no data on the directional features of the user correctly identifying the directional image, then k... i s i t i All values ​​are set to 1, max{t1,t2,t3,t4} is the maximum of the average response times for users to correctly identify the orientation of the directional image as up, down, left, and right, and j is the adjustment coefficient; P is set to... i The direction represented by i corresponding to the maximum value is the orientation of the directional image displayed on the interface next time;

[0022] Step S2, let T be the generation time of the j-th data in the n data points used by the user for visual perception training. j The current time is T. d Then the time decay factor for the j-th data point used in the user's visual perception training is:

[0023] In the above formula (2), Q j The time decay factor for the j-th data point used in visual perception training for the user, where e is the natural constant, and T d T j All are timestamp values ​​in milliseconds, γ is the time decay rate, and j is the number, which is an integer greater than or equal to 1 and less than or equal to n;

[0024] Step S3, let m be the response time for the j-th data item of the user. j The correct identification of the j-th data is r j When the recognition is correct, its value is 1; when the recognition is incorrect, its value is 0. The duration of the directional image displayed on the user's interface next time is:

[0025] In the above formula (3), T is the duration of the directional image displayed on the interface for the next time the user is connected;

[0026] When the number of user identification errors increases, the duration of the directional image displayed in the next interface display will relatively increase, and when the number of user identification errors decreases, the duration of the directional image displayed in the next interface display will relatively decrease.

[0027] The myopia prevention and control and visual perception training system based on images comprises:

[0028] A user positioning detection module is configured to perform positioning detection on a user located in front of a terminal machine to obtain relative position relationship information of the user and the terminal machine.

[0029] A first image display state adjustment module is configured to judge, based on the relative position relationship information, whether the user is located in a visual perception training effective space region of the terminal machine, and adjust a first display state of a directional image displayed on an interface of the terminal machine according to the judgment result.

[0030] A visual line tracking and identification module is configured to perform visual line tracking and identification on the user watching the directional image to obtain visual line change trajectory information of the user.

[0031] A second image display state adjustment module is configured to adjust a second display state of the directional image on the interface based on the visual line change trajectory information.

[0032] An image recognition result judgment module is configured to analyze a directional characteristic response result of the user about the directional image, and judge whether the user correctly identifies the directional image.

[0033] An image display mode adjustment module is configured to adjust a display mode of the directional image on the interface of the terminal machine based on the judgment result of whether the user correctly identifies the directional image and directional characteristic response attribute information about the directional image.

[0034] Compared with the prior art, the present application has the following beneficial effects:

[0035] The myopia prevention and control and visual perception training method and system based on images provided in the application detect the relative position relationship information of the user and the terminal machine, judge whether the user is located in the visual perception training effective space area of the terminal machine, adjust the first display state of the interface display directional image of the terminal machine, so that the display of the directional image can adapt to the position scene of different users; based on the visual line change track information of the user watching the directional image, adjust the second display state of the directional image, ensure that the user can watch the complete image in the whole training process; also analyze the directional characteristic response result of the user to the directional image, judge whether the user correctly identifies the directional image, provide basis for subsequent change of image display content; and combine the directional characteristic response attribute information of the user to the directional image, adjust the display mode of the directional image of the interface of the terminal machine, effectively avoid repeatedly displaying the same directional image to the user, improve the form flexibility and diversity of the training image, and provide multiple targeted vision training schemes for the user. BRIEF DESCRIPTION OF DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor. Among them:

[0037] Fig. 1 is a flowchart of the myopia prevention and control and visual perception training method based on images provided in the application.

[0038] Fig. 2 is a structural schematic diagram of the myopia prevention and control and visual perception training system based on images provided in the application. DETAILED DESCRIPTION

[0039] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application will be described in detail below with reference to the drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, in order to facilitate the description, only the parts related to the present application are shown in the drawings, but not all the structures. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0040] The terms "comprises", "comprising", "includes", "including", "has", "having" and their conjugates herein, mean "including but not limited to". As used herein, the expression "and / or" includes combinations of one or more of the associated listed items.

[0041] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment. The appearances of the phrase "in an embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are they necessarily all directed to the same embodiment, or to a single alternative embodiment. It is explicitly contemplated that embodiments described herein can be combined with each other.

[0042] Referring to FIG. 1, an embodiment of the present application provides an image-based myopia prevention and control and visual perception training method. The image-based myopia prevention and control and visual perception training method comprises:

[0043] Positioning and detecting a user located in front of a terminal to obtain relative position relationship information of the user and the terminal; judging whether the user is located in a visual perception training effective space region of the terminal based on the relative position relationship information, so as to adjust a first display state of a directional image of an interface display of the terminal;

[0044] Tracking and identifying a line of sight of the user watching the directional image to obtain line of sight change trajectory information of the user; adjusting a second display state of the directional image in the interface based on the line of sight change trajectory information; analyzing a directional characteristic response result of the user about the directional image to judge whether the user correctly identifies the directional image;

[0045] Adjusting a display mode of the directional image of the interface of the terminal based on a judgment result of whether the user correctly identifies the directional image and directional characteristic response attribute information about the directional image.

[0046] The myopia prevention and control and visual perception training method based on images has the beneficial effects that the relative position relationship information of the user and the terminal is positioned and detected, it is judged whether the user is located in the visual perception training effective space region of the terminal, the first display state of the interface display of the terminal is adjusted based on the judgment result, the display of the directional image can adapt to the position scene of different users, the second display state of the directional image is adjusted based on the visual line change track information of the user watching the directional image, the user can watch the complete image in the whole training process, the directional characteristic response result of the user to the directional image is analyzed, it is judged whether the user correctly identifies the directional image, and the basis for changing the image display content is provided, and the display mode of the directional image of the interface of the terminal is adjusted combined with the directional characteristic response attribute information of the user, the same directional image is effectively avoided from being repeatedly displayed to the user, the form flexibility and diversity of the training image are improved, and various targeted vision training schemes are provided for the user.

[0047] In another embodiment, a user located in front of a terminal is positioned and detected to obtain relative position relationship information of the user and the terminal, and based on the relative position relationship information, it is judged whether the user is located in a visual perception training effective space region of the terminal, and the first display state of the interface display of the terminal is adjusted based on the judgment result, including:

[0048] The user located in front of the terminal is dynamically binocularly photographed to obtain a dynamic binocular activity image of the user in front of the terminal, the three-dimensional activity image of the user is generated based on the binocular parallax of the dynamic binocular activity image, and the relative position relationship information between the activity range of the user and the terminal is obtained by identifying the activity position of the three-dimensional activity image, wherein the relative position relationship information includes the relative distance and the relative azimuth angle between the activity range and the terminal.

[0049] Based on the relative position relationship information, the actual viewing space visual field angle of the user to the terminal is estimated, the actual viewing space visual field angle and the best viewing space visual field angle of the terminal are compared to determine the spatial overlap ratio, if the spatial overlap ratio exceeds a preset ratio threshold, it is judged that the user is located in the visual perception training effective space region of the terminal, so that the display contrast of the interface display of the terminal is kept unchanged, otherwise, it is judged that the user is not located in the visual perception training effective space region of the terminal, so that the display contrast of the interface display of the terminal is increased.

[0050] The beneficial effects of the above embodiments are that, in the visual perception training process, a terminal such as a computer terminal is used to display different sizes and types of directional images (such as image "E" and images formed by rotating image "E" 90°, 180°, and 270° clockwise) to the user, so that the terminal randomly displays the corresponding directional image and displays the directional image for a certain length of time, so that the user can switch between eye tension and relaxation by looking at different directional images on the terminal, thereby achieving off-focus eye fixation training, thereby avoiding the eyes being in a state of tension all the time, which can induce myopia or cause pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position relative to the terminal to ensure that the user can completely watch the directional image displayed by the terminal. Therefore, the user is dynamically photographed with both eyes in front of the terminal to obtain dynamic binocular activity images of the user in front of the terminal. By analyzing the dynamic binocular activity images, the relative positional relationship information between the activity range of the user and the terminal can be obtained, so that the position change of the user relative to the terminal when the user moves during the visual perception training process can be accurately identified, and the relative distance and relative azimuth angle between the activity range of the user and the terminal are determined. Based on the relative positional relationship information, the actual viewing space field of view of the user to the terminal is estimated, that is, according to the relative distance and relative azimuth angle between the activity range of the user and the terminal and the spatial position of the interface of the terminal, the actual viewing space field of view of the user to the terminal is estimated, so that the field of view range of the user watching the interface of the terminal is quantitatively identified, and the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio of the two, and the spatial overlap ratio is compared with a threshold value to determine whether the user is located in the effective space area of the visual perception training of the terminal, thereby providing a reliable basis for subsequent adjustment of the display state of the directional image. When the user is located in the effective space area of the visual perception training of the terminal, the display contrast of the interface of the terminal displaying the directional image is kept unchanged; when the user is not located in the effective space area of the visual perception training of the terminal, the display contrast of the interface of the terminal displaying the directional image is increased, so that the visual recognition of the directional image can be improved, and the visual sensitivity of the user to the directional image can be effectively stimulated.

[0051] In another embodiment, the line-of-sight tracking of the user watching the directional image is identified to obtain the line-of-sight change trajectory information of the user; based on the line-of-sight change trajectory information, the second display state of the directional image on the interface is adjusted; and the directional characteristic response result of the user to the directional image is analyzed to determine whether the user correctly identifies the directional image, including:

[0052] gaze tracking identification is performed on the user watching the directional image to obtain binocular gaze direction change information of the user; based on the binocular gaze direction change information, projection position change information of a viewing viewpoint of the user on an interface of the terminal is determined, which is used as gaze change trajectory information of the user;

[0053] based on the gaze change trajectory information, a maximum offset distance between a projection position of the viewing gaze on the interface and a reference display region of the directional image on the interface is determined; if the maximum offset distance exceeds a preset distance threshold, a display position of the directional image on the interface is adjusted; otherwise, a current display position of the directional image on the interface is kept unchanged;

[0054] fuzzy recognition is performed on the direction characteristic response voice of the user about the directional image to obtain a direction characteristic identification result of the user about the directional image and a response occurrence time; based on the direction characteristic identification result and the response occurrence time, it is judged whether the user correctly identifies the direction characteristic of the directional image during the directional image display period.

[0055] The beneficial effects of the above embodiments are that during the visual perception training process of the user watching the different directional images displayed on the interface of the terminal, the user's line of sight may change, and at this time the user may not be able to completely watch the directional image displayed on the interface. Therefore, the line of sight of the user watching the directional image is tracked and identified to obtain the binocular line of sight direction change information of the user, and the projection position change information of the viewing point of the user on the interface of the terminal is determined based on the binocular line of sight direction change information. This can accurately determine the change of the line of sight of the user when watching the directional image on the interface. Based on the line of sight change trajectory information, the maximum offset distance between the projection position of the viewing line on the interface and the reference display area of the directional image on the interface is determined. This can accurately determine the relative offset distance between the line of sight of the user and the directional image displayed on the interface, and compare the maximum offset distance with a threshold value to adaptively adjust the actual display position of the directional image on the interface, so that the user can always watch the complete directional image. In addition, the user needs to identify the directional characteristics (such as left, right, up or down) of the directional image displayed on the interface each time. Therefore, the user's directional characteristic response voice about the directional image is fuzzy identified to obtain the directional characteristic identification result of the user about the directional image and the response occurrence time (i.e. the time corresponding to the directional characteristic response voice of the user). When the directional characteristic identification result is consistent with the true directional characteristic of the directional image and the response occurrence time is within the display duration range of the directional image on the interface, it is judged that the user correctly identifies the directional characteristic of the directional image during the display of the directional image. Otherwise, it is judged that the user does not correctly identify the directional characteristic of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image on the interface of the terminal.

[0056] In another embodiment, based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image, the display mode of the directional image on the interface of the terminal is adjusted, including:

[0057] When the user correctly identifies the directional image, the display state of the directional image on the interface of the terminal is adjusted based on the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal.

[0058] When the user does not correctly identify the directional image, the display duration of the directional image on the interface of the terminal is adjusted based on the directional characteristic response time of the user about the directional image.

[0059] The beneficial effect of the above embodiment is that when the user correctly identifies the directional image, the direction characteristic distribution information and the image size distribution information of all directional images displayed based on the interface history of the terminal are used to select other types of directional images from the corresponding directional image library in the terminal for the next display, thereby avoiding repeated display of the same type or size of directional image in the terminal for a short time and reducing the effectiveness of visual perception training for the user. When the user does not correctly identify the directional image, the duration of the directional image displayed by the interface of the terminal is adjusted based on the response time of the user to the directional characteristics of the directional image. For example, when the response time of the user to the directional characteristics of the directional image is greater than a preset time, the duration of the directional image displayed by the interface of the terminal is extended, thereby providing more time for the user to watch the directional image and maximizing the effectiveness of visual perception training.

[0060] The beneficial effect of the above embodiment is that since the user is usually required to display directional images of different orientations and sizes at different times during visual perception training, the direction characteristic distribution information and the image size distribution information of all directional images displayed by the interface in the historical time period are used to determine the orientation and duration of the directional image displayed by the interface next time, thereby avoiding the same orientation and size of directional image from appearing repeatedly in a short time and affecting the effectiveness of visual perception training. According to the historical data of the user during visual perception training, the orientation and duration of the directional image displayed by the interface next time are scientifically evaluated and calculated, thereby avoiding the same orientation and size of directional image from appearing repeatedly in a short time and affecting the effectiveness of visual perception training.

[0061] Referring to FIG. 2, an embodiment of the present application provides an image-based myopia prevention and control and visual perception training system. The image-based myopia prevention and control and visual perception training system comprises:

[0062] A user positioning detection module is configured to perform positioning detection on a user located in front of the terminal to obtain relative position relationship information of the user and the terminal.

[0063] A first image display state adjustment module is configured to determine, based on the relative position relationship information, whether the user is located in a visual perception training effective space region of the terminal, and adjust a first display state of the directional image displayed by the interface of the terminal.

[0064] A line-of-sight tracking identification module is configured to perform line-of-sight tracking identification on the user watching the directional image to obtain line-of-sight change trajectory information of the user.

[0065] The second image display state adjustment module is configured to adjust a second display state of the directional image on the interface based on the line-of-sight change trajectory information.

[0066] The image recognition result judgment module is configured to analyze the directional characteristic response result of the user about the directional image, and judge whether the user correctly recognizes the directional image.

[0067] The image display mode adjustment module is configured to adjust a display mode of the directional image on the interface of the terminal based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

[0068] The above-mentioned embodiments have the following beneficial effects. The myopia prevention and control system based on images detects the relative position relationship information between the user and the terminal, judges whether the user is located in the visual perception training effective space area of the terminal, adjusts the first display state of the directional image on the interface of the terminal, so that the display of the directional image can adapt to different user locations; adjusts the second display state of the directional image based on the line-of-sight change trajectory information of the user watching the directional image, so that the user can watch the complete image during the whole training process; analyzes the directional characteristic response result of the user about the directional image, judges whether the user correctly recognizes the directional image, and provides a basis for subsequent changes of the image display content; and adjusts the display mode of the directional image on the interface of the terminal based on the directional characteristic response attribute information of the user about the directional image, effectively avoids repeatedly displaying the same directional image to the user, improves the form flexibility and diversity of the training image, and provides multiple targeted vision training schemes for the user.

[0069] In another embodiment, the user positioning detection module is configured to positionally detect a user located in front of the terminal, and obtain the relative position relationship information between the user and the terminal, including:

[0070] The user located in front of the terminal is dynamically binocularly photographed to obtain a dynamic binocular activity image of the user in front of the terminal; a three-dimensional activity image of the user is generated based on the binocular parallax of the dynamic binocular activity image; and the three-dimensional activity image is subjected to user activity position recognition to obtain the relative position relationship information between the activity range of the user and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth angle between the activity range of the user and the terminal.

[0071] The first image display state adjustment module is configured to judge whether the user is located in the visual perception training effective space area of the terminal based on the relative position relationship information, and adjust the first display state of the directional image on the interface of the terminal, including:

[0072] Based on the relative position relationship information, an actual viewing space field of view of the user to the terminal is estimated; the actual viewing space field of view is compared with an optimal viewing space field of view of the terminal, and a spatial overlap ratio of the two is determined; if the spatial overlap ratio exceeds a preset ratio threshold, it is judged that the user is located in a visual perception training effective space region of the terminal, so that a display contrast of an interface display directional image of the terminal is kept unchanged; otherwise, it is judged that the user is not located in the visual perception training effective space region of the terminal, so that the display contrast of the interface display directional image of the terminal is increased.

[0073] The beneficial effects of the above embodiments are that, in the visual perception training process, a terminal such as a computer terminal is used to display different sizes and types of directional images (such as image "E" and images formed by rotating image "E" 90°, 180°, and 270° clockwise) to the user, so that the terminal randomly displays the corresponding directional image and displays the directional image for a certain length of time, so that the user can switch between eye tension and relaxation by looking at different directional images on the terminal, realize the training of the eye's defocus fixation, and thus avoid the eye being in a state of tension all the time to induce myopia or cause pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position relative to the terminal to ensure that the user can completely watch the directional image displayed by the terminal. Therefore, the user in front of the terminal is dynamically binocularly photographed to obtain a dynamic binocular activity image of the user in front of the terminal. By analyzing the dynamic binocular activity image, the relative positional relationship information between the activity range of the user and the terminal can be obtained, so that the position change of the user relative to the terminal when the user moves during the visual perception training process can be accurately identified, and the relative distance and relative azimuth angle between the activity range of the user and the terminal are determined. Based on the relative positional relationship information, the actual viewing space field of view of the user to the terminal is estimated, that is, according to the relative distance and relative azimuth angle between the activity range of the user and the terminal and the spatial position of the interface of the terminal, the actual viewing space field of view of the user to the terminal is estimated, so that the field of view range of the user watching the interface of the terminal is quantitatively identified, and the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio of the two, and the spatial overlap ratio is compared with a threshold value to determine whether the user is located in the effective space area of the visual perception training of the terminal, thereby providing a reliable basis for subsequent adjustment of the display state of the directional image. When the user is located in the effective space area of the visual perception training of the terminal, the display contrast of the interface of the terminal displaying the directional image is kept unchanged; when the user is not located in the effective space area of the visual perception training of the terminal, the display contrast of the interface of the terminal displaying the directional image is increased, so that the visual recognition degree of the directional image can be improved, and the visual sensitivity of the user to the directional image can be effectively stimulated.

[0074] In another embodiment, the line-of-sight tracking identification module is used to track and identify the line-of-sight of the user watching the directional image to obtain the line-of-sight change trajectory information of the user, including:

[0075] The gaze tracking identification is performed on the user watching the directional image, and binocular gaze direction change information of the user is obtained; based on the binocular gaze direction change information, projection position change information of a viewing viewpoint of the user on an interface of the terminal is determined, which is used as gaze change trajectory information of the user;

[0076] The second image display state adjustment module is configured to adjust a second display state of the directional image on the interface based on the gaze change trajectory information, including:

[0077] Based on the gaze change trajectory information, a maximum offset distance between a projection position of the viewing gaze on the interface and a reference display region of the directional image on the interface is determined; if the maximum offset distance exceeds a preset distance threshold, a display position of the directional image on the interface is adjusted; otherwise, the current display position of the directional image on the interface is kept unchanged;

[0078] The image recognition result judgment module is configured to analyze a directional characteristic response result of the user about the directional image, and judge whether the user correctly recognizes the directional image, including:

[0079] The fuzzy recognition is performed on the directional characteristic response voice of the user about the directional image, and directional characteristic recognition result and response occurrence time of the user about the directional image are obtained; based on the directional characteristic recognition result and the response occurrence time, it is judged whether the user correctly recognizes the directional feature of the directional image during the directional image display period.

[0080] The beneficial effects of the above embodiments are that during the visual perception training process of the user watching the different directional images displayed on the interface of the terminal, the user's line of sight may change, and at this time the user may not be able to completely watch the directional image displayed on the interface. Therefore, the line of sight of the user watching the directional image is tracked and identified to obtain the binocular line of sight direction change information of the user, and the projection position change information of the viewing point of the user on the interface of the terminal is determined based on the binocular line of sight direction change information. This can accurately determine the change of the line of sight of the user when watching the directional image on the interface. Based on the line of sight change trajectory information, the maximum offset distance between the projection position of the viewing line on the interface and the reference display area of the directional image on the interface is determined. This can accurately determine the relative offset distance between the line of sight of the user and the directional image displayed on the interface, and compare the maximum offset distance with a threshold value to adaptively adjust the actual display position of the directional image on the interface, so that the user can always watch the complete directional image. In addition, the user needs to identify the directional characteristics (such as left, right, up or down) of the directional image displayed on the interface each time. Therefore, the directional characteristic response voice of the user about the directional image is fuzzy identified to obtain the directional characteristic identification result of the user about the directional image and the response occurrence time (i.e. the time corresponding to the directional characteristic response voice of the user). When the directional characteristic identification result is consistent with the true directional characteristic of the directional image and the response occurrence time is within the display duration range of the directional image on the interface, it is judged that the user correctly identifies the directional characteristic of the directional image during the display of the directional image. Otherwise, it is judged that the user does not correctly identify the directional characteristic of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image on the interface of the terminal.

[0081] In another embodiment, the image display mode adjustment module is configured to adjust the display mode of the directional image on the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image, including:

[0082] When the user correctly identifies the directional image, the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal are used to adjust the state of the next display of the directional image on the interface of the terminal.

[0083] When the user does not correctly identify the directional image, the duration of the display of the directional image on the interface of the terminal is adjusted based on the directional characteristic response time of the user about the directional image.

[0084] The beneficial effects of the above embodiments are that when the user correctly identifies the directional image, the direction characteristic distribution information and image size distribution information of all directional images displayed based on the interface history of the terminal are used to select other types of directional images from the corresponding directional image library in the terminal for the next display, thereby avoiding repeated display of the same type or size of directional image in a short time, and reducing the effectiveness of visual perception training for the user. When the user does not correctly identify the directional image, the duration of the interface of the terminal displaying the directional image is adjusted based on the response time of the user about the direction characteristic of the directional image, such as when the response time of the user about the direction characteristic of the directional image is greater than the preset time, the duration of the interface of the terminal displaying the directional image is extended, thereby providing more time for the user to watch the directional image, and maximizing the effectiveness of visual perception training.

[0085] In general, the image-based myopia prevention and control and visual perception training method and system detect the relative position relationship information between the user and the terminal, determine whether the user is located in the visual perception training effective space area of the terminal, adjust the first display state of the interface of the terminal displaying the directional image, so that the display of the directional image can adapt to different user locations; based on the visual line change trajectory information of the user watching the directional image, the second display state of the directional image is adjusted to ensure that the user can watch the complete image during the entire training process; the directional characteristic response result of the user to the directional image is analyzed to determine whether the user correctly identifies the directional image, which provides a basis for subsequent changes in image display content; and the display mode of the directional image of the interface of the terminal is adjusted in combination with the directional characteristic response attribute information of the user about the directional image, which effectively avoids repeatedly displaying the same directional image to the user, improves the form flexibility and diversity of the training image, and provides multiple targeted vision training schemes for the user.

[0086] The above is only one specific embodiment of the present application, and any improvement made on the basis of the concept of the present application is considered to be within the scope of protection of the present application.

Claims

1. An image-based myopia prevention and control and visual perception training method, characterized in that, The method comprises the following steps: detecting the relative position relationship information between the user in front of the terminal and the terminal; judging whether the user is in the visual perception training effective space region of the terminal based on the relative position relationship information, and adjusting the first display state of the directional image displayed on the interface of the terminal; tracking and identifying the line of sight of the user watching the directional image to obtain the line of sight change trajectory information of the user; adjusting the second display state of the directional image on the interface based on the line of sight change trajectory information; analyzing the response result of the user about the directional characteristics of the directional image to determine whether the user correctly identifies the directional image; adjusting the display mode of the directional image on the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image.

2. The image-based myopia prevention and control and visual perception training method of claim 1, wherein: detecting the relative position relationship information between the user in front of the terminal and the terminal; judging whether the user is in the visual perception training effective space region of the terminal based on the relative position relationship information, and adjusting the first display state of the directional image displayed on the interface of the terminal, comprising: capturing the dynamic binocular image of the user in front of the terminal to obtain the dynamic binocular activity image of the user in front of the terminal; generating a three-dimensional activity image of the user based on the binocular parallax of the dynamic binocular activity image; identifying the activity range of the user based on the three-dimensional activity image to obtain the relative position relationship information between the activity range of the user and the terminal; wherein the relative position relationship information comprises the relative distance and the relative azimuth angle between the activity range of the user and the terminal; estimating the actual viewing space field angle of the user to the terminal based on the relative position relationship information; comparing the actual viewing space field angle with the optimal viewing space field angle of the terminal to determine the spatial overlap ratio; if the spatial overlap ratio exceeds the preset ratio threshold, it is determined that the user is in the visual perception training effective space region of the terminal, so that the display contrast of the directional image displayed on the interface of the terminal remains unchanged; otherwise, it is determined that the user is not in the visual perception training effective space region of the terminal, so that the display contrast of the directional image displayed on the interface of the terminal is increased.

3. The image-based myopia prevention and control and visual perception training method of claim 1, wherein: tracking and identifying the line of sight of the user watching the directional image to obtain the line of sight change trajectory information of the user; adjusting the second display state of the directional image on the interface based on the line of sight change trajectory information; analyzing the response result of the user about the directional characteristics of the directional image to determine whether the user correctly identifies the directional image, comprising: The gaze tracking identification is performed on the user watching the directional image, to obtain binocular gaze direction change information of the user; based on the binocular gaze direction change information, projection position change information of the watching gaze point of the user on the interface of the terminal is determined, which is used as the gaze change trajectory information of the user; Based on the gaze change trajectory information, the maximum offset distance between the projection position of the watching gaze on the interface and the reference display region of the directional image on the interface is determined; if the maximum offset distance exceeds a preset distance threshold, the display position of the directional image on the interface is adjusted; otherwise, the current display position of the directional image on the interface is kept unchanged; The fuzzy recognition is performed on the directional characteristic response voice of the user about the directional image, to obtain the directional characteristic recognition result of the user about the directional image and the response occurrence time; based on the directional characteristic recognition result and the response occurrence time, it is judged whether the user correctly identifies the directional feature of the directional image during the directional image display period.

4. The image-based myopia prevention and control and visual perception training method of claim 1, wherein: Based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image, the display mode of the directional image on the interface of the terminal is adjusted, including: When the user correctly identifies the directional image, based on the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal, the state of displaying the directional image next time on the interface of the terminal is adjusted; When the user does not correctly identify the directional image, based on the directional characteristic response time of the user about the directional image, the display duration of the directional image on the interface of the terminal is adjusted.

5. The image-based myopia prevention and control and visual perception training method of claim 4, wherein: Based on the directional characteristic distribution information and the image size distribution information of all directional images historically displayed on the interface of the terminal, the state of displaying the directional image next time on the interface of the terminal is adjusted, including: Step S1, suppose the history data of the user's visual perception training has n pieces, wherein the data of the orientation i of the directional image has k pieces i , the number of the directional image of the orientation i which is correctly recognized by the user is s i , the average response time of the directional image of the orientation i which is correctly recognized by the user is t i , then the probability of the orientation i of the directional image displayed in the next interface is: In the above formula (1), P i is the probability of the orientation i of the directional image displayed in the next interface, the orientation of the directional image includes four directions of up, down, left and right, t1, t2, t3 and t4 respectively represent the average response time of the user correctly identifying the directional image orientation as up, down, left and right, i takes 1, 2, 3 and 4, and k i , s i , t i all take 1, max{t1, t2, t3, t4} is the maximum value of the average response time of the user correctly identifying the directional image orientation as up, down, left and right, and j is an adjustment coefficient; the direction represented by i corresponding to the maximum value of P i is the orientation of the directional image displayed in the next interface. Step S2, assuming that the user performs visual perception training n data, the first j data generation time is T j , the current time is T d , then the user performs visual perception training j data time decay factor is: In the above formula (2), Q j is a time decay factor of the jth data for visual perception training of the user, e is a natural constant, T d , T j are both time stamp values in milliseconds, γ is a time decay rate, and j is a number that is an integer greater than or equal to 1 and less than or equal to n. Step S3, let the response time of the jth data of the user be m j , the correct identification of the jth data is r j , when the identification is correct, the value is 1, and when the identification is wrong, the value is 0, then the duration of the directional image displayed in the next interface of the user is: In the above formula (3), T is the display duration of the directional image next time on the interface of the user; When the number of user identification errors increases, the display duration of the directional image next time on the interface will relatively become longer, and when the number of user identification errors decreases, the display duration of the directional image next time on the interface will relatively become shorter.

6. The image-based myopia prevention and control and visual perception training system is characterized in that, including: A user positioning detection module is configured to perform positioning detection on a user located in front of the terminal, to obtain relative position relationship information of the user and the terminal; A first image display state adjustment module is configured to judge, based on the relative position relationship information, whether the user is located in a visual perception training effective space region of the terminal, to thereby adjust a first display state of displaying a directional image on the interface of the terminal; a gaze tracking identification module, configured to perform gaze tracking identification on the user watching the directional image, to obtain gaze change trajectory information of the user; a second image display state adjustment module, configured to adjust a second display state of the directional image on the interface of the terminal based on the gaze change trajectory information; an image recognition result judgment module, configured to analyze a directional characteristic response result of the user about the directional image, to judge whether the user correctly recognizes the directional image; an image display mode adjustment module, configured to adjust a display mode of the directional image on the interface of the terminal based on a judgment result of whether the user correctly recognizes the directional image and directional characteristic response attribute information about the directional image.

7. The image-based myopia prevention and control and visual perception training system of claim 6, wherein: the user positioning detection module is configured to perform positioning detection on a user located in front of the terminal, to obtain relative position relationship information between the user and the terminal, including: performing dynamic binocular shooting on the user located in front of the terminal, to obtain dynamic binocular activity images of the user in front of the terminal; generating a three-dimensional activity image of the user based on binocular parallax of the dynamic binocular activity images; and performing user activity position recognition on the three-dimensional activity image, to obtain relative position relationship information between an activity range of the user and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth angle between the activity range and the terminal; the first image display state adjustment module is configured to judge whether the user is located in a visual perception training effective space region of the terminal based on the relative position relationship information, to thereby adjust a first display state of the directional image displayed on the interface of the terminal, including: estimating an actual viewing space field of view of the user for the terminal based on the relative position relationship information; comparing the actual viewing space field of view with an optimal viewing space field of view of the terminal, to determine a spatial overlap ratio therebetween; if the spatial overlap ratio exceeds a preset ratio threshold, judging that the user is located in the visual perception training effective space region of the terminal, so as to keep a display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, judging that the user is not located in the visual perception training effective space region of the terminal, so as to increase the display contrast of the directional image displayed on the interface of the terminal.

8. The image-based myopia prevention and control and visual perception training system of claim 6, wherein: the gaze tracking identification module is configured to perform gaze tracking identification on the user watching the directional image, to obtain gaze change trajectory information of the user, including: performing gaze tracking identification on the user watching the directional image, to obtain binocular gaze direction change information of the user; and determining projection position change information of a viewing point of the user on the interface of the terminal based on the binocular gaze direction change information, to thereby use the projection position change information as the gaze change trajectory information of the user. The second image display state adjustment module is configured to adjust a second display state of the directive image on the interface based on the gaze change trajectory information, including: determining a maximum offset distance between a projection position of the viewing gaze on the interface and a reference display region of the directive image on the interface based on the gaze change trajectory information; adjusting a display position of the directive image on the interface if the maximum offset distance exceeds a preset distance threshold; otherwise, keeping the current display position of the directive image on the interface unchanged; The image recognition result judgment module is configured to analyze a directional characteristic response result of the user about the directive image, and judge whether the user correctly recognizes the directive image, including: performing fuzzy recognition on a directional characteristic response voice of the user about the directive image to obtain a directional characteristic recognition result of the user about the directive image and a response occurrence time; judging whether the user correctly recognizes a directional feature of the directive image during a display period of the directive image based on the directional characteristic recognition result and the response occurrence time.

9. The image-based myopia prevention and control and visual perception training system of claim 6, wherein: The image display mode adjustment module is configured to adjust a display mode of the directive image on the interface of the terminal machine based on a judgment result of whether the user correctly recognizes the directive image and directional characteristic response attribute information about the directive image, including: when the user correctly recognizes the directive image, adjusting a state of displaying a next directive image on the interface of the terminal machine based on directional characteristic distribution information and image size distribution information of all directive images historically displayed on the interface of the terminal machine; when the user does not correctly recognize the directive image, adjusting a display duration of the directive image on the interface of the terminal machine based on a directional characteristic response response time of the user about the directive image.

Images