Image-based myopia prevention and control and visual perception training method and system

Abstract

The invention provides an image-based myopia prevention and control and visual perception training method and system, and the method comprises the steps: carrying out the positioning detection of the relative position relation information of a user and a terminal, judging whether the user is located in a visual perception training effective space region of the terminal or not, and adjusting the interface of the terminal to display a first display state of a directional image; adjusting a second display state of the directional image based on the sight change track information of the user watching the directional image; the directional characteristic response result of the user to the directional image is analyzed, whether the user correctly recognizes the directional image or not is judged, and a basis is provided for subsequently changing the image display content; the directional characteristic response attribute information of the directional image of the user is combined, the display mode of the directional image of the interface of the terminal is adjusted, the situation that the same directional image is repeatedly displayed to the user is effectively avoided, the form flexibility and diversity of the training image are improved, and multiple targeted visual training schemes are provided for the user.

Description

Technical Field

[0001] The present invention relates to the field of vision training, and in particular to an image-based myopia prevention and control and visual perception training method and system. Background Art

[0002] Myopia has become the main vision problem for school-age children. As the frequency of school-age children's daily use of electronic devices such as smartphones increases, the probability of myopia in school-age children is gradually increasing. Generally speaking, the occurrence of myopia is a gradual process. In the early stage, school-age children basically suffer from pseudomyopia, which is reversible. By conducting corresponding vision training for school-age children, avoiding excessive eye use and paying attention to eye relaxation and rest, school-age children can restore normal vision. Existing vision training mainly includes repeatedly looking at images of different sizes and directions with the eyes, so that the eyes can constantly switch between tense and relaxed states, avoiding the eyes from being in a tense state all the time and being unable to effectively adjust the lens. However, existing vision training is only achieved by using corresponding vision training pictures, which makes the image content of vision training too monotonous, and it is impossible to train the eyes to different degrees and forms, reducing the flexibility and diversity of vision training forms, and unable to provide targeted vision training programs for different objects. Summary of the invention

[0003] The purpose of the present invention is to provide an image-based myopia prevention and control and visual perception training method and system, which locates and detects the relative position relationship information between a user and a terminal, and determines whether the user is located in the effective spatial area of ​​the terminal for visual perception training, thereby adjusting the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjust the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyze the user's response result to the directional characteristics of the directional image, determine whether the user correctly identifies the directional image, and provide a basis for subsequent changes in the image display content; and combined with the user's response attribute information about the directional characteristics of the directional image, adjust the display mode of the directional image of the terminal interface, effectively avoid repeatedly displaying the same directional image to the user, improve the flexibility and diversity of the form of training images, and provide users with a variety of targeted vision training programs.

[0004] The present invention is achieved through the following technical solutions:

[0005] Image-based myopia prevention and control and visual perception training methods, including:

[0006] Performing positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; judging whether the user is located in an effective space area for visual perception training of the terminal based on the relative position relationship information, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0007] Performing sight tracking and recognition on the user when viewing the directional image to obtain the user's sight line change track information; adjusting the second display state of the directional image on the interface based on the sight line change track information; analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image;

[0008] The display mode of the directional image of the interface of the terminal is adjusted based on the determination result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

[0009] Optionally, positioning detection is performed on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; based on the relative position relationship information, it is determined whether the user is located in an effective space area for visual perception training of the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal, including:

[0010] Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular activity image of the user in front of the terminal; generating a three-dimensional activity image of the user based on binocular parallax of the dynamic binocular activity image; performing user activity position recognition on the three-dimensional activity image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal;

[0011] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0012] Optionally, performing sight tracking and recognition on the user viewing the directional image to obtain the user's sight line change trajectory information; adjusting the second display state of the directional image on the interface based on the sight line change trajectory information; and analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image, including:

[0013] Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; determining projection position change information of the user's viewing viewpoint on the interface of the terminal based on the binocular sight direction change information, and using this as the user's sight change trajectory information;

[0014] Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged;

[0015] Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0016] Optionally, adjusting the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image includes:

[0017] When the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, the state of the directional image displayed next time on the interface of the terminal is adjusted;

[0018] When the user fails to correctly identify the directional image, the duration of the terminal interface displaying the directional image is adjusted based on the user's response time regarding the directional characteristic of the directional image.

[0019] Optionally, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, adjusting the state of the directional image displayed next time on the interface of the terminal includes:

[0020] Step S1: Assume that there are n pieces of historical data of visual perception training performed by the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose orientation is correctly identified by the user is s. i , the average response time for users to correctly identify the directional image of the orientation is t i , then the probability that the direction of the directional image displayed on the next interface is i is:

[0021]

[0022] In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time of the user correctly identifying the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the directional feature of the directional image, then k i 、s i ,t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P i The direction represented by i corresponding to the maximum value is the direction of the directional image displayed on the next interface;

[0023] Step S2: Assume that the generation time of the jth data among the n data for visual perception training of the user is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is:

[0024]

[0025] In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d 、T j All are millisecond timestamp values, γ is the time decay rate, j is the number, which is an integer greater than or equal to 1 and less than or equal to n;

[0026] Step S3: Assume that the response time of the user's j-th data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, and when it is wrong, its value is 0. Then the duration of the directional image displayed on the user's interface next time is:

[0027]

[0028] In the above formula (3), T is the duration of the directional image displayed on the user's interface next time;

[0029] When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

[0030] Image-based myopia prevention and control and visual perception training system, including:

[0031] A user positioning detection module is used to perform positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal;

[0032] A first image display state adjustment module, configured to determine whether the user is located in a visual perception training effective space area of ​​the terminal based on the relative position relationship information, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0033] A sight tracking and recognition module, used to perform sight tracking and recognition on the user watching the directional image, and obtain the sight change trajectory information of the user;

[0034] A second image display state adjustment module, used for adjusting the second display state of the directional image on the interface based on the sight line change trajectory information;

[0035] An image recognition result judgment module, used to analyze the user's response result regarding the directional characteristic of the directional image, and judge whether the user correctly recognizes the directional image;

[0036] The image display mode adjustment module is used to adjust the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

[0037] Optionally, the user location detection module is used to perform location detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal, including:

[0038] Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular activity image of the user in front of the terminal; generating a three-dimensional activity image of the user based on binocular parallax of the dynamic binocular activity image; performing user activity position recognition on the three-dimensional activity image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal;

[0039] The first image display state adjustment module is used to determine whether the user is located in the visual perception training effective space area of ​​the terminal based on the relative position relationship information, so as to adjust the first display state of the directional image displayed on the interface of the terminal, including:

[0040] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0041] Optionally, the sight tracking and identification module is used to perform sight tracking and identification on the user viewing the directional image to obtain the user's sight line change trajectory information, including:

[0042] Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; determining projection position change information of the user's viewing viewpoint on the interface of the terminal based on the binocular sight direction change information, and using this as the user's sight change trajectory information;

[0043] The second image display state adjustment module is used to adjust the second display state of the directional image on the interface based on the sight line change trajectory information, including:

[0044] Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged;

[0045] The image recognition result judgment module is used to analyze the user's response result regarding the directional characteristic of the directional image to judge whether the user correctly recognizes the directional image, including:

[0046] Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0047] Optionally, the image display mode adjustment module is used to adjust the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image, including:

[0048] When the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, the state of the directional image displayed next time on the interface of the terminal is adjusted;

[0049] When the user fails to correctly identify the directional image, the duration of the terminal interface displaying the directional image is adjusted based on the user's response time regarding the directional characteristic of the directional image.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] The image-based myopia prevention and control and visual perception training method and system provided in the present application locate and detect the relative position relationship information between the user and the terminal, and determine whether the user is located in the effective spatial area of ​​the visual perception training of the terminal, so as to adjust the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjust the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyze the user's response results to the directional characteristics of the directional image, determine whether the user correctly identifies the directional image, and provide a basis for subsequent changes in the image display content; and adjust the display mode of the directional image of the terminal interface in combination with the user's response attribute information on the directional characteristics of the directional image, effectively avoid repeatedly displaying the same directional image to the user, improve the flexibility and diversity of the form of training images, and provide users with a variety of targeted vision training programs. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0053] Figure 1 A schematic flow chart of the image-based myopia prevention and control and visual perception training method provided by the present invention.

[0054] Figure 2 A schematic diagram of the structure of the image-based myopia prevention and control and visual perception training system provided by the present invention. DETAILED DESCRIPTION

[0055] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It is to be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some structures related to the present application are shown in the accompanying drawings, rather than all structures. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0056] The terms "including" and "having" and any variations thereof in this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0057] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0058] See also Figure 1 As shown, an image-based myopia prevention and control and visual perception training method provided by an embodiment of the present application. The image-based myopia prevention and control and visual perception training method includes:

[0059] Performing positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; based on the relative position relationship information, determining whether the user is located in an effective space area for visual perception training of the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0060] Performing sight tracking and identification on the user when viewing the directional image to obtain the user's sight line change track information; adjusting the second display state of the directional image on the interface based on the sight line change track information; analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly identifies the directional image;

[0061] Based on the determination result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image, the display mode of the directional image of the interface of the terminal is adjusted.

[0062] The beneficial effects of the above embodiments are as follows: the image-based myopia prevention and control and visual perception training method locates and detects the relative position relationship information between the user and the terminal, determines whether the user is located in the effective space area for visual perception training of the terminal, and thereby adjusts the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjusts the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyzes the user's response results to the directional characteristics of the directional image, determines whether the user correctly identifies the directional image, and provides a basis for subsequent changes in the image display content; and combined with the user's response attribute information about the directional characteristics of the directional image, adjusts the display mode of the directional image of the terminal interface, effectively avoids repeatedly displaying the same directional image to the user, improves the flexibility and diversity of the form of training images, and provides users with a variety of targeted vision training programs.

[0063] In another embodiment, positioning detection is performed on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; based on the relative position relationship information, it is determined whether the user is located in an effective space area for visual perception training of the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, including:

[0064] Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal;

[0065] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio of the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0066] The beneficial effect of the above embodiment is that during the visual perception training process, a computer terminal or other terminal is used to display directional images of different sizes and types to the user (such as image "E" and the corresponding images formed by rotating it clockwise by 90°, 180°, and 270°). In this way, the terminal will randomly display the corresponding directional images and the display of the directional images will last for a certain period of time, so that by watching different directional images on the terminal, the corresponding eye tension and relaxation actions can be switched, thereby realizing the defocused attention training of the eyes, thereby avoiding the eyes being in a tense state all the time and inducing myopia or causing pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position area relative to the terminal to ensure that the user can fully view the directional image displayed by the terminal. For this purpose, dynamic binocular shooting is performed on the user in front of the terminal to obtain a dynamic binocular activity image of the user in front of the terminal. By analyzing the dynamic binocular activity image, the relative position relationship information between the user's activity range and the terminal can be obtained, so as to accurately identify the position change of the user relative to the terminal when the user moves during the visual perception training process, thereby determining the relative distance and relative azimuth between the user's activity range and the terminal. Based on the relative position relationship information, the user's actual viewing spatial field of view of the terminal is estimated, that is, according to the relative distance and relative azimuth between the user's activity range and the terminal and the spatial position of the terminal's interface, the user's actual viewing spatial field of view of the terminal is estimated, so as to quantitatively identify the viewing range of the user's interface of the terminal, and compare the actual viewing spatial field of view with the terminal's optimal viewing spatial field of view, determine the spatial overlap ratio of the two, and compare the spatial overlap ratio with a threshold value to determine whether the user is located in the effective spatial area of ​​the visual perception training of the terminal, thereby providing a reliable basis for whether to adjust the display state of the directional image in the future. When the user is located in the effective spatial area of ​​the visual perception training of the terminal, the display contrast of the directional image displayed on the interface of the terminal is kept unchanged; when the user is not located in the effective spatial area of ​​the visual perception training of the terminal, the display contrast of the directional image displayed on the interface of the terminal is increased, so that the visual recognition of the directional image can be improved and the user's visual sensitivity to the directional image can be effectively stimulated.

[0067] In another embodiment, performing sight tracking and recognition on the user viewing the directional image to obtain the user's sight line change track information; adjusting the second display state of the directional image on the interface based on the sight line change track information; and analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image, including:

[0068] Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; based on the binocular sight direction change information, determining projection position change information of the user's viewing viewpoint on the interface of the terminal, and using this as the user's sight change trajectory information;

[0069] Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged;

[0070] Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristics recognition result and the time when the response occurs; based on the directional characteristics recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0071] The beneficial effect of the above embodiment is that during the visual perception training of the user watching different directional images displayed on the interface of the terminal, the user's line of sight may not remain fixed and may change, and the user may not be able to fully view the directional image displayed on the interface. To this end, the user's line of sight is tracked and identified when watching the directional image, and the user's binocular line of sight direction change information is obtained, and the projection position change information of the user's viewing viewpoint on the interface of the terminal is determined based on the binocular line of sight direction change information, so that the change of the user's line of sight during the viewing of the directional image on the interface can be accurately determined. In addition, based on the line of sight change trajectory information, the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface is determined, so that the relative offset distance between the user's line of sight and the directional image displayed on the interface can be accurately determined, and the maximum offset distance is compared with a threshold value, so as to adaptively adjust the actual display position of the directional image on the interface, and ensure that the user can always view the complete directional image. In addition, each time the user views a directional image displayed on the interface, the user needs to identify the directional characteristics of the directional image (such as left, right, up or down). To this end, the user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the response time (i.e., the time corresponding to the user's directional characteristic response voice) regarding the directional image. When the directional characteristic recognition result is consistent with the real directional characteristic of the directional image and the response time exists within the display duration range of the directional image on the interface, it is determined that the user correctly identified the directional characteristics of the directional image during the display of the directional image; otherwise, it is determined that the user did not correctly identify the directional characteristics of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image of the terminal interface.

[0072] In another embodiment, adjusting the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image includes:

[0073] When the user correctly identifies the directional image, the state of the terminal's interface displaying the directional image next time is adjusted based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal's interface;

[0074] When the user fails to correctly identify the directional image, the duration of the terminal's interface displaying the directional image is adjusted based on the user's response time to the directional characteristic of the directional image.

[0075] The beneficial effect of the above embodiment is that when the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, other types of directional images are selected from the corresponding directional image library inside the terminal for the next display, thereby avoiding the terminal from repeatedly displaying the same type or the same size of directional images in a short period of time, thereby reducing the effectiveness of visual perception training for the user. Also, when the user does not correctly identify the directional image, based on the user's response time to the directional characteristic of the directional image, the duration of the terminal's interface displaying the directional image is adjusted. For example, when the user's response time to the directional characteristic of the directional image is greater than the preset time, the duration of the terminal's interface displaying the directional image is extended, thereby providing the user with more time to watch and gaze at the directional image, thereby maximizing the effectiveness of visual perception training.

[0076] In another embodiment, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, adjusting the state of the directional image displayed next time on the interface of the terminal includes:

[0077] Step S1: Assume that there are n pieces of historical data of visual perception training performed by the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose orientation is correctly identified by the user is s. i , the average response time for users to correctly identify the directional image of the orientation is t i , then the probability that the direction of the directional image displayed on the next interface is i is:

[0078]

[0079] In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time of the user correctly identifying the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the directional feature of the directional image, then k i 、s i ,t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P iThe direction represented by i corresponding to the maximum value is the orientation of the directional image displayed on the next interface; according to the user's historical directional image recognition, including the recognition accuracy, recognition response time, etc., the orientation of the directional image displayed on the next interface is obtained, and the image orientation in the process of user recognition of directional images is trained competitively;

[0080] Step S2: Assume that the generation time of the jth data among the n data for visual perception training of the user is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is:

[0081]

[0082] In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d 、T j All are millisecond timestamp values, γ is the time decay rate, j is the number, which is an integer greater than or equal to 1 and less than or equal to n;

[0083] Step S3: Assume that the response time of the user's j-th data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, and when it is wrong, its value is 0. Then the duration of the directional image displayed on the user's interface next time is:

[0084]

[0085] In the above formula (3), T is the duration of the directional image displayed on the user's next interface; thus, the duration of the directional image displayed on the user's next interface is scientifically calculated based on the user's previous recognition response time and its distance from the current time;

[0086] When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

[0087] The beneficial effect of the above embodiment is that, since it is usually required to display directional images of different directions and sizes to the user as much as possible at different times during the visual perception training process, it is necessary to determine the direction and duration of the directional image displayed on the interface next time based on the directional feature distribution information and image size distribution information of all directional images displayed on the interface in the historical time period, so as to avoid the directional images of the same direction and size being repeated multiple times in a short period of time and affecting the effectiveness of the visual perception training. Based on the historical data of the user's visual perception training, the direction and duration of the directional image displayed on the user's interface next time are scientifically evaluated and calculated, so as to avoid the situation where the directional images of the same direction and size are repeated multiple times in a short period of time and affecting the effectiveness of the visual perception training.

[0088] See also Figure 2 As shown, an image-based myopia prevention and control and visual perception training system provided by an embodiment of the present application. The image-based myopia prevention and control and visual perception training system includes:

[0089] A user positioning detection module is used to perform positioning detection on a user located in front of a terminal to obtain relative position information between the user and the terminal;

[0090] A first image display state adjustment module, used to determine whether the user is located in the visual perception training effective space area of ​​the terminal based on the relative position relationship information, so as to adjust the first display state of the directional image displayed on the interface of the terminal;

[0091] A sight tracking and recognition module is used to track and recognize the sight of the user when viewing the directional image, and obtain the sight change trajectory information of the user;

[0092] A second image display state adjustment module, used for adjusting the second display state of the directional image on the interface based on the sight line change trajectory information;

[0093] An image recognition result judgment module is used to analyze the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image;

[0094] The image display mode adjustment module is used to adjust the display mode of the directional image of the terminal interface based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

[0095] The beneficial effects of the above embodiments are as follows: the image-based myopia prevention and control and visual perception training system locates and detects the relative position relationship information between the user and the terminal, determines whether the user is located in the effective space area for visual perception training of the terminal, and adjusts the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjusts the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyzes the user's response results to the directional characteristics of the directional image, determines whether the user correctly identifies the directional image, and provides a basis for subsequent changes in the image display content; and combined with the user's response attribute information about the directional characteristics of the directional image, adjusts the display mode of the directional image on the terminal interface, effectively avoids repeatedly displaying the same directional image to the user, improves the flexibility and diversity of the form of training images, and provides users with a variety of targeted vision training programs.

[0096] In another embodiment, the user location detection module is used to perform location detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal, including:

[0097] Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal;

[0098] The first image display state adjustment module is used to determine whether the user is located in the visual perception training effective space area of ​​the terminal based on the relative position relationship information, so as to adjust the first display state of the directional image displayed on the interface of the terminal, including:

[0099] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio of the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0100] The beneficial effect of the above embodiment is that during the visual perception training process, a computer terminal or other terminal is used to display directional images of different sizes and types to the user (such as image "E" and the corresponding images formed by rotating it clockwise by 90°, 180°, and 270°). In this way, the terminal will randomly display the corresponding directional images and the display of the directional images will last for a certain period of time, so that by watching different directional images on the terminal, the corresponding eye tension and relaxation actions can be switched, thereby realizing the defocused attention training of the eyes, thereby avoiding the eyes being in a tense state all the time and inducing myopia or causing pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position area relative to the terminal to ensure that the user can fully view the directional image displayed by the terminal. For this purpose, dynamic binocular shooting is performed on the user in front of the terminal to obtain a dynamic binocular activity image of the user in front of the terminal. By analyzing the dynamic binocular activity image, the relative position relationship information between the user's activity range and the terminal can be obtained, so as to accurately identify the position change of the user relative to the terminal when the user moves during the visual perception training process, thereby determining the relative distance and relative azimuth between the user's activity range and the terminal. Based on the relative position relationship information, the user's actual viewing spatial field of view of the terminal is estimated, that is, according to the relative distance and relative azimuth between the user's activity range and the terminal and the spatial position of the terminal's interface, the user's actual viewing spatial field of view of the terminal is estimated, so as to quantitatively identify the viewing range of the user's interface of the terminal, and compare the actual viewing spatial field of view with the terminal's optimal viewing spatial field of view, determine the spatial overlap ratio of the two, and compare the spatial overlap ratio with a threshold value to determine whether the user is located in the effective spatial area of ​​the visual perception training of the terminal, thereby providing a reliable basis for whether to adjust the display state of the directional image in the future. When the user is located in the effective spatial area of ​​the visual perception training of the terminal, the display contrast of the directional image displayed on the interface of the terminal is kept unchanged; when the user is not located in the effective spatial area of ​​the visual perception training of the terminal, the display contrast of the directional image displayed on the interface of the terminal is increased, so that the visual recognition of the directional image can be improved and the user's visual sensitivity to the directional image can be effectively stimulated.

[0101] In another embodiment, the sight tracking and recognition module is used to perform sight tracking and recognition on the user viewing the directional image to obtain the user's sight line change trajectory information, including:

[0102] Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; based on the binocular sight direction change information, determining projection position change information of the user's viewing viewpoint on the interface of the terminal, and using this as the user's sight change trajectory information;

[0103] The second image display state adjustment module is used to adjust the second display state of the directional image on the interface based on the sight line change trajectory information, including:

[0104] Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged;

[0105] The image recognition result judgment module is used to analyze the user's response result regarding the directional characteristic of the directional image to judge whether the user correctly recognizes the directional image, including:

[0106] Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristics recognition result and the time when the response occurs; based on the directional characteristics recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0107] The beneficial effect of the above embodiment is that during the visual perception training of the user watching different directional images displayed on the interface of the terminal, the user's line of sight may not remain fixed and may change, and the user may not be able to fully view the directional image displayed on the interface. To this end, the user's line of sight is tracked and identified when watching the directional image, and the user's binocular line of sight direction change information is obtained, and the projection position change information of the user's viewing viewpoint on the interface of the terminal is determined based on the binocular line of sight direction change information, so that the change of the user's line of sight during the viewing of the directional image on the interface can be accurately determined. In addition, based on the line of sight change trajectory information, the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface is determined, so that the relative offset distance between the user's line of sight and the directional image displayed on the interface can be accurately determined, and the maximum offset distance is compared with a threshold value, so as to adaptively adjust the actual display position of the directional image on the interface, and ensure that the user can always view the complete directional image. In addition, each time the user views a directional image displayed on the interface, the user needs to identify the directional characteristics of the directional image (such as left, right, up or down). To this end, the user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the response time (i.e., the time corresponding to the user's directional characteristic response voice) regarding the directional image. When the directional characteristic recognition result is consistent with the real directional characteristic of the directional image and the response time exists within the display duration range of the directional image on the interface, it is determined that the user correctly identified the directional characteristics of the directional image during the display of the directional image; otherwise, it is determined that the user did not correctly identify the directional characteristics of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image of the terminal interface.

[0108] In another embodiment, the image display mode adjustment module is used to adjust the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image, including:

[0109] When the user correctly identifies the directional image, the state of the terminal's interface displaying the directional image next time is adjusted based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal's interface;

[0110] When the user fails to correctly identify the directional image, the duration of the terminal's interface displaying the directional image is adjusted based on the user's response time to the directional characteristic of the directional image.

[0111] The beneficial effect of the above embodiment is that when the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, other types of directional images are selected from the corresponding directional image library inside the terminal for the next display, thereby avoiding the terminal from repeatedly displaying the same type or the same size of directional images in a short period of time, thereby reducing the effectiveness of visual perception training for the user. Also, when the user does not correctly identify the directional image, based on the user's response time to the directional characteristic of the directional image, the duration of the terminal's interface displaying the directional image is adjusted. For example, when the user's response time to the directional characteristic of the directional image is greater than the preset time, the duration of the terminal's interface displaying the directional image is extended, thereby providing the user with more time to watch and gaze at the directional image, thereby maximizing the effectiveness of visual perception training.

[0112] In general, the image-based myopia prevention and control and visual perception training method and system locate and detect the relative position relationship information between the user and the terminal, and determine whether the user is located in the effective spatial area of ​​the visual perception training of the terminal, so as to adjust the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjust the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyze the user's response results to the directional characteristics of the directional image, determine whether the user correctly identifies the directional image, and provide a basis for subsequent changes in the image display content; and combined with the user's response attribute information about the directional characteristics of the directional image, adjust the display mode of the directional image of the terminal interface, effectively avoid repeatedly displaying the same directional image to the user, improve the flexibility and diversity of the form of training images, and provide users with a variety of targeted vision training programs.

[0113] The above is only a specific implementation of the present invention, and any other improvements made based on the concept of the present invention are considered to be within the protection scope of the present invention.

Claims

1. An image-based myopia prevention and control and visual perception training method, characterized in that: include: Performing positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; Based on the relative position relationship information, determining whether the user is located in the effective space area of ​​visual perception training of the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal; Performing sight tracking and recognition on the user viewing the directional image to obtain sight change trajectory information of the user; Based on the sight line change trajectory information, adjusting the second display state of the directional image on the interface; Analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly identifies the directional image; The display mode of the directional image of the interface of the terminal is adjusted based on the determination result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

2. The image-based myopia prevention and control and visual perception training method according to claim 1, characterized in that: Performing positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; Based on the relative position relationship information, determining whether the user is located in the effective space area of ​​visual perception training of the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, includes: Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular activity image of the user in front of the terminal; generating a three-dimensional activity image of the user based on binocular parallax of the dynamic binocular activity image; performing user activity position recognition on the three-dimensional activity image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal; Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

3. The image-based myopia prevention and control and visual perception training method according to claim 1, characterized in that: Performing sight tracking and identification on the user watching the directional image to obtain the sight line change track information of the user; and adjusting the second display state of the directional image on the interface based on the sight line change track information; Analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image includes: Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; determining projection position change information of the user's viewing viewpoint on the interface of the terminal based on the binocular sight direction change information, and using this as the user's sight change trajectory information; Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged; Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

4. The image-based myopia prevention and control and visual perception training method according to claim 1, characterized in that: Based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image, adjusting the display mode of the directional image of the interface of the terminal, including: When the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, the state of the directional image displayed next time on the interface of the terminal is adjusted; When the user fails to correctly identify the directional image, the duration of the terminal interface displaying the directional image is adjusted based on the user's response time regarding the directional characteristic of the directional image.

5. The image-based myopia prevention and control and visual perception training method according to claim 4, characterized in that: Based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, adjusting the state of the directional image displayed next time on the interface of the terminal, including: Step S1: Assume that there are n pieces of historical data of visual perception training performed by the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose orientation is correctly identified by the user is s. i , the average response time for users to correctly identify the directional image of the orientation is t i , then the probability that the direction of the directional image displayed on the next interface is i is: In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time of the user correctly identifying the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the directional feature of the directional image, then k i 、s i ,t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P i The direction represented by i corresponding to the maximum value is the direction of the directional image displayed on the next interface; Step S2: Assume that the generation time of the jth data among the n data for visual perception training of the user is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is: In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d , T j All are millisecond timestamp values, γ is the time decay rate, j is the number, which is an integer greater than or equal to 1 and less than or equal to n; Step S3: Assume that the response time of the user's j-th data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, and when it is wrong, its value is 0. Then the duration of the directional image displayed on the user's interface next time is: In the above formula (3), T is the duration of the directional image displayed on the user's interface next time; When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

6. The image-based myopia prevention and control and visual perception training system is characterized by: include: A user positioning detection module is used to perform positioning detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal; A first image display state adjustment module, configured to determine whether the user is located in a visual perception training effective space area of ​​the terminal based on the relative position relationship information, thereby adjusting a first display state of a directional image displayed on an interface of the terminal; A sight tracking and recognition module, used to perform sight tracking and recognition on the user watching the directional image, and obtain the sight change trajectory information of the user; A second image display state adjustment module, used for adjusting the second display state of the directional image on the interface based on the sight line change trajectory information; An image recognition result judgment module, used to analyze the user's response result regarding the directional characteristic of the directional image, and judge whether the user correctly recognizes the directional image; The image display mode adjustment module is used to adjust the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

7. The image-based myopia prevention and control and visual perception training system according to claim 6, characterized in that: The user location detection module is used to perform location detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal, including: Performing dynamic binocular shooting of a user located in front of a terminal to obtain a dynamic binocular activity image of the user in front of the terminal; generating a three-dimensional activity image of the user based on binocular parallax of the dynamic binocular activity image; performing user activity position recognition on the three-dimensional activity image to obtain relative position relationship information between the user's activity range and the terminal; wherein the relative position relationship information includes a relative distance and a relative azimuth between the activity range and the terminal; The first image display state adjustment module is used to determine whether the user is located in the visual perception training effective space area of ​​the terminal based on the relative position relationship information, so as to adjust the first display state of the directional image displayed on the interface of the terminal, including: Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in an effective spatial area for visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area for visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

8. The image-based myopia prevention and control and visual perception training system according to claim 6, characterized in that: The sight tracking and identification module is used to track and identify the sight of the user when viewing the directional image to obtain the sight change trajectory information of the user, including: Performing sight tracking and identification on the user when viewing the directional image to obtain binocular sight direction change information of the user; determining projection position change information of the user's viewing viewpoint on the interface of the terminal based on the binocular sight direction change information, and using this as the user's sight change trajectory information; The second image display state adjustment module is used to adjust the second display state of the directional image on the interface based on the sight line change trajectory information, including: Based on the line of sight change trajectory information, determine the maximum offset distance between the projection position of the viewing line of sight on the interface and the reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjust the display position of the directional image on the interface; otherwise, keep the current display position of the directional image on the interface unchanged; The image recognition result judgment module is used to analyze the user's response result regarding the directional characteristic of the directional image to judge whether the user correctly recognizes the directional image, including: Perform fuzzy recognition on the user's response voice regarding the directional characteristics of the directional image to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, determine whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

9. The image-based myopia prevention and control and visual perception training system according to claim 6, characterized in that: The image display mode adjustment module is used to adjust the display mode of the directional image of the interface of the terminal based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image, including: When the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal, the state of the directional image displayed next time on the interface of the terminal is adjusted; When the user fails to correctly identify the directional image, the duration of the terminal interface displaying the directional image is adjusted based on the user's response time regarding the directional characteristic of the directional image.

Images