Image-based myopia prevention and control and visual perception training method and system

Abstract

The present invention provides an image-based myopia prevention and control and visual perception training method and system, which locates and detects the relative position relationship information between a user and a terminal, determines whether the user is located in the effective spatial area of ​​the terminal for visual perception training, and thereby adjusts the first display state of the directional image displayed on the terminal interface; adjusts the second display state of the directional image based on the user's line of sight change trajectory information when viewing the directional image; also analyzes the user's response results to the directional characteristics of the directional image, determines whether the user correctly identifies the directional image, and provides a basis for subsequent changes in the image display content; and adjusts the display mode of the directional image on the terminal interface in combination with the user's response attribute information on the directional characteristics of the directional image, effectively avoiding the repeated display of the same directional image to the user, improving the flexibility and diversity of the form of training images, and providing users with a variety of targeted vision training programs.

Description

Technical Field

[0001] The present invention relates to the field of vision training, and in particular to an image-based myopia prevention and control and visual perception training method and system. Background Art

[0002] Myopia has become a major vision problem for school-age children. As their daily use of electronic devices such as smartphones increases, the probability of developing myopia among them is also gradually increasing. Generally speaking, the development of myopia is a gradual process. Initially, school-age children generally develop pseudomyopia, which is reversible. By providing appropriate vision training to school-age children, preventing them from overusing their eyes and ensuring they relax and rest their eyes, their vision can be restored to normal. Existing vision training primarily involves repeatedly gazing at images of varying sizes and orientations, allowing the eyes to continuously switch between tense and relaxed states, thus preventing them from being constantly tense and unable to effectively adjust the lens. However, existing vision training methods are often implemented using only corresponding vision training images, making the image content of the training too monotonous. This makes it impossible to provide different degrees and forms of vision training for the eyes, reduces the flexibility and diversity of vision training methods, and fails to provide targeted vision training programs for different subjects. Summary of the Invention

[0003] The purpose of the present invention is to provide an image-based myopia prevention and control and visual perception training method and system, which locates and detects the relative position relationship information between the user and the terminal, and determines whether the user is located in the effective spatial area of ​​the terminal for visual perception training, thereby adjusting the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjust the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyze the user's response to the directional characteristics of the directional image, determine whether the user correctly identifies the directional image, and provide a basis for subsequent changes in the image display content; and combined with the user's response attribute information on the directional characteristics of the directional image, adjust the display mode of the directional image on the terminal interface, effectively avoid repeatedly displaying the same directional image to the user, improve the flexibility and diversity of the form of training images, and provide users with a variety of targeted vision training programs.

[0004] The present invention is achieved through the following technical solutions:

[0005] Image-based myopia prevention and control and visual perception training methods, including:

[0006] Performing positioning detection on a user located in front of a terminal to obtain relative positional relationship information between the user and the terminal; determining, based on the relative positional relationship information, whether the user is located in an effective spatial area for visual perception training of the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0007] performing gaze tracking and identification on the user while viewing the directional image to obtain information on a trajectory of gaze changes of the user; adjusting a second display state of the directional image on the interface based on the gaze change trajectory information; and analyzing a response result of the user regarding the directional characteristics of the directional image to determine whether the user correctly identified the directional image;

[0008] The display mode of the directional image on the interface of the terminal is adjusted based on a determination result of whether the user correctly recognizes the directional image and directional characteristic response attribute information about the directional image.

[0009] Optionally, performing positioning detection on a user located in front of a terminal to obtain relative positional relationship information between the user and the terminal; and determining whether the user is located in an effective spatial area for visual perception training of the terminal based on the relative positional relationship information, thereby adjusting a first display state of a directional image displayed on an interface of the terminal, including:

[0010] Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal;

[0011] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0012] Optionally, performing gaze tracking and identification on the user while viewing the directional image to obtain gaze change trajectory information of the user; adjusting the second display state of the directional image on the interface based on the gaze change trajectory information; and analyzing the user's response result regarding the directional characteristics of the directional image to determine whether the user correctly identified the directional image, including:

[0013] performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; and determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, as the user's gaze change trajectory information;

[0014] Determining, based on the line of sight change trajectory information, a maximum offset distance between a projection position of the viewing line of sight on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged;

[0015] The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0016] Optionally, adjusting a display mode of the directional image on an interface of the terminal based on a determination result of whether the user correctly identifies the directional image and response attribute information about a directional characteristic of the directional image includes:

[0017] When the user correctly identifies the directional image, adjusting the state of the directional image displayed next time on the terminal interface based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface;

[0018] When the user fails to correctly identify the directional image, the duration for which the directional image is displayed on the interface of the terminal is adjusted based on the response time of the user regarding the directional characteristic of the directional image.

[0019] Optionally, adjusting a state of the terminal interface displaying a directional image next time based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface includes:

[0020] Step S1: Assume that there are n pieces of historical data of visual perception training for the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose directions are correctly identified by the user is s. i , the average response time for the user to correctly identify the directional image of the direction is t i , then the probability that the direction of the directional image displayed on the next interface is i is:

[0021]

[0022] In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time for the user to correctly identify the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the direction feature of the directional image, then k i 、s i , t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P i The direction of i corresponding to the maximum value is the direction of the directional image displayed on the next interface;

[0023] Step S2: Assume that the generation time of the jth data in the n data of the user's visual perception training is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is:

[0024]

[0025] In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d 、T j All are in the form of millisecond timestamps, γ is the time decay rate, and j is a number, which is an integer greater than or equal to 1 and less than or equal to n;

[0026] Step S3: Assume that the response time of the user's jth data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, when it is wrong, its value is 0, then the duration of the directional image displayed on the user interface next time is:

[0027]

[0028] In the above formula (3), T is the duration of the directional image displayed on the user's next interface;

[0029] When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

[0030] Image-based myopia prevention and control and visual perception training system, including:

[0031] A user positioning detection module is used to detect the position of a user in front of a terminal and obtain information about the relative position relationship between the user and the terminal;

[0032] A first image display state adjustment module is configured to determine, based on the relative position relationship information, whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0033] a sight tracking and recognition module, configured to perform sight tracking and recognition on the user while viewing the directional image, and obtain information on the user's sight line changes;

[0034] A second image display state adjustment module, configured to adjust a second display state of the directional image on the interface based on the sight line change trajectory information;

[0035] an image recognition result judgment module, configured to analyze the user's response result regarding the directional characteristics of the directional image and determine whether the user correctly recognizes the directional image;

[0036] The image display mode adjustment module is configured to adjust the display mode of the directional image on the terminal interface based on a determination result of whether the user correctly identifies the directional image and response attribute information about the directional characteristic of the directional image.

[0037] Optionally, the user location detection module is configured to perform location detection on a user located in front of a terminal to obtain information about a relative position relationship between the user and the terminal, including:

[0038] Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal;

[0039] The first image display state adjustment module is configured to determine whether the user is located in a visual perception training effective space area of ​​the terminal based on the relative position relationship information, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, including:

[0040] Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0041] Optionally, the gaze tracking and recognition module is configured to perform gaze tracking and recognition on the user viewing the directional image to obtain gaze change trajectory information of the user, including:

[0042] performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; and determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, as the user's gaze change trajectory information;

[0043] The second image display state adjustment module is configured to adjust the second display state of the directional image on the interface based on the sight line change trajectory information, including:

[0044] Determining, based on the line of sight change trajectory information, a maximum offset distance between a projection position of the viewing line of sight on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged;

[0045] The image recognition result judgment module is configured to analyze the user's response result regarding the directional characteristics of the directional image to determine whether the user correctly recognizes the directional image, including:

[0046] The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0047] Optionally, the image display mode adjustment module is configured to adjust the display mode of the directional image on the terminal interface based on a determination result of whether the user correctly identifies the directional image and response attribute information regarding a directional characteristic of the directional image, including:

[0048] When the user correctly identifies the directional image, adjusting the state of the directional image displayed next time on the terminal interface based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface;

[0049] When the user fails to correctly identify the directional image, the duration for which the directional image is displayed on the interface of the terminal is adjusted based on the response time of the user regarding the directional characteristic of the directional image.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] The image-based myopia prevention and control and visual perception training method and system provided in the present application locate and detect the relative position relationship information between the user and the terminal, and determine whether the user is located in the effective spatial area of ​​the terminal for visual perception training, so as to adjust the first display state of the directional image displayed on the terminal interface, so that the display of the directional image can adapt to the different user location scenes; based on the user's line of sight change trajectory information when viewing the directional image, adjust the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyze the user's response results to the directional characteristics of the directional image, determine whether the user correctly identifies the directional image, and provide a basis for subsequent changes in the image display content; and combined with the user's response attribute information on the directional characteristics of the directional image, adjust the display mode of the directional image on the terminal interface, effectively avoid repeatedly displaying the same directional image to the user, improve the flexibility and diversity of the form of training images, and provide users with a variety of targeted vision training programs. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work. Among them:

[0053] Figure 1 A schematic flow chart of the image-based myopia prevention and control and visual perception training method provided by the present invention.

[0054] Figure 2 This is a structural schematic diagram of the image-based myopia prevention and control and visual perception training system provided by the present invention. DETAILED DESCRIPTION

[0055] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It will be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some, rather than all, structures related to the present application are shown in the accompanying drawings. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0056] As used herein, the terms "comprise," "comprising," and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0057] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0058] See also Figure 1 As shown, an embodiment of the present application provides an image-based myopia prevention and control and visual perception training method. The image-based myopia prevention and control and visual perception training method includes:

[0059] Performing positioning detection on a user located in front of a terminal to obtain relative positional relationship information between the user and the terminal; determining, based on the relative positional relationship information, whether the user is located in an effective spatial area for visual perception training of the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0060] Tracking the user's gaze while viewing the directional image to obtain information about the user's gaze change trajectory; adjusting the second display state of the directional image on the interface based on the gaze change trajectory information; and analyzing the user's response regarding the directional characteristics of the directional image to determine whether the user correctly identified the directional image.

[0061] Based on the determination result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image, the display mode of the directional image on the interface of the terminal is adjusted.

[0062] The beneficial effects of the above embodiments are that the image-based myopia prevention and control and visual perception training method locates and detects the relative position relationship information between the user and the terminal, determines whether the user is located in the effective space area of ​​the terminal for visual perception training, and adjusts the first display state of the directional image displayed on the terminal interface so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, adjusts the second display state of the directional image to ensure that the user can view the complete image during the entire training process; also analyzes the user's response to the directional characteristics of the directional image, determines whether the user correctly identifies the directional image, and provides a basis for subsequent changes in the image display content; and combined with the user's response attribute information on the directional characteristics of the directional image, adjusts the display mode of the directional image on the terminal interface, effectively avoiding repeatedly displaying the same directional image to the user, improving the flexibility and diversity of the form of training images, and providing users with a variety of targeted vision training programs.

[0063] In another embodiment, a user located in front of a terminal is detected to obtain relative positional relationship information between the user and the terminal; based on the relative positional relationship information, whether the user is located in an effective spatial area for visual perception training of the terminal is determined, and thereby adjusting a first display state of a directional image displayed on an interface of the terminal, includes:

[0064] Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; and performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal;

[0065] Based on the relative position relationship information, the user's actual viewing space field of view of the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0066] The beneficial effect of the above embodiment is that during the visual perception training process, a computer terminal or other terminal is used to display directional images of different sizes and types to the user (such as image "E" and the corresponding images formed by rotating it clockwise by 90°, 180°, and 270°). In this way, the terminal will randomly display the corresponding directional image and the display of the directional image will last for a certain period of time. By watching different directional images on the terminal, the user can switch between corresponding eye tension and relaxation actions, thereby realizing the defocused attention training of the eyes, thereby avoiding the eyes being in a tense state all the time and inducing myopia or causing pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position area relative to the terminal to ensure that the user can fully view the directional image displayed by the terminal. To this end, a dynamic binocular shot of the user in front of the terminal is performed to obtain a dynamic binocular activity image of the user in front of the terminal. By analyzing the dynamic binocular activity image, the relative position relationship information between the user's activity range and the terminal can be obtained, so as to accurately identify the position change of the user relative to the terminal when the user moves during the visual perception training process, thereby determining the relative distance and relative azimuth between the user's activity range and the terminal. Based on the relative position relationship information, the user's actual viewing spatial field of view of the terminal is estimated. Specifically, the user's actual viewing spatial field of view of the terminal is estimated based on the relative distance and relative azimuth between the user's activity range and the terminal, as well as the spatial location of the terminal's interface. This is used to quantitatively identify the user's viewing range of the terminal's interface. The actual viewing spatial field of view is compared with the terminal's optimal viewing spatial field of view, and the spatial overlap ratio between the two is determined. A threshold comparison is then performed on the spatial overlap ratio to determine whether the user is located in the terminal's effective visual perception training spatial area, thereby providing a reliable basis for subsequently adjusting the display state of the directional image. When the user is located in the terminal's effective visual perception training spatial area, the display contrast of the directional image displayed on the terminal's interface is maintained unchanged; when the user is not located in the terminal's effective visual perception training spatial area, the display contrast of the directional image displayed on the terminal's interface is increased. This can improve the visual recognition of the directional image and effectively stimulate the user's visual sensitivity to the directional image.

[0067] In another embodiment, the user's gaze is tracked and identified while viewing the directional image to obtain information about the user's gaze change trajectory; based on the gaze change trajectory information, the second display state of the directional image on the interface is adjusted; and the user's response regarding the directional characteristics of the directional image is analyzed to determine whether the user correctly identified the directional image, including:

[0068] performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; and determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, as the user's gaze change trajectory information;

[0069] Determining, based on the line of sight change trajectory information, a maximum offset distance between a projection position of the viewing line of sight on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged;

[0070] The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0071] The beneficial effect of the above embodiment is that when a user is undergoing visual perception training by viewing different directional images displayed on the terminal interface, the user's line of sight may not remain fixed and may change, resulting in the user being unable to fully view the directional image displayed on the interface. To this end, the user's line of sight is tracked and identified while viewing the directional image to obtain information about changes in the user's binocular line of sight direction. Based on this binocular line of sight direction change information, information about changes in the projection position of the user's viewing point on the terminal interface is determined. This allows accurate determination of changes in the user's line of sight while viewing the directional image on the interface. Furthermore, based on this line of sight change trajectory information, the maximum offset distance between the projection position of the viewing point on the interface and the reference display area of ​​the directional image on the interface is determined. This allows accurate determination of the relative offset distance between the user's line of sight and the directional image displayed on the interface. A threshold comparison is then performed on this maximum offset distance to adaptively adjust the actual display position of the directional image on the interface, ensuring that the user can always view the complete directional image. In addition, each time the user views the directional image displayed on the interface, the user needs to identify the directional characteristics of the directional image (such as left, right, up or down). To this end, the user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the response time (that is, the time corresponding to the user's directional characteristic response voice) regarding the directional image. When the directional characteristic recognition result is consistent with the true directional characteristic of the directional image and the response time exists within the display duration range of the directional image on the interface, it is judged that the user correctly identified the directional characteristics of the directional image during the display of the directional image; otherwise, it is judged that the user did not correctly identify the directional characteristics of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image of the terminal interface.

[0072] In another embodiment, adjusting the display mode of the directional image on the terminal interface based on the determination result of whether the user correctly identifies the directional image and the directional characteristic response attribute information about the directional image includes:

[0073] When the user correctly identifies the directional image, the state of the directional image displayed next time on the terminal interface is adjusted based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface;

[0074] When the user fails to correctly identify the directional image, the duration for which the directional image is displayed on the terminal interface is adjusted based on the user's response time regarding the directional characteristic of the directional image.

[0075] The beneficial effects of the above embodiment are as follows: when the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface, a different type of directional image is selected from the corresponding directional image library within the terminal for the next display, thereby preventing the terminal from repeatedly displaying directional images of the same type or size in a short period of time, which would reduce the effectiveness of the user's visual perception training. Furthermore, when the user does not correctly identify the directional image, the duration of the terminal's interface display of the directional image is adjusted based on the user's response time regarding the directional characteristics of the directional image. For example, if the user's response time regarding the directional characteristics of the directional image is greater than a preset time, the duration of the terminal's interface display of the directional image is extended, thereby providing the user with more time to view and gaze at the directional image, thereby maximizing the effectiveness of the visual perception training.

[0076] In another embodiment, adjusting a state of a directional image displayed next time on the terminal interface based on directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface includes:

[0077] Step S1: Assume that there are n pieces of historical data of visual perception training for the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose directions are correctly identified by the user is s. i , the average response time for the user to correctly identify the directional image of the direction is t i , then the probability that the direction of the directional image displayed on the next interface is i is:

[0078]

[0079] In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time for the user to correctly identify the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the directional feature of the directional image, then k i 、s i , t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P iThe direction of i corresponding to the maximum value is the orientation of the directional image displayed on the next interface. Based on the user's historical directional image recognition results, including recognition accuracy and recognition response time, the orientation of the directional image displayed on the next interface is obtained, and the image orientation in the process of user recognition of directional images is trained.

[0080] Step S2: Assume that the generation time of the jth data in the n data of the user's visual perception training is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is:

[0081]

[0082] In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d 、T j All are in the form of millisecond timestamps, γ is the time decay rate, and j is a number, which is an integer greater than or equal to 1 and less than or equal to n;

[0083] Step S3: Assume that the response time of the user's jth data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, when it is wrong, its value is 0, then the duration of the directional image displayed on the user interface next time is:

[0084]

[0085] In the above formula (3), T is the duration of the directional image displayed on the user's next interface; thus, the duration of the directional image displayed on the user's next interface is scientifically calculated based on the user's previous recognition response time and its distance from the current time;

[0086] When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

[0087] The beneficial effects of the above embodiments are as follows: since visual perception training for users usually requires displaying directional images of different orientations and sizes to the user at different times as much as possible, it is necessary to determine the orientation and duration of the directional image displayed on the interface next time based on the directional feature distribution information and image size distribution information of all directional images displayed on the interface in the historical time period, so as to avoid the repeated appearance of directional images of the same orientation and size in a short period of time, which would affect the effectiveness of visual perception training. Based on the historical data of the user's visual perception training, the orientation and duration of the directional image displayed on the user's interface next time are scientifically evaluated and calculated, so as to avoid the repeated appearance of directional images of the same orientation and size in a short period of time, which would affect the effectiveness of visual perception training.

[0088] See also Figure 2 As shown, an embodiment of the present application provides an image-based myopia prevention and control and visual perception training system. The image-based myopia prevention and control and visual perception training system includes:

[0089] A user positioning detection module is used to detect the position of a user in front of a terminal and obtain information about the relative position of the user and the terminal;

[0090] A first image display state adjustment module is configured to determine, based on the relative position relationship information, whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal;

[0091] An eye tracking and recognition module is used to track and recognize the user's eye when viewing the directional image, and obtain information about the user's eye tracking changes;

[0092] A second image display state adjustment module, configured to adjust the second display state of the directional image on the interface based on the sight line change trajectory information;

[0093] An image recognition result judgment module is used to analyze the user's response result regarding the directional characteristics of the directional image and determine whether the user correctly recognizes the directional image;

[0094] The image display mode adjustment module is used to adjust the display mode of the directional image of the terminal interface based on the judgment result of whether the user correctly recognizes the directional image and the directional characteristic response attribute information about the directional image.

[0095] The beneficial effects of the above embodiments are as follows: the image-based myopia prevention and control and visual perception training system locates and detects the relative position relationship information between the user and the terminal, determines whether the user is located in the effective space area for visual perception training of the terminal, and adjusts the first display state of the directional image displayed on the terminal interface so that the display of the directional image can adapt to the location scenes of different users; based on the user's line of sight change trajectory information when viewing the directional image, the second display state of the directional image is adjusted to ensure that the user can view the complete image during the entire training process; it also analyzes the user's response results to the directional characteristics of the directional image to determine whether the user correctly identifies the directional image, providing a basis for subsequent changes in the image display content; and combined with the user's response attribute information on the directional characteristics of the directional image, adjusts the display mode of the directional image on the terminal interface, effectively avoiding repeatedly displaying the same directional image to the user, improving the flexibility and diversity of the form of training images, and providing users with a variety of targeted vision training programs.

[0096] In another embodiment, the user location detection module is used to perform location detection on a user located in front of a terminal to obtain relative position relationship information between the user and the terminal, including:

[0097] Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; and performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal;

[0098] The first image display state adjustment module is configured to determine, based on the relative position relationship information, whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, including:

[0099] Based on the relative position relationship information, the user's actual viewing space field of view of the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

[0100] The beneficial effect of the above embodiment is that during the visual perception training process, a computer terminal or other terminal is used to display directional images of different sizes and types to the user (such as image "E" and the corresponding images formed by rotating it clockwise by 90°, 180°, and 270°). In this way, the terminal will randomly display the corresponding directional image and the display of the directional image will last for a certain period of time. By watching different directional images on the terminal, the user can switch between corresponding eye tension and relaxation actions, thereby realizing the defocused attention training of the eyes, thereby avoiding the eyes being in a tense state all the time and inducing myopia or causing pseudomyopia to develop into true myopia. In actual training operations, the user needs to be in a suitable position area relative to the terminal to ensure that the user can fully view the directional image displayed by the terminal. To this end, a dynamic binocular shot of the user in front of the terminal is performed to obtain a dynamic binocular activity image of the user in front of the terminal. By analyzing the dynamic binocular activity image, the relative position relationship information between the user's activity range and the terminal can be obtained, so as to accurately identify the position change of the user relative to the terminal when the user moves during the visual perception training process, thereby determining the relative distance and relative azimuth between the user's activity range and the terminal. Based on the relative position relationship information, the user's actual viewing spatial field of view of the terminal is estimated. Specifically, the user's actual viewing spatial field of view of the terminal is estimated based on the relative distance and relative azimuth between the user's activity range and the terminal, as well as the spatial location of the terminal's interface. This is used to quantitatively identify the user's viewing range of the terminal's interface. The actual viewing spatial field of view is compared with the terminal's optimal viewing spatial field of view, and the spatial overlap ratio between the two is determined. A threshold comparison is then performed on the spatial overlap ratio to determine whether the user is located in the terminal's effective visual perception training spatial area, thereby providing a reliable basis for subsequently adjusting the display state of the directional image. When the user is located in the terminal's effective visual perception training spatial area, the display contrast of the directional image displayed on the terminal's interface is maintained unchanged; when the user is not located in the terminal's effective visual perception training spatial area, the display contrast of the directional image displayed on the terminal's interface is increased. This can improve the visual recognition of the directional image and effectively stimulate the user's visual sensitivity to the directional image.

[0101] In another embodiment, the gaze tracking and recognition module is configured to perform gaze tracking and recognition on the user viewing the directional image to obtain gaze change trajectory information of the user, including:

[0102] performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; and determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, as the user's gaze change trajectory information;

[0103] The second image display state adjustment module is configured to adjust the second display state of the directional image on the interface based on the sight line change trajectory information, including:

[0104] Determining, based on the line of sight change trajectory information, a maximum offset distance between a projection position of the viewing line of sight on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged;

[0105] The image recognition result judgment module is used to analyze the user's response result regarding the directional characteristics of the directional image to determine whether the user correctly recognizes the directional image, including:

[0106] The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

[0107] The beneficial effect of the above embodiment is that when a user is undergoing visual perception training by viewing different directional images displayed on the terminal interface, the user's line of sight may not remain fixed and may change, resulting in the user being unable to fully view the directional image displayed on the interface. To this end, the user's line of sight is tracked and identified while viewing the directional image to obtain information about changes in the user's binocular line of sight direction. Based on this binocular line of sight direction change information, information about changes in the projection position of the user's viewing point on the terminal interface is determined. This allows accurate determination of changes in the user's line of sight while viewing the directional image on the interface. Furthermore, based on this line of sight change trajectory information, the maximum offset distance between the projection position of the viewing point on the interface and the reference display area of ​​the directional image on the interface is determined. This allows accurate determination of the relative offset distance between the user's line of sight and the directional image displayed on the interface. A threshold comparison is then performed on this maximum offset distance to adaptively adjust the actual display position of the directional image on the interface, ensuring that the user can always view the complete directional image. In addition, each time the user views the directional image displayed on the interface, the user needs to identify the directional characteristics of the directional image (such as left, right, up or down). To this end, the user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the response time (that is, the time corresponding to the user's directional characteristic response voice) regarding the directional image. When the directional characteristic recognition result is consistent with the true directional characteristic of the directional image and the response time exists within the display duration range of the directional image on the interface, it is judged that the user correctly identified the directional characteristics of the directional image during the display of the directional image; otherwise, it is judged that the user did not correctly identify the directional characteristics of the directional image during the display of the directional image, thereby providing a reliable basis for subsequent adjustment of the display mode of the directional image of the terminal interface.

[0108] In another embodiment, the image display mode adjustment module is configured to adjust the display mode of the directional image on the terminal interface based on a determination result of whether the user correctly identifies the directional image and response attribute information regarding the directional characteristic of the directional image, including:

[0109] When the user correctly identifies the directional image, the state of the directional image displayed next time on the terminal interface is adjusted based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface;

[0110] When the user fails to correctly identify the directional image, the duration for which the directional image is displayed on the terminal interface is adjusted based on the user's response time regarding the directional characteristic of the directional image.

[0111] The beneficial effects of the above embodiment are as follows: when the user correctly identifies the directional image, based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface, a different type of directional image is selected from the corresponding directional image library within the terminal for the next display, thereby preventing the terminal from repeatedly displaying directional images of the same type or size in a short period of time, which would reduce the effectiveness of the user's visual perception training. Furthermore, when the user does not correctly identify the directional image, the duration of the terminal's interface display of the directional image is adjusted based on the user's response time regarding the directional characteristics of the directional image. For example, if the user's response time regarding the directional characteristics of the directional image is greater than a preset time, the duration of the terminal's interface display of the directional image is extended, thereby providing the user with more time to view and gaze at the directional image, thereby maximizing the effectiveness of the visual perception training.

[0112] In general, the image-based myopia prevention and control and visual perception training method and system locates and detects the relative position relationship information between the user and the terminal, determines whether the user is located in the effective spatial area of ​​the terminal for visual perception training, and adjusts the first display state of the directional image displayed on the terminal interface so that the display of the directional image can adapt to the different user location scenes; based on the user's line of sight change trajectory information when viewing the directional image, the second display state of the directional image is adjusted to ensure that the user can view the complete image during the entire training process; it also analyzes the user's response results to the directional characteristics of the directional image to determine whether the user correctly identifies the directional image, providing a basis for subsequent changes in the image display content; and combined with the user's response attribute information on the directional characteristics of the directional image, adjusts the display mode of the directional image on the terminal interface, effectively avoiding repeatedly displaying the same directional image to the user, improving the flexibility and diversity of the form of training images, and providing users with a variety of targeted vision training programs.

[0113] The above is only a specific embodiment of the present invention, and any other improvements made based on the concept of the present invention are considered to be within the scope of protection of the present invention.

Claims

1. An image-based myopia prevention and control and visual perception training method, characterized in that: include: Performing positioning detection on a user located in front of a terminal to obtain relative position information between the user and the terminal; Based on the relative position relationship information, determining whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal; performing gaze tracking and recognition on the user viewing the directional image to obtain gaze change trajectory information of the user; Adjusting a second display state of the directional image on the interface based on the sight line change trajectory information; analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly identifies the directional image; adjusting a display mode of the directional image on an interface of the terminal based on a determination result of whether the user correctly identifies the directional image and response attribute information regarding a directional characteristic of the directional image; Adjusting a display mode of the directional image on an interface of the terminal based on a determination result of whether the user correctly identifies the directional image and response attribute information about a directional characteristic of the directional image includes: When the user correctly identifies the directional image, adjusting the state of the directional image displayed next time on the terminal interface based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface; When the user fails to correctly identify the directional image, adjusting the duration of the terminal's interface displaying the directional image based on the user's response time regarding the directional characteristics of the directional image; Adjusting a state of a directional image displayed next time on the interface of the terminal based on directional characteristic distribution information and image size distribution information of all directional images historically displayed on the interface of the terminal includes: Step S1: Assume that there are n pieces of historical data of visual perception training for the user, and there are k pieces of data with the directional image direction i. i The number of directional images whose directions are correctly identified by the user is s. i , the average response time for the user to correctly identify the directional image of the direction is t i , then the probability that the direction of the directional image displayed on the next interface is i is: In the above formula (1), P i is the probability that the direction of the directional image displayed on the next interface is i. The directions of the directional image include up, down, left, and right. t1, t2, t3, and t4 represent the average response time for the user to correctly identify the direction of the directional image as up, down, left, and right, respectively. i takes 1, 2, 3, and 4. If there is no data that the user correctly identifies the direction feature of the directional image, then k i 、s i , t i All of them are taken as 1, max{t1,t2,t3,t4} is the maximum value of the average response time when the user correctly identifies the directional image direction as up, down, left, and right, j is the adjustment coefficient; take P i The direction of i corresponding to the maximum value is the direction of the directional image displayed on the next interface; Step S2: Assume that the generation time of the jth data in the n data of the user's visual perception training is T j , the current time is T d , then the time attenuation factor of the jth data of the user's visual perception training is: In the above formula (2), Q j is the time decay factor of the jth data for visual perception training for users, e is a natural constant, T d 、T j All are in the form of millisecond timestamps, γ is the time decay rate, and j is a number, which is an integer greater than or equal to 1 and less than or equal to n; Step S3: Assume that the response time of the user's jth data is m j , the correct identification of the jth data is r j , when the recognition is correct, its value is 1, when it is wrong, its value is 0, then the duration of the directional image displayed on the user interface next time is: In the above formula (3), T is the duration of the directional image displayed on the user's next interface; When the number of user recognition errors increases, the duration of the directional image displayed on the next interface will be relatively longer. When the number of user recognition errors decreases, the duration of the directional image displayed on the next interface will be relatively shorter.

2. The image-based myopia prevention and control and visual perception training method according to claim 1, characterized in that: Performing positioning detection on a user located in front of a terminal to obtain relative position information between the user and the terminal; Based on the relative position relationship information, determining whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, includes: Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal; Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

3. The image-based myopia prevention and control and visual perception training method according to claim 1, characterized in that: performing gaze tracking and identification on the user while viewing the directional image to obtain gaze change trajectory information of the user; and adjusting the second display state of the directional image on the interface based on the gaze change trajectory information; Analyzing the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly identifies the directional image includes: performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, using this as the user's gaze change trajectory information; determining, based on the gaze change trajectory information, a maximum offset distance between the projection position of the viewing viewpoint on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged; The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

4. An image-based myopia prevention and control and visual perception training system, using the image-based myopia prevention and control and visual perception training method according to any one of claims 1 to 3, characterized in that: include: A user positioning detection module is used to detect the position of a user in front of a terminal and obtain information about the relative position relationship between the user and the terminal; A first image display state adjustment module is configured to determine, based on the relative position relationship information, whether the user is located in a visual perception training effective space area of ​​the terminal, thereby adjusting a first display state of a directional image displayed on an interface of the terminal; a sight tracking and recognition module, configured to perform sight tracking and recognition on the user while viewing the directional image, and obtain information on the user's sight line changes; A second image display state adjustment module, configured to adjust a second display state of the directional image on the interface based on the sight line change trajectory information; an image recognition result judgment module, configured to analyze the user's response result regarding the directional characteristic of the directional image and judge whether the user correctly recognizes the directional image; The image display mode adjustment module is configured to adjust the display mode of the directional image on the terminal interface based on a determination result of whether the user correctly identifies the directional image and response attribute information about the directional characteristic of the directional image.

5. The image-based myopia prevention and control and visual perception training system according to claim 4, characterized in that: The user location detection module is used to detect the location of a user located in front of a terminal to obtain information about the relative position relationship between the user and the terminal, including: Performing dynamic binocular photography of a user located in front of a terminal to obtain a dynamic binocular moving image of the user in front of the terminal; generating a three-dimensional moving image of the user based on binocular parallax of the dynamic binocular moving image; performing user activity position recognition on the three-dimensional moving image to obtain relative positional relationship information between the user's activity range and the terminal; wherein the relative positional relationship information includes a relative distance and relative azimuth between the activity range and the terminal; The first image display state adjustment module is configured to determine whether the user is located in a visual perception training effective space area of ​​the terminal based on the relative position relationship information, thereby adjusting the first display state of the directional image displayed on the interface of the terminal, including: Based on the relative position relationship information, the actual viewing space field of view of the user for the terminal is estimated; the actual viewing space field of view is compared with the optimal viewing space field of view of the terminal to determine the spatial overlap ratio between the two; if the spatial overlap ratio exceeds a preset ratio threshold, it is determined that the user is located in the effective spatial area of ​​visual perception training of the terminal, thereby maintaining the display contrast of the directional image displayed on the interface of the terminal unchanged; otherwise, it is determined that the user is not located in the effective spatial area of ​​visual perception training of the terminal, thereby increasing the display contrast of the directional image displayed on the interface of the terminal.

6. The image-based myopia prevention and control and visual perception training system according to claim 4, characterized in that: The gaze tracking and recognition module is used to track and recognize the gaze of the user when viewing the directional image to obtain the user's gaze change trajectory information, including: performing gaze tracking and identification on the user while viewing the directional image to obtain binocular gaze direction change information of the user; determining, based on the binocular gaze direction change information, projection position change information of the user's viewing viewpoint on the interface of the terminal, using this as the user's gaze change trajectory information; and a second image display state adjustment module configured to adjust a second display state of the directional image on the interface based on the gaze change trajectory information, including: Determining, based on the line of sight change trajectory information, a maximum offset distance between a projection position of the viewing line of sight on the interface and a reference display area of ​​the directional image on the interface; if the maximum offset distance exceeds a preset distance threshold, adjusting the display position of the directional image on the interface; otherwise, maintaining the current display position of the directional image on the interface unchanged; The image recognition result judgment module is configured to analyze the user's response result regarding the directional characteristic of the directional image to determine whether the user correctly recognizes the directional image, including: The user's response voice regarding the directional characteristics of the directional image is fuzzy recognized to obtain the user's directional characteristic recognition result and the time when the response occurs; based on the directional characteristic recognition result and the time when the response occurs, it is determined whether the user correctly recognizes the directional characteristics of the directional image during the display of the directional image.

7. The image-based myopia prevention and control and visual perception training system according to claim 4, characterized in that: The image display mode adjustment module is configured to adjust the display mode of the directional image on the terminal interface based on a determination result of whether the user correctly identifies the directional image and response attribute information regarding the directional characteristic of the directional image, including: When the user correctly identifies the directional image, adjusting the state of the directional image displayed next time on the terminal interface based on the directional characteristic distribution information and image size distribution information of all directional images historically displayed on the terminal interface; When the user fails to correctly identify the directional image, the duration for which the directional image is displayed on the interface of the terminal is adjusted based on the response time of the user regarding the directional characteristic of the directional image.

Images